[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:14:43.736718  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:36083
I20260709 13:14:43.738641  7657 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:14:43.739784  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:14:43.760490  7657 server_base.cc:1061] running on GCE node
W20260709 13:14:43.758370  7664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.758320  7663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:43.758360  7666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:45.016155  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:45.016444  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:45.016628  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602885016599 us; error 0 us; skew 500 ppm
I20260709 13:14:45.017632  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:45.023680  7657 webserver.cc:533] Webserver started at http://127.7.122.126:34903/ using document root <none> and password file <none>
I20260709 13:14:45.024606  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:45.024813  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:45.025336  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:45.031543  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "4e862cccafe54f3ba06372d53e2e7766"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.041054  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.004s
I20260709 13:14:45.046839  7672 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.048321  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:14:45.048754  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "4e862cccafe54f3ba06372d53e2e7766"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.049177  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:45.117375  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:45.119633  7657 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:14:45.120321  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:45.202680  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:36083
I20260709 13:14:45.202776  7723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:36083 every 8 connection(s)
I20260709 13:14:45.211318  7724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:45.234436  7724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766: Bootstrap starting.
I20260709 13:14:45.241308  7724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:45.243285  7724 log.cc:826] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766: Log is configured to *not* fsync() on all Append() calls
I20260709 13:14:45.248297  7724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766: No bootstrap required, opened a new log
I20260709 13:14:45.269738  7724 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e862cccafe54f3ba06372d53e2e7766" member_type: VOTER }
I20260709 13:14:45.270323  7724 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:45.270588  7724 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e862cccafe54f3ba06372d53e2e7766, State: Initialized, Role: FOLLOWER
I20260709 13:14:45.271668  7724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e862cccafe54f3ba06372d53e2e7766" member_type: VOTER }
I20260709 13:14:45.272182  7724 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:45.272480  7724 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:45.272926  7724 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:45.277664  7724 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e862cccafe54f3ba06372d53e2e7766" member_type: VOTER }
I20260709 13:14:45.278496  7724 leader_election.cc:304] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e862cccafe54f3ba06372d53e2e7766; no voters: 
I20260709 13:14:45.280625  7724 leader_election.cc:290] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:45.280993  7727 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:45.286057  7724 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:45.289813  7727 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 1 LEADER]: Becoming Leader. State: Replica: 4e862cccafe54f3ba06372d53e2e7766, State: Running, Role: LEADER
I20260709 13:14:45.290802  7727 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e862cccafe54f3ba06372d53e2e7766" member_type: VOTER }
I20260709 13:14:45.303027  7729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e862cccafe54f3ba06372d53e2e7766. Latest consensus state: current_term: 1 leader_uuid: "4e862cccafe54f3ba06372d53e2e7766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e862cccafe54f3ba06372d53e2e7766" member_type: VOTER } }
I20260709 13:14:45.303279  7728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e862cccafe54f3ba06372d53e2e7766" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e862cccafe54f3ba06372d53e2e7766" member_type: VOTER } }
I20260709 13:14:45.303773  7729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:45.303774  7728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:45.307547  7739 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:45.319523  7739 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:45.321453  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:45.337416  7739 catalog_manager.cc:1383] Generated new cluster ID: cc77172b030d4bf5b5d450eed50bd929
I20260709 13:14:45.337815  7739 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:45.360587  7739 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:45.362174  7739 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:45.374940  7739 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766: Generated new TSK 0
I20260709 13:14:45.376245  7739 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:45.388496  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:45.397684  7746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:45.399535  7747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:45.404765  7657 server_base.cc:1061] running on GCE node
W20260709 13:14:45.404765  7749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:45.405920  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:45.406147  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:45.406283  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602885406270 us; error 0 us; skew 500 ppm
I20260709 13:14:45.406816  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:45.411456  7657 webserver.cc:533] Webserver started at http://127.7.122.65:41295/ using document root <none> and password file <none>
I20260709 13:14:45.411998  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:45.412184  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:45.412410  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:45.413650  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.419754  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.006s
I20260709 13:14:45.424768  7754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.425735  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:14:45.426026  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.426327  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:45.451398  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:45.452760  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:45.455658  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:45.460397  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:45.460628  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.460844  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:45.461066  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:14:45.572196  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:40265
I20260709 13:14:45.572271  7816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:40265 every 8 connection(s)
I20260709 13:14:45.579551  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:45.591590  7821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:45.592837  7822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:45.604406  7824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:45.605690  7657 server_base.cc:1061] running on GCE node
I20260709 13:14:45.607002  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:45.607218  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:45.607345  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602885607334 us; error 0 us; skew 500 ppm
I20260709 13:14:45.608124  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:45.608536  7817 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36083
I20260709 13:14:45.609104  7817 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:45.610453  7817 heartbeater.cc:507] Master 127.7.122.126:36083 requested a full tablet report, sending...
I20260709 13:14:45.611361  7657 webserver.cc:533] Webserver started at http://127.7.122.66:42049/ using document root <none> and password file <none>
I20260709 13:14:45.611971  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:45.612205  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:45.612546  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:45.613797  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "44ed36e244d445128d242d86f036d3d0"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.614601  7689 ts_manager.cc:194] Registered new tserver with Master: cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265)
I20260709 13:14:45.618077  7689 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48170
I20260709 13:14:45.619997  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:14:45.624573  7829 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.625487  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:14:45.625789  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "44ed36e244d445128d242d86f036d3d0"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.626080  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:45.648216  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:45.649629  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:45.652281  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:45.655503  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:45.655705  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.655911  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:45.656044  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.756907  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:44667
I20260709 13:14:45.757184  7891 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:44667 every 8 connection(s)
I20260709 13:14:45.764797  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:45.772826  7895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:45.774515  7896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:45.778545  7892 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36083
I20260709 13:14:45.778973  7892 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:45.779976  7892 heartbeater.cc:507] Master 127.7.122.126:36083 requested a full tablet report, sending...
I20260709 13:14:45.782159  7657 server_base.cc:1061] running on GCE node
I20260709 13:14:45.782743  7689 ts_manager.cc:194] Registered new tserver with Master: 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
W20260709 13:14:45.782842  7898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:45.783989  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:45.784272  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:45.784456  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602885784441 us; error 0 us; skew 500 ppm
I20260709 13:14:45.784582  7689 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48174
I20260709 13:14:45.785214  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:45.788182  7657 webserver.cc:533] Webserver started at http://127.7.122.67:42811/ using document root <none> and password file <none>
I20260709 13:14:45.788722  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:45.788936  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:45.789207  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:45.790313  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "feaf6574b83848eeaad2feff0195dbfe"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.795118  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:14:45.798923  7903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.799829  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:14:45.800175  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "feaf6574b83848eeaad2feff0195dbfe"
format_stamp: "Formatted at 2026-07-09 13:14:45 on dist-test-slave-078m"
I20260709 13:14:45.800472  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:45.819146  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:45.820523  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:45.823431  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:45.825861  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:45.826115  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.826367  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:45.826722  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:45.932971  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:33743
I20260709 13:14:45.933585  7965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:33743 every 8 connection(s)
I20260709 13:14:45.951820  7966 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36083
I20260709 13:14:45.952251  7966 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:45.953177  7966 heartbeater.cc:507] Master 127.7.122.126:36083 requested a full tablet report, sending...
I20260709 13:14:45.955507  7689 ts_manager.cc:194] Registered new tserver with Master: feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:45.955651  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017492623s
I20260709 13:14:45.957398  7689 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48180
I20260709 13:14:46.014285  7689 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48184:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:46.018617  7689 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:46.130561  7931 tablet_service.cc:1511] Processing CreateTablet for tablet da7b1a9f8d8a49438f2bf81f4c9ba666 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:46.134042  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7b1a9f8d8a49438f2bf81f4c9ba666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.147114  7930 tablet_service.cc:1511] Processing CreateTablet for tablet e9803c38748b4bd0bc1629b84dad115e (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:46.149296  7930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9803c38748b4bd0bc1629b84dad115e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.165645  7929 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca8b7932f045b9b7954185f2d0678c (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:46.166613  7928 tablet_service.cc:1511] Processing CreateTablet for tablet 14ec9c1f361848a6acb2067b1c2f7a80 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:46.170418  7928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ec9c1f361848a6acb2067b1c2f7a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.175216  7929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca8b7932f045b9b7954185f2d0678c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.175303  7927 tablet_service.cc:1511] Processing CreateTablet for tablet 4662c2f169ed4abcbc03e999437cceda (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:46.181880  7782 tablet_service.cc:1511] Processing CreateTablet for tablet da7b1a9f8d8a49438f2bf81f4c9ba666 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:46.184221  7781 tablet_service.cc:1511] Processing CreateTablet for tablet e9803c38748b4bd0bc1629b84dad115e (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:46.188333  7927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4662c2f169ed4abcbc03e999437cceda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.187582  7780 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca8b7932f045b9b7954185f2d0678c (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:46.191576  7780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca8b7932f045b9b7954185f2d0678c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.187650  7926 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1d1e5708184507a711d1e20d3200a1 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:46.195420  7925 tablet_service.cc:1511] Processing CreateTablet for tablet 8864945e8f044382b236030d9debf946 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:46.200446  7924 tablet_service.cc:1511] Processing CreateTablet for tablet 252c6bd217b44f2b9009c97343185baf (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:46.203789  7782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7b1a9f8d8a49438f2bf81f4c9ba666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.203990  7926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d1e5708184507a711d1e20d3200a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.195884  7779 tablet_service.cc:1511] Processing CreateTablet for tablet 14ec9c1f361848a6acb2067b1c2f7a80 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:46.208654  7781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9803c38748b4bd0bc1629b84dad115e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.214092  7779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ec9c1f361848a6acb2067b1c2f7a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.216562  7925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8864945e8f044382b236030d9debf946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.209787  7778 tablet_service.cc:1511] Processing CreateTablet for tablet 4662c2f169ed4abcbc03e999437cceda (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:46.224167  7776 tablet_service.cc:1511] Processing CreateTablet for tablet 8864945e8f044382b236030d9debf946 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:46.226254  7778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4662c2f169ed4abcbc03e999437cceda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.228632  7924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252c6bd217b44f2b9009c97343185baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.220945  7775 tablet_service.cc:1511] Processing CreateTablet for tablet 252c6bd217b44f2b9009c97343185baf (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:46.218506  7777 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1d1e5708184507a711d1e20d3200a1 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:46.238202  7776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8864945e8f044382b236030d9debf946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.245208  7774 tablet_service.cc:1511] Processing CreateTablet for tablet baa058df02a044b399f3ade3259234d2 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:46.252202  7774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa058df02a044b399f3ade3259234d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.258839  7777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d1e5708184507a711d1e20d3200a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.281234  7855 tablet_service.cc:1511] Processing CreateTablet for tablet 95ca8b7932f045b9b7954185f2d0678c (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:14:46.284209  7855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ca8b7932f045b9b7954185f2d0678c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.286554  7856 tablet_service.cc:1511] Processing CreateTablet for tablet e9803c38748b4bd0bc1629b84dad115e (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:14:46.295759  7856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9803c38748b4bd0bc1629b84dad115e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.286276  7775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252c6bd217b44f2b9009c97343185baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.287127  7857 tablet_service.cc:1511] Processing CreateTablet for tablet da7b1a9f8d8a49438f2bf81f4c9ba666 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:14:46.301702  7857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da7b1a9f8d8a49438f2bf81f4c9ba666. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:14:46.306120  7735 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:46.312274  7854 tablet_service.cc:1511] Processing CreateTablet for tablet 14ec9c1f361848a6acb2067b1c2f7a80 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:14:46.317859  7931 tablet_service.cc:1511] Processing CreateTablet for tablet baa058df02a044b399f3ade3259234d2 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:46.319567  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa058df02a044b399f3ade3259234d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.315186  7854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ec9c1f361848a6acb2067b1c2f7a80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.326047  7853 tablet_service.cc:1511] Processing CreateTablet for tablet 4662c2f169ed4abcbc03e999437cceda (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:14:46.335501  7984 tablet_bootstrap.cc:492] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.337553  7853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4662c2f169ed4abcbc03e999437cceda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.351722  7852 tablet_service.cc:1511] Processing CreateTablet for tablet 2d1d1e5708184507a711d1e20d3200a1 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:14:46.354782  7852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d1d1e5708184507a711d1e20d3200a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.422052  7850 tablet_service.cc:1511] Processing CreateTablet for tablet 252c6bd217b44f2b9009c97343185baf (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:14:46.431238  7850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 252c6bd217b44f2b9009c97343185baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.399784  7849 tablet_service.cc:1511] Processing CreateTablet for tablet baa058df02a044b399f3ade3259234d2 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:14:46.442451  7849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa058df02a044b399f3ade3259234d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.402287  7851 tablet_service.cc:1511] Processing CreateTablet for tablet 8864945e8f044382b236030d9debf946 (DEFAULT_TABLE table=test-workload [id=90fabb26b62a4440a4a8c4ee5592ddce]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:14:46.448148  7851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8864945e8f044382b236030d9debf946. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:46.469290  7984 tablet_bootstrap.cc:654] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.494402  7985 tablet_bootstrap.cc:492] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:46.552116  7985 tablet_bootstrap.cc:654] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.580060  7987 tablet_bootstrap.cc:492] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:46.590190  7984 tablet_bootstrap.cc:492] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.590744  7984 ts_tablet_manager.cc:1403] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.270s	user 0.025s	sys 0.016s
I20260709 13:14:46.601166  7985 tablet_bootstrap.cc:492] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:46.601696  7985 ts_tablet_manager.cc:1403] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.116s	user 0.020s	sys 0.016s
I20260709 13:14:46.602974  7984 raft_consensus.cc:359] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:46.605080  7984 raft_consensus.cc:385] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.604913  7985 raft_consensus.cc:359] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.605516  7984 raft_consensus.cc:740] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.605741  7985 raft_consensus.cc:385] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.606205  7985 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.606541  7987 tablet_bootstrap.cc:654] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.606503  7984 consensus_queue.cc:260] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:46.607187  7985 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.612699  7817 heartbeater.cc:499] Master 127.7.122.126:36083 was elected leader, sending a full tablet report...
I20260709 13:14:46.615483  7984 ts_tablet_manager.cc:1434] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.008s
I20260709 13:14:46.616256  7966 heartbeater.cc:499] Master 127.7.122.126:36083 was elected leader, sending a full tablet report...
I20260709 13:14:46.616588  7984 tablet_bootstrap.cc:492] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.621804  7987 tablet_bootstrap.cc:492] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:46.622440  7987 ts_tablet_manager.cc:1403] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.009s
I20260709 13:14:46.626032  7987 raft_consensus.cc:359] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.626976  7987 raft_consensus.cc:385] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.627349  7987 raft_consensus.cc:740] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.627435  7984 tablet_bootstrap.cc:654] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.629001  7987 consensus_queue.cc:260] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.631896  7985 ts_tablet_manager.cc:1434] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.005s
I20260709 13:14:46.633250  7985 tablet_bootstrap.cc:492] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:46.638640  7987 ts_tablet_manager.cc:1434] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:14:46.639756  7984 tablet_bootstrap.cc:492] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.640268  7892 heartbeater.cc:499] Master 127.7.122.126:36083 was elected leader, sending a full tablet report...
I20260709 13:14:46.640262  7984 ts_tablet_manager.cc:1403] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.024s	user 0.002s	sys 0.015s
I20260709 13:14:46.643790  7984 raft_consensus.cc:359] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.644541  7984 raft_consensus.cc:385] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.644847  7984 raft_consensus.cc:740] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.646162  7987 tablet_bootstrap.cc:492] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:46.648772  7984 consensus_queue.cc:260] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.651491  7984 ts_tablet_manager.cc:1434] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:14:46.652472  7984 tablet_bootstrap.cc:492] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.654174  7987 tablet_bootstrap.cc:654] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.659544  7984 tablet_bootstrap.cc:654] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.672519  7984 tablet_bootstrap.cc:492] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.672703  7987 tablet_bootstrap.cc:492] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:46.673065  7984 ts_tablet_manager.cc:1403] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:14:46.673440  7987 ts_tablet_manager.cc:1403] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.002s
I20260709 13:14:46.676127  7984 raft_consensus.cc:359] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.676977  7984 raft_consensus.cc:385] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.677289  7984 raft_consensus.cc:740] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.677338  7987 raft_consensus.cc:359] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.678251  7987 raft_consensus.cc:385] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.678731  7987 raft_consensus.cc:740] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.678292  7984 consensus_queue.cc:260] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.680999  7984 ts_tablet_manager.cc:1434] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:14:46.681996  7984 tablet_bootstrap.cc:492] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.684969  7985 tablet_bootstrap.cc:654] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.688900  7984 tablet_bootstrap.cc:654] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:46.692652  7967 tablet.cc:2406] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:14:46.696108  7987 consensus_queue.cc:260] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.698203  7984 tablet_bootstrap.cc:492] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.698731  7984 ts_tablet_manager.cc:1403] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260709 13:14:46.701587  7987 ts_tablet_manager.cc:1434] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:14:46.702808  7987 tablet_bootstrap.cc:492] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:46.704607  7985 tablet_bootstrap.cc:492] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:46.705148  7985 ts_tablet_manager.cc:1403] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.011s
I20260709 13:14:46.701699  7984 raft_consensus.cc:359] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.706463  7984 raft_consensus.cc:385] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.706804  7984 raft_consensus.cc:740] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.707597  7984 consensus_queue.cc:260] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.708461  7985 raft_consensus.cc:359] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.709494  7985 raft_consensus.cc:385] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.709782  7985 raft_consensus.cc:740] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.709899  7984 ts_tablet_manager.cc:1434] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:14:46.710546  7985 consensus_queue.cc:260] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.711117  7984 tablet_bootstrap.cc:492] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.712707  7985 ts_tablet_manager.cc:1434] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:14:46.713682  7985 tablet_bootstrap.cc:492] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:46.721061  7989 raft_consensus.cc:493] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.721403  7984 tablet_bootstrap.cc:654] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.721642  7989 raft_consensus.cc:515] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:46.726672  7989 leader_election.cc:290] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:46.720495  7985 tablet_bootstrap.cc:654] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.742312  7985 tablet_bootstrap.cc:492] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:46.742834  7985 ts_tablet_manager.cc:1403] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.006s
I20260709 13:14:46.746202  7985 raft_consensus.cc:359] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.747174  7985 raft_consensus.cc:385] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.747536  7985 raft_consensus.cc:740] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.748437  7985 consensus_queue.cc:260] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.752782  7985 ts_tablet_manager.cc:1434] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:14:46.754019  7985 tablet_bootstrap.cc:492] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:46.766073  7985 tablet_bootstrap.cc:654] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.774531  7987 tablet_bootstrap.cc:654] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.794761  7984 tablet_bootstrap.cc:492] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.796541  7985 tablet_bootstrap.cc:492] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:46.796597  7984 ts_tablet_manager.cc:1403] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.086s	user 0.034s	sys 0.031s
I20260709 13:14:46.797214  7985 ts_tablet_manager.cc:1403] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.012s
I20260709 13:14:46.802961  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:46.804661  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
W20260709 13:14:46.807047  7906 leader_election.cc:343] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:46.806731  7985 raft_consensus.cc:359] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
W20260709 13:14:46.807833  7907 leader_election.cc:343] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:46.808254  7907 leader_election.cc:304] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b
I20260709 13:14:46.809155  7989 raft_consensus.cc:2749] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:46.809949  7984 raft_consensus.cc:359] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.810739  7984 raft_consensus.cc:385] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.811043  7984 raft_consensus.cc:740] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.811743  7987 tablet_bootstrap.cc:492] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:46.812264  7987 ts_tablet_manager.cc:1403] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.007s
I20260709 13:14:46.811791  7984 consensus_queue.cc:260] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.814361  7984 ts_tablet_manager.cc:1434] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:14:46.815371  7984 tablet_bootstrap.cc:492] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.815354  7987 raft_consensus.cc:359] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:46.816237  7987 raft_consensus.cc:385] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.816522  7987 raft_consensus.cc:740] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.817255  7987 consensus_queue.cc:260] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:46.819367  7987 ts_tablet_manager.cc:1434] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:14:46.820289  7987 tablet_bootstrap.cc:492] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:46.807688  7985 raft_consensus.cc:385] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.821179  7985 raft_consensus.cc:740] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.822286  7984 tablet_bootstrap.cc:654] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.822476  7985 consensus_queue.cc:260] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:46.825088  7985 ts_tablet_manager.cc:1434] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 13:14:46.828186  7985 tablet_bootstrap.cc:492] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:46.835016  7985 tablet_bootstrap.cc:654] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.840176  7990 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.840708  7990 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.842918  7984 tablet_bootstrap.cc:492] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.843214  7989 raft_consensus.cc:493] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.843431  7984 ts_tablet_manager.cc:1403] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.012s
I20260709 13:14:46.843686  7990 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:46.843710  7989 raft_consensus.cc:515] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.846338  7989 leader_election.cc:290] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:46.846776  7984 raft_consensus.cc:359] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.847231  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:46.847548  7984 raft_consensus.cc:385] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.848101  7984 raft_consensus.cc:740] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
W20260709 13:14:46.848755  7906 leader_election.cc:343] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:46.848966  7984 consensus_queue.cc:260] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.849953  7987 tablet_bootstrap.cc:654] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.851613  7984 ts_tablet_manager.cc:1434] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:46.852676  7984 tablet_bootstrap.cc:492] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.859383  7984 tablet_bootstrap.cc:654] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.867831  7990 raft_consensus.cc:493] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.868412  7990 raft_consensus.cc:515] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.870743  7990 leader_election.cc:290] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:46.872399  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
W20260709 13:14:46.874485  7907 leader_election.cc:343] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:46.874967  7907 leader_election.cc:304] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b
I20260709 13:14:46.875749  7989 raft_consensus.cc:2749] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:46.877420  7984 tablet_bootstrap.cc:492] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.877928  7984 ts_tablet_manager.cc:1403] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 13:14:46.881193  7984 raft_consensus.cc:359] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.881950  7984 raft_consensus.cc:385] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.882275  7984 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.882427  7985 tablet_bootstrap.cc:492] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:46.883083  7985 ts_tablet_manager.cc:1403] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.008s
I20260709 13:14:46.883044  7984 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.885995  7984 ts_tablet_manager.cc:1434] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:14:46.887161  7984 tablet_bootstrap.cc:492] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.889849  7987 tablet_bootstrap.cc:492] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:46.890348  7987 ts_tablet_manager.cc:1403] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.004s
I20260709 13:14:46.893738  7984 tablet_bootstrap.cc:654] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.894254  7985 raft_consensus.cc:359] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.895028  7985 raft_consensus.cc:385] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.895324  7985 raft_consensus.cc:740] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.896092  7985 consensus_queue.cc:260] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.901091  7992 raft_consensus.cc:493] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.901624  7992 raft_consensus.cc:515] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.905880  7984 tablet_bootstrap.cc:492] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:46.906369  7984 ts_tablet_manager.cc:1403] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:14:46.907270  7992 leader_election.cc:290] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:46.908501  7987 raft_consensus.cc:359] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.908960  7984 raft_consensus.cc:359] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.909487  7987 raft_consensus.cc:385] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.909682  7984 raft_consensus.cc:385] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:46.909833  7987 raft_consensus.cc:740] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.910051  7984 raft_consensus.cc:740] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:46.910878  7984 consensus_queue.cc:260] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.913334  7984 ts_tablet_manager.cc:1434] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:46.913645  7990 raft_consensus.cc:493] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.914161  7990 raft_consensus.cc:515] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.917249  7990 leader_election.cc:290] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:46.919221  7985 ts_tablet_manager.cc:1434] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:14:46.920246  7985 tablet_bootstrap.cc:492] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:46.921763  7984 tablet_bootstrap.cc:492] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe: Bootstrap starting.
I20260709 13:14:46.923300  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:46.924364  7941 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:46.927291  7985 tablet_bootstrap.cc:654] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.928705  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:46.933192  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:46.934588  7990 raft_consensus.cc:493] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.934057  7984 tablet_bootstrap.cc:654] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:46.928537  7987 consensus_queue.cc:260] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.967586  7941 raft_consensus.cc:2468] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:46.975164  7987 ts_tablet_manager.cc:1434] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.085s	user 0.012s	sys 0.004s
I20260709 13:14:46.976244  7987 tablet_bootstrap.cc:492] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:46.973116  7990 raft_consensus.cc:515] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.985649  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:46.980531  7992 raft_consensus.cc:493] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.970670  7940 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:46.987728  7992 raft_consensus.cc:515] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:46.987886  7756 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:46.992199  8016 raft_consensus.cc:2804] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:46.992817  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:46.994925  8016 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:46.994481  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:46.995402  8016 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:46.995669  7990 leader_election.cc:290] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
W20260709 13:14:46.996320  7758 leader_election.cc:343] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:46.997440  7990 raft_consensus.cc:493] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:46.999033  7990 raft_consensus.cc:515] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:47.002275  7990 leader_election.cc:290] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:47.003285  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
W20260709 13:14:47.003626  7758 leader_election.cc:343] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:47.004065  7940 raft_consensus.cc:2468] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 0.
I20260709 13:14:46.995674  7866 raft_consensus.cc:2468] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.006265  7831 leader_election.cc:304] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.006353  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:47.006922  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:47.008811  7867 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.015738  7992 leader_election.cc:290] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.020902  7992 raft_consensus.cc:2804] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.023557  7985 tablet_bootstrap.cc:492] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:47.024621  7985 ts_tablet_manager.cc:1403] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.014s
I20260709 13:14:47.010682  7758 leader_election.cc:304] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.025871  7990 raft_consensus.cc:2804] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:14:47.025947  7758 leader_election.cc:343] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:47.026309  7990 raft_consensus.cc:493] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.026695  7990 raft_consensus.cc:3060] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.026736  7758 leader_election.cc:304] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.021520  7992 raft_consensus.cc:493] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.028946  7985 raft_consensus.cc:359] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.031535  7985 raft_consensus.cc:385] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.032137  7985 raft_consensus.cc:740] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.030253  7992 raft_consensus.cc:3060] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.033630  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d1e5708184507a711d1e20d3200a1" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.036662  7940 raft_consensus.cc:2468] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 0.
I20260709 13:14:47.033264  7985 consensus_queue.cc:260] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.040261  7831 leader_election.cc:304] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.038384  7756 leader_election.cc:304] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.042073  7984 tablet_bootstrap.cc:492] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe: No bootstrap required, opened a new log
I20260709 13:14:47.043071  7984 ts_tablet_manager.cc:1403] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.013s
I20260709 13:14:47.042326  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d1e5708184507a711d1e20d3200a1" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:47.045347  7791 raft_consensus.cc:2468] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 0.
I20260709 13:14:47.049642  7984 raft_consensus.cc:359] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.048566  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:47.050310  7985 ts_tablet_manager.cc:1434] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:14:47.050500  7984 raft_consensus.cc:385] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.050938  7984 raft_consensus.cc:740] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.051754  8019 raft_consensus.cc:2804] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.052531  8019 raft_consensus.cc:493] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.053013  8019 raft_consensus.cc:3060] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.053386  7985 tablet_bootstrap.cc:492] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:47.053947  7990 raft_consensus.cc:515] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.052224  7984 consensus_queue.cc:260] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.057394  7984 ts_tablet_manager.cc:1434] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:14:47.058876  7792 raft_consensus.cc:2393] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44ed36e244d445128d242d86f036d3d0 in current term 1: Already voted for candidate cb9ef2ac44944a518cd82b0b6c33a83b in this term.
I20260709 13:14:47.058358  8021 raft_consensus.cc:2804] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.066424  7987 tablet_bootstrap.cc:654] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.067293  7990 leader_election.cc:290] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.069855  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.062192  8021 raft_consensus.cc:493] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.071018  8020 raft_consensus.cc:2804] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.071810  8020 raft_consensus.cc:493] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.072184  8020 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.071370  8021 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.091790  7985 tablet_bootstrap.cc:654] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:47.093101  7756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:33743, user_credentials={real_user=slave}} blocked reactor thread for 54759.3us
I20260709 13:14:47.096716  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.097635  7940 raft_consensus.cc:2468] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.098940  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.099591  7941 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.099435  8019 raft_consensus.cc:515] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.098698  8016 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.106130  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d1e5708184507a711d1e20d3200a1" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.106752  7941 raft_consensus.cc:3060] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.101775  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.109265  7939 raft_consensus.cc:3060] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.103338  8019 leader_election.cc:290] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.105333  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d1d1e5708184507a711d1e20d3200a1" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:47.104255  7992 raft_consensus.cc:515] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.113155  7987 tablet_bootstrap.cc:492] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:47.114164  7792 raft_consensus.cc:3060] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.115278  7867 raft_consensus.cc:2393] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cb9ef2ac44944a518cd82b0b6c33a83b in current term 1: Already voted for candidate 44ed36e244d445128d242d86f036d3d0 in this term.
I20260709 13:14:47.115185  7756 leader_election.cc:304] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.125360  8022 raft_consensus.cc:2804] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.125149  8021 raft_consensus.cc:515] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.126801  7987 ts_tablet_manager.cc:1403] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.151s	user 0.014s	sys 0.011s
I20260709 13:14:47.130496  8022 raft_consensus.cc:493] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.131891  8022 raft_consensus.cc:3060] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.126646  7939 raft_consensus.cc:2468] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.127614  7792 raft_consensus.cc:2468] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 1.
I20260709 13:14:47.131842  8020 raft_consensus.cc:515] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:47.137181  7832 leader_election.cc:304] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.139276  8019 raft_consensus.cc:2804] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.139199  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
W20260709 13:14:47.143698  7758 leader_election.cc:343] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:47.139460  7941 raft_consensus.cc:2468] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 1.
I20260709 13:14:47.146546  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:47.148538  7985 tablet_bootstrap.cc:492] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:47.148241  7792 raft_consensus.cc:2393] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44ed36e244d445128d242d86f036d3d0 in current term 1: Already voted for candidate cb9ef2ac44944a518cd82b0b6c33a83b in this term.
I20260709 13:14:47.140555  7756 leader_election.cc:304] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.151297  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.151889  7865 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.148711  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.144640  7992 leader_election.cc:290] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.149057  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.146538  8016 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.152240  8022 raft_consensus.cc:515] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.154999  8021 leader_election.cc:290] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.150533  7985 ts_tablet_manager.cc:1403] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.025s
I20260709 13:14:47.146785  8019 raft_consensus.cc:697] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 1 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:47.157063  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.156903  8019 consensus_queue.cc:237] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.157826  7938 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.152822  8020 leader_election.cc:290] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:47.153018  7990 raft_consensus.cc:2804] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.153139  7941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.159184  7941 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.159229  7990 raft_consensus.cc:697] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.160277  7990 consensus_queue.cc:237] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.153429  7939 raft_consensus.cc:2393] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 44ed36e244d445128d242d86f036d3d0 in current term 1: Already voted for candidate cb9ef2ac44944a518cd82b0b6c33a83b in this term.
I20260709 13:14:47.153415  7940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.162184  7940 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.164695  7987 raft_consensus.cc:359] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.165717  7987 raft_consensus.cc:385] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.166056  7987 raft_consensus.cc:740] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.167081  7987 consensus_queue.cc:260] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.168845  7941 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.169699  7831 leader_election.cc:304] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0; no voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:47.170269  7866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.171136  7756 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
W20260709 13:14:47.172138  7758 leader_election.cc:343] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:47.172382  7992 raft_consensus.cc:2749] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:47.173048  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.173693  7939 raft_consensus.cc:3060] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.174384  7985 raft_consensus.cc:359] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.175110  7985 raft_consensus.cc:385] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.175431  7985 raft_consensus.cc:740] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.175231  8020 raft_consensus.cc:2804] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.175921  7940 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.163968  7865 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.171104  7938 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.169663  8022 leader_election.cc:290] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.179138  8020 raft_consensus.cc:697] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.182569  7758 leader_election.cc:304] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.183915  7987 ts_tablet_manager.cc:1434] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.003s
I20260709 13:14:47.184877  8022 raft_consensus.cc:2804] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.176216  7985 consensus_queue.cc:260] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.185652  8022 raft_consensus.cc:697] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.185648  7987 tablet_bootstrap.cc:492] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:47.185413  8020 consensus_queue.cc:237] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.189733  8022 consensus_queue.cc:237] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:47.191205  7985 ts_tablet_manager.cc:1434] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:14:47.193918  7985 tablet_bootstrap.cc:492] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:47.200012  7939 raft_consensus.cc:2468] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.208413  7987 tablet_bootstrap.cc:654] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.210625  7985 tablet_bootstrap.cc:654] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.212734  7756 leader_election.cc:304] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.218585  7867 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.219149  7756 leader_election.cc:304] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.220082  8020 raft_consensus.cc:2804] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.220714  8020 raft_consensus.cc:697] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.221791  8020 consensus_queue.cc:237] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.223315  7688 catalog_manager.cc:5697] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.218614  8022 raft_consensus.cc:2804] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.225564  8022 raft_consensus.cc:697] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.226622  7990 raft_consensus.cc:493] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.226425  8022 consensus_queue.cc:237] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.227061  7990 raft_consensus.cc:515] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.229157  7990 leader_election.cc:290] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.230710  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.231570  7939 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.232602  7865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:47.232810  7756 leader_election.cc:304] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.233292  7865 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.233712  7990 raft_consensus.cc:2804] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.234155  7990 raft_consensus.cc:493] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.234553  7990 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.233930  7689 catalog_manager.cc:5697] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.239640  7867 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.247071  7990 raft_consensus.cc:515] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.251230  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.247853  7985 tablet_bootstrap.cc:492] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:47.251629  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.252096  7867 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.252281  7938 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.252358  7985 ts_tablet_manager.cc:1403] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.005s
I20260709 13:14:47.255290  7985 raft_consensus.cc:359] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.255950  7985 raft_consensus.cc:385] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.256247  7985 raft_consensus.cc:740] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.258766  7990 leader_election.cc:290] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.260003  7938 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.261375  7756 leader_election.cc:304] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.262259  8022 raft_consensus.cc:2804] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.262850  8022 raft_consensus.cc:697] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.263734  8022 consensus_queue.cc:237] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.265594  7985 consensus_queue.cc:260] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.268735  7985 ts_tablet_manager.cc:1434] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 13:14:47.271560  7985 tablet_bootstrap.cc:492] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: Bootstrap starting.
I20260709 13:14:47.269372  7867 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.274607  7987 tablet_bootstrap.cc:492] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:47.275110  7987 ts_tablet_manager.cc:1403] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.090s	user 0.028s	sys 0.018s
I20260709 13:14:47.275895  7989 raft_consensus.cc:493] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.276450  7989 raft_consensus.cc:515] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.277151  7985 tablet_bootstrap.cc:654] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.278600  7989 leader_election.cc:290] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:47.278714  7987 raft_consensus.cc:359] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.279455  7987 raft_consensus.cc:385] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.279774  7987 raft_consensus.cc:740] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.280342  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa058df02a044b399f3ade3259234d2" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:47.282076  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa058df02a044b399f3ade3259234d2" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
W20260709 13:14:47.282426  7907 leader_election.cc:343] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:47.282608  7792 raft_consensus.cc:2468] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 0.
I20260709 13:14:47.283859  7906 leader_election.cc:304] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.284730  7985 tablet_bootstrap.cc:492] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: No bootstrap required, opened a new log
I20260709 13:14:47.280511  7987 consensus_queue.cc:260] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.285100  7989 raft_consensus.cc:2804] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.285205  7985 ts_tablet_manager.cc:1403] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.010s
I20260709 13:14:47.285609  7989 raft_consensus.cc:493] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.286689  7989 raft_consensus.cc:3060] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.287371  7987 ts_tablet_manager.cc:1434] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:14:47.288465  7987 tablet_bootstrap.cc:492] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:47.288550  7985 raft_consensus.cc:359] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.289484  7985 raft_consensus.cc:385] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.289956  7985 raft_consensus.cc:740] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.294629  7985 consensus_queue.cc:260] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.295691  7989 raft_consensus.cc:515] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.297246  7985 ts_tablet_manager.cc:1434] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:14:47.298689  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa058df02a044b399f3ade3259234d2" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:47.299140  7987 tablet_bootstrap.cc:654] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.300202  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa058df02a044b399f3ade3259234d2" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.299284  7792 raft_consensus.cc:3060] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:14:47.306968  7907 leader_election.cc:343] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:47.307760  7989 leader_election.cc:290] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
W20260709 13:14:47.312220  7735 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:47.314303  7792 raft_consensus.cc:2468] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 1.
I20260709 13:14:47.316082  7906 leader_election.cc:304] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.317149  7989 raft_consensus.cc:2804] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.318289  7989 raft_consensus.cc:697] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 1 LEADER]: Becoming Leader. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:47.319003  7989 consensus_queue.cc:237] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.331184  7987 tablet_bootstrap.cc:492] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:47.331809  7987 ts_tablet_manager.cc:1403] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.006s
I20260709 13:14:47.335000  7987 raft_consensus.cc:359] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.335819  7987 raft_consensus.cc:385] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.336127  7987 raft_consensus.cc:740] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.336895  7987 consensus_queue.cc:260] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.340251  7987 ts_tablet_manager.cc:1434] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:14:47.341480  7987 tablet_bootstrap.cc:492] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:47.342811  7688 catalog_manager.cc:5697] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.345558  7688 catalog_manager.cc:5697] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.348204  7987 tablet_bootstrap.cc:654] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.347477  7688 catalog_manager.cc:5697] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.349503  7688 catalog_manager.cc:5697] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.351327  7688 catalog_manager.cc:5697] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.353538  7987 tablet_bootstrap.cc:492] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:47.353992  7987 ts_tablet_manager.cc:1403] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:14:47.356542  7987 raft_consensus.cc:359] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.357246  7987 raft_consensus.cc:385] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.357514  7987 raft_consensus.cc:740] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.358294  7987 consensus_queue.cc:260] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.359951  7987 ts_tablet_manager.cc:1434] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:14:47.360781  7987 tablet_bootstrap.cc:492] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: Bootstrap starting.
I20260709 13:14:47.366539  7987 tablet_bootstrap.cc:654] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:47.367992  7689 catalog_manager.cc:5697] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe reported cstate change: term changed from 0 to 1, leader changed from <none> to feaf6574b83848eeaad2feff0195dbfe (127.7.122.67). New cstate: current_term: 1 leader_uuid: "feaf6574b83848eeaad2feff0195dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:47.377626  7987 tablet_bootstrap.cc:492] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: No bootstrap required, opened a new log
I20260709 13:14:47.378242  7987 ts_tablet_manager.cc:1403] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:14:47.381181  7987 raft_consensus.cc:359] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.381994  7987 raft_consensus.cc:385] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:47.382369  7987 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Initialized, Role: FOLLOWER
I20260709 13:14:47.383155  7987 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.385402  7987 ts_tablet_manager.cc:1434] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:14:47.439210  8022 raft_consensus.cc:493] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.439702  8022 raft_consensus.cc:515] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.441718  8022 leader_election.cc:290] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.442714  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0" is_pre_election: true
I20260709 13:14:47.443044  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.443563  7867 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.443768  7938 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 0.
I20260709 13:14:47.444932  7758 leader_election.cc:304] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.445614  8022 raft_consensus.cc:2804] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:47.445976  8022 raft_consensus.cc:493] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:47.446259  8022 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.451887  8022 raft_consensus.cc:515] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.453976  8022 leader_election.cc:290] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.454849  7867 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:47.455116  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.455493  7867 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.455669  7938 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.460296  7938 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.461447  7756 leader_election.cc:304] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.462255  8022 raft_consensus.cc:2804] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:47.462322  7867 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 1.
I20260709 13:14:47.462857  8022 raft_consensus.cc:697] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.463604  8022 consensus_queue.cc:237] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.474022  7685 catalog_manager.cc:5697] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 0 to 1, leader changed from <none> to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 1 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.572813  8019 raft_consensus.cc:493] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.573382  8019 raft_consensus.cc:515] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.575169  8019 leader_election.cc:290] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.576128  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:47.576305  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.577142  7938 raft_consensus.cc:2393] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44ed36e244d445128d242d86f036d3d0 in current term 1: Already voted for candidate cb9ef2ac44944a518cd82b0b6c33a83b in this term.
I20260709 13:14:47.578132  7831 leader_election.cc:304] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0; no voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:47.578869  8019 raft_consensus.cc:3060] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.583330  8019 raft_consensus.cc:2749] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:47.589293  8019 raft_consensus.cc:493] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.589850  8019 raft_consensus.cc:515] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.591557  8019 leader_election.cc:290] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.592710  7792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa058df02a044b399f3ade3259234d2" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:47.593577  7792 raft_consensus.cc:2393] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44ed36e244d445128d242d86f036d3d0 in current term 1: Already voted for candidate feaf6574b83848eeaad2feff0195dbfe in this term.
I20260709 13:14:47.592710  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa058df02a044b399f3ade3259234d2" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.596925  7831 leader_election.cc:304] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0; no voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:47.597755  8019 raft_consensus.cc:3060] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.598384  7992 consensus_queue.cc:1048] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.599457  8022 consensus_queue.cc:1048] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.605016  8019 raft_consensus.cc:2749] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:47.623389  8022 consensus_queue.cc:1048] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:47.631978  8022 consensus_queue.cc:1048] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.641431  8022 consensus_queue.cc:1048] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.648766  8022 consensus_queue.cc:1048] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.655134  8016 consensus_queue.cc:1048] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.668594  8022 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:47.697032  7992 consensus_queue.cc:1048] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.721879  8022 consensus_queue.cc:1048] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.722559  7990 consensus_queue.cc:1048] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.728183  7989 consensus_queue.cc:1048] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:47.724502  7867 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:47.769757  8041 consensus_queue.cc:1048] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:47.801609  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:45032
I20260709 13:14:47.802850  7790 raft_consensus.cc:606] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.825555  8025 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:47.826138  8025 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.827008  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8864945e8f044382b236030d9debf946"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:45032
I20260709 13:14:47.827621  7790 raft_consensus.cc:606] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.828706  8025 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.828568  7990 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.832229  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "feaf6574b83848eeaad2feff0195dbfe" is_pre_election: true
I20260709 13:14:47.832230  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" is_pre_election: true
I20260709 13:14:47.838733  7832 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0; no voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:47.839555  8025 raft_consensus.cc:2749] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:14:47.841961  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:45032
I20260709 13:14:47.842620  7790 raft_consensus.cc:606] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:47.843377  7990 raft_consensus.cc:993] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:47.843811  7990 raft_consensus.cc:1081] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:47.852262  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8864945e8f044382b236030d9debf946"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44978
I20260709 13:14:47.853156  7864 raft_consensus.cc:493] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.853665  7864 raft_consensus.cc:3060] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.862653  8020 consensus_queue.cc:1048] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.878741  8020 raft_consensus.cc:993] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:47.879472  8020 raft_consensus.cc:1081] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:47.884783  7866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44978
I20260709 13:14:47.885439  7866 raft_consensus.cc:493] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.885828  7866 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.887269  8021 consensus_queue.cc:1048] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.874858  7864 raft_consensus.cc:515] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.893972  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:47.894217  7939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8864945e8f044382b236030d9debf946" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.894729  7790 raft_consensus.cc:3055] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.895260  7790 raft_consensus.cc:740] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.896191  7864 leader_election.cc:290] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.896353  7790 consensus_queue.cc:260] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.897820  7790 raft_consensus.cc:3060] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.898532  7866 raft_consensus.cc:515] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.899696  7867 raft_consensus.cc:1240] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Rejecting Update request from peer cb9ef2ac44944a518cd82b0b6c33a83b for earlier term 1. Current term is 2. Ops: []
I20260709 13:14:47.894840  7939 raft_consensus.cc:3060] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.904606  8021 raft_consensus.cc:993] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:47.905128  8021 raft_consensus.cc:1081] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:47.910524  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.910756  7790 raft_consensus.cc:2468] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:47.911201  7938 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.911710  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44978
I20260709 13:14:47.912288  7864 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:47.912632  7864 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.917670  7832 leader_election.cc:304] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.918670  8025 raft_consensus.cc:2804] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.919190  8025 raft_consensus.cc:697] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:47.920100  8025 consensus_queue.cc:237] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.922322  7990 consensus_queue.cc:1059] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.923235  7990 raft_consensus.cc:3055] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.923568  7990 raft_consensus.cc:740] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.924280  7866 leader_election.cc:290] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.919219  7939 raft_consensus.cc:2468] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:47.925995  7938 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:47.924422  7990 consensus_queue.cc:260] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.927606  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:47.928246  7990 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.929605  7831 leader_election.cc:304] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:47.930517  8019 raft_consensus.cc:2804] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.931002  8019 raft_consensus.cc:697] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:47.931824  8019 consensus_queue.cc:237] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.932544  7864 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.935261  7864 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:47.937150  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:47.937759  7791 raft_consensus.cc:3055] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:47.938076  7791 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:47.938871  7791 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.940021  7791 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.941973  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:47.942657  7938 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:47.948318  7685 catalog_manager.cc:5697] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.949100  7791 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:47.949096  7938 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:47.951025  7832 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:47.951959  8019 raft_consensus.cc:2804] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:47.952463  8019 raft_consensus.cc:697] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:47.953297  8019 consensus_queue.cc:237] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:47.957072  7790 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:47.963040  7990 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:47.965777  7685 catalog_manager.cc:5697] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.967864  7685 catalog_manager.cc:5697] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:47.981030  8022 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:48.385795  7938 raft_consensus.cc:1275] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.387280  8019 consensus_queue.cc:1048] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.391768  7939 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.393290  8019 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.400738  7790 raft_consensus.cc:1275] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.403065  8025 consensus_queue.cc:1048] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.414364  7790 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.416195  8019 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.476760  7790 raft_consensus.cc:1275] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.478204  7992 consensus_queue.cc:1048] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:48.486415  7940 raft_consensus.cc:1275] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:48.488183  8019 consensus_queue.cc:1048] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:50.894446  7657 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:14:50.895390  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:50.915307  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:45040
I20260709 13:14:50.915833  7790 raft_consensus.cc:606] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:50.929646  7864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
mode: GRACEFUL
new_leader_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:44988
I20260709 13:14:50.930413  7864 raft_consensus.cc:606] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Received request to transfer leadership to TS feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:50.931793  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:14:50.932322  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:51.249241  8081 raft_consensus.cc:993] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:51.249698  8081 raft_consensus.cc:1081] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:51.251675  7938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80"
dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:54878
I20260709 13:14:51.252170  7938 raft_consensus.cc:493] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:51.252718  7938 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.258409  7938 raft_consensus.cc:515] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:51.260178  7938 leader_election.cc:290] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 2 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:51.261157  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:51.261138  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:51.261910  7864 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.261938  7790 raft_consensus.cc:3055] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:51.262354  7790 raft_consensus.cc:740] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:51.262977  7790 consensus_queue.cc:260] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:51.263895  7790 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:51.267007  7864 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 2.
I20260709 13:14:51.268200  7907 leader_election.cc:304] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:51.268819  7790 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 2.
I20260709 13:14:51.268936  8073 raft_consensus.cc:2804] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:51.270505  8073 raft_consensus.cc:697] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 LEADER]: Becoming Leader. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:51.272370  8083 raft_consensus.cc:993] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: : Instructing follower feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:51.272964  8075 raft_consensus.cc:1081] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Signalling peer feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:51.272665  8073 consensus_queue.cc:237] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:51.274986  7938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:14:51.275591  7938 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:51.276057  7938 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.281368  7938 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:51.283052  7938 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 3 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:51.284019  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:51.283643  7685 catalog_manager.cc:5697] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to feaf6574b83848eeaad2feff0195dbfe (127.7.122.67). New cstate: current_term: 2 leader_uuid: "feaf6574b83848eeaad2feff0195dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.284598  7790 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.284826  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:51.285439  7864 raft_consensus.cc:3055] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:51.288225  7864 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:51.289247  7864 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:51.290715  7864 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:51.294317  7790 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 3.
I20260709 13:14:51.295841  7906 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:51.296267  7864 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 3.
I20260709 13:14:51.296684  8073 raft_consensus.cc:2804] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:51.297281  8073 raft_consensus.cc:697] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Becoming Leader. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:51.298280  8073 consensus_queue.cc:237] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:51.311477  7685 catalog_manager.cc:5697] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe reported cstate change: term changed from 2 to 3, leader changed from 44ed36e244d445128d242d86f036d3d0 (127.7.122.66) to feaf6574b83848eeaad2feff0195dbfe (127.7.122.67). New cstate: current_term: 3 leader_uuid: "feaf6574b83848eeaad2feff0195dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:51.685298  7864 raft_consensus.cc:1275] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:51.687283  8073 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:51.697808  7790 raft_consensus.cc:1275] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:51.699980  8073 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:51.823357  7790 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.824776  8092 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:51.835285  7864 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:51.837173  8082 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:51.933460  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:51.944352  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:45032
I20260709 13:14:51.945111  7790 raft_consensus.cc:606] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:51.950771  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:45032
I20260709 13:14:51.951354  7790 raft_consensus.cc:606] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:51.957086  7790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:45032
I20260709 13:14:51.957784  7790 raft_consensus.cc:606] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:51.981508  7938 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80"
dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:54896
I20260709 13:14:51.982153  7938 raft_consensus.cc:606] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:51.998350  7938 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
mode: GRACEFUL
new_leader_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:54896
I20260709 13:14:51.998903  7938 raft_consensus.cc:606] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Received request to transfer leadership to TS 44ed36e244d445128d242d86f036d3d0
I20260709 13:14:52.155421  8081 raft_consensus.cc:993] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.155854  8081 raft_consensus.cc:1081] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.157457  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44978
I20260709 13:14:52.157956  7864 raft_consensus.cc:493] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.158296  7864 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.163053  7864 raft_consensus.cc:515] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:52.164686  7864 leader_election.cc:290] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Requested vote from peers feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743), cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265)
I20260709 13:14:52.165680  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:52.165731  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:52.166414  7938 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.166527  7790 raft_consensus.cc:3055] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:52.166872  7790 raft_consensus.cc:740] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:52.167465  7790 consensus_queue.cc:260] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:52.168318  7790 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.172250  7938 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:52.173224  8097 raft_consensus.cc:993] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.173729  8082 raft_consensus.cc:1081] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.173564  7831 leader_election.cc:304] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:52.174283  7790 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:52.174479  8101 raft_consensus.cc:2804] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:52.174983  8101 raft_consensus.cc:697] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:52.175487  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44976
I20260709 13:14:52.176064  7864 raft_consensus.cc:493] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.175889  8101 consensus_queue.cc:237] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:52.176414  7864 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.181926  7864 raft_consensus.cc:515] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.183727  7864 leader_election.cc:290] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 3 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:52.184626  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:52.185065  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:52.185281  7790 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.185654  7938 raft_consensus.cc:3055] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:52.184976  7687 catalog_manager.cc:5697] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:52.186050  7938 raft_consensus.cc:740] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 LEADER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:52.188786  7938 consensus_queue.cc:260] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.190162  7938 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:52.194465  7790 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 3.
I20260709 13:14:52.194895  7938 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 3.
I20260709 13:14:52.196007  7832 leader_election.cc:304] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:52.196982  8101 raft_consensus.cc:2804] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:52.197470  8101 raft_consensus.cc:697] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:52.198132  8101 consensus_queue.cc:237] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.209026  7687 catalog_manager.cc:5697] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 2 to 3, leader changed from feaf6574b83848eeaad2feff0195dbfe (127.7.122.67) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.273342  8102 raft_consensus.cc:993] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.273974  8081 raft_consensus.cc:1081] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.275712  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44978
I20260709 13:14:52.276261  7864 raft_consensus.cc:493] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.276562  7864 raft_consensus.cc:3060] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.281282  7864 raft_consensus.cc:515] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.282946  7864 leader_election.cc:290] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:52.283890  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:52.284116  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ca8b7932f045b9b7954185f2d0678c" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:52.284521  7790 raft_consensus.cc:3055] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:52.284685  7938 raft_consensus.cc:3060] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.284865  7790 raft_consensus.cc:740] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:52.285630  7790 consensus_queue.cc:260] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.286607  7790 raft_consensus.cc:3060] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.290004  7938 raft_consensus.cc:2468] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:52.291118  7831 leader_election.cc:304] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:52.291654  7790 raft_consensus.cc:2468] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:52.292054  8101 raft_consensus.cc:2804] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:52.292580  8101 raft_consensus.cc:697] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:52.293318  8101 consensus_queue.cc:237] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.302026  7687 catalog_manager.cc:5697] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.340699  8102 raft_consensus.cc:993] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.341209  8081 raft_consensus.cc:1081] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.342873  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44978
I20260709 13:14:52.343457  7864 raft_consensus.cc:493] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.343775  7864 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.348392  7864 raft_consensus.cc:515] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.351953  7864 leader_election.cc:290] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:52.352646  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:52.353281  7938 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.354169  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:52.354837  7790 raft_consensus.cc:3055] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:52.355242  7790 raft_consensus.cc:740] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:52.355728  8108 raft_consensus.cc:993] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: : Instructing follower 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.356177  8082 raft_consensus.cc:1081] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Signalling peer 44ed36e244d445128d242d86f036d3d0 to start an election
I20260709 13:14:52.357017  7790 consensus_queue.cc:260] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.358338  7790 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:52.357937  7864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
 from {username='slave'} at 127.0.0.1:44976
I20260709 13:14:52.358996  7864 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:52.359406  7864 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.359926  7938 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:52.360991  7831 leader_election.cc:304] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:52.361663  8101 raft_consensus.cc:2804] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:52.362109  8101 raft_consensus.cc:697] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:52.362998  8101 consensus_queue.cc:237] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.365525  7790 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 2.
I20260709 13:14:52.367815  7864 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.371202  7864 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 4 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:52.372108  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:52.372680  7938 raft_consensus.cc:3055] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:52.373039  7938 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Becoming Follower/Learner. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:52.373248  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "44ed36e244d445128d242d86f036d3d0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:52.373842  7790 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.373767  7938 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.374905  7938 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:52.378692  7790 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 4.
I20260709 13:14:52.379930  7832 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:52.381294  8101 raft_consensus.cc:2804] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:52.381806  8101 raft_consensus.cc:697] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 LEADER]: Becoming Leader. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:52.381987  7938 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44ed36e244d445128d242d86f036d3d0 in term 4.
I20260709 13:14:52.382682  8101 consensus_queue.cc:237] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:52.383607  7687 catalog_manager.cc:5697] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 1 to 2, leader changed from cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.398715  7687 catalog_manager.cc:5697] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 reported cstate change: term changed from 3 to 4, leader changed from feaf6574b83848eeaad2feff0195dbfe (127.7.122.67) to 44ed36e244d445128d242d86f036d3d0 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "44ed36e244d445128d242d86f036d3d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:52.582746  7938 raft_consensus.cc:1275] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.584110  8101 consensus_queue.cc:1048] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.593997  7790 raft_consensus.cc:1275] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.595940  8075 consensus_queue.cc:1048] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.652072  7790 raft_consensus.cc:1275] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:52.653530  8075 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:52.662616  7938 raft_consensus.cc:1275] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:52.664239  8075 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:52.742813  7790 raft_consensus.cc:1275] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.744227  8116 consensus_queue.cc:1048] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.753543  7938 raft_consensus.cc:1275] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.757081  8116 consensus_queue.cc:1048] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.853751  7790 raft_consensus.cc:1275] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.855322  8116 consensus_queue.cc:1048] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.865247  7938 raft_consensus.cc:1275] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:52.867519  8116 consensus_queue.cc:1048] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:52.972757  7790 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:52.974164  8116 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:52.982533  7938 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Refusing update from remote peer 44ed36e244d445128d242d86f036d3d0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:52.984836  8116 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:55.005295  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:55.014072  7864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
mode: GRACEFUL
new_leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
 from {username='slave'} at 127.0.0.1:44988
I20260709 13:14:55.014760  7864 raft_consensus.cc:606] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 LEADER]: Received request to transfer leadership to TS cb9ef2ac44944a518cd82b0b6c33a83b
I20260709 13:14:55.017843  7864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
mode: GRACEFUL
new_leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
 from {username='slave'} at 127.0.0.1:44988
I20260709 13:14:55.018369  7864 raft_consensus.cc:606] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 LEADER]: Received request to transfer leadership to TS cb9ef2ac44944a518cd82b0b6c33a83b
I20260709 13:14:55.020979  7864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
mode: GRACEFUL
new_leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
 from {username='slave'} at 127.0.0.1:44988
I20260709 13:14:55.021452  7864 raft_consensus.cc:606] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Received request to transfer leadership to TS cb9ef2ac44944a518cd82b0b6c33a83b
I20260709 13:14:55.024248  7864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
mode: GRACEFUL
new_leader_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:44988
I20260709 13:14:55.024823  7864 raft_consensus.cc:606] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Received request to transfer leadership to TS feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:55.027412  7864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e"
dest_uuid: "44ed36e244d445128d242d86f036d3d0"
mode: GRACEFUL
new_leader_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:44988
I20260709 13:14:55.027908  7864 raft_consensus.cc:606] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Received request to transfer leadership to TS feaf6574b83848eeaad2feff0195dbfe
I20260709 13:14:55.028987  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:14:55.029547  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:14:55.041502  8075 raft_consensus.cc:993] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: : Instructing follower cb9ef2ac44944a518cd82b0b6c33a83b to start an election
I20260709 13:14:55.042115  8125 raft_consensus.cc:1081] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Signalling peer cb9ef2ac44944a518cd82b0b6c33a83b to start an election
I20260709 13:14:55.044150  7790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
 from {username='slave'} at 127.0.0.1:45028
I20260709 13:14:55.044646  7790 raft_consensus.cc:493] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.045069  7790 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.050093  7790 raft_consensus.cc:515] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.052007  7790 leader_election.cc:290] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 3 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:55.053074  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:55.053546  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4662c2f169ed4abcbc03e999437cceda" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:55.053872  7864 raft_consensus.cc:3055] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.054028  7938 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.054193  7864 raft_consensus.cc:740] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:55.055086  7864 consensus_queue.cc:260] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.056381  7864 raft_consensus.cc:3060] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.061093  7938 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 3.
I20260709 13:14:55.062700  7756 leader_election.cc:304] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:55.063079  7864 raft_consensus.cc:2468] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 3.
I20260709 13:14:55.064826  8126 raft_consensus.cc:2804] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:55.066221  8126 raft_consensus.cc:697] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:55.067173  8126 consensus_queue.cc:237] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.074913  7685 catalog_manager.cc:5697] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 2 to 3, leader changed from 44ed36e244d445128d242d86f036d3d0 (127.7.122.66) to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 3 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:55.171167  8075 raft_consensus.cc:993] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: : Instructing follower cb9ef2ac44944a518cd82b0b6c33a83b to start an election
I20260709 13:14:55.171653  8125 raft_consensus.cc:1081] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 LEADER]: Signalling peer cb9ef2ac44944a518cd82b0b6c33a83b to start an election
I20260709 13:14:55.173643  7790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
 from {username='slave'} at 127.0.0.1:45028
I20260709 13:14:55.174196  7790 raft_consensus.cc:493] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.174572  7790 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.179468  7790 raft_consensus.cc:515] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.181051  7790 leader_election.cc:290] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 4 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:55.182049  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:55.182054  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14ec9c1f361848a6acb2067b1c2f7a80" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:55.182576  7938 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.182641  7864 raft_consensus.cc:3055] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:14:55.182960  7864 raft_consensus.cc:740] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:55.183607  7864 consensus_queue.cc:260] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.184412  7864 raft_consensus.cc:3060] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:14:55.187249  7938 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 4.
I20260709 13:14:55.188350  7756 leader_election.cc:304] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:55.188611  7864 raft_consensus.cc:2468] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 4.
I20260709 13:14:55.189239  8126 raft_consensus.cc:2804] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:14:55.189672  8126 raft_consensus.cc:697] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:55.190411  8126 consensus_queue.cc:237] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.198174  7685 catalog_manager.cc:5697] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 3 to 4, leader changed from 44ed36e244d445128d242d86f036d3d0 (127.7.122.66) to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 4 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:55.199456  8075 raft_consensus.cc:993] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: : Instructing follower feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:55.199924  8125 raft_consensus.cc:1081] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Signalling peer feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:55.201620  7938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e"
dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:14:55.202088  7938 raft_consensus.cc:493] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.202469  7938 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.208770  7938 raft_consensus.cc:515] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.210803  8075 raft_consensus.cc:993] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: : Instructing follower cb9ef2ac44944a518cd82b0b6c33a83b to start an election
I20260709 13:14:55.210978  7938 leader_election.cc:290] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 3 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:55.211292  8075 raft_consensus.cc:1081] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 LEADER]: Signalling peer cb9ef2ac44944a518cd82b0b6c33a83b to start an election
I20260709 13:14:55.212035  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:55.212101  7790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e9803c38748b4bd0bc1629b84dad115e" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:55.212642  7864 raft_consensus.cc:3055] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.212744  7790 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.212972  7864 raft_consensus.cc:740] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:55.213299  7791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf"
dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
 from {username='slave'} at 127.0.0.1:45028
I20260709 13:14:55.213862  7791 raft_consensus.cc:493] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.213760  7864 consensus_queue.cc:260] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.214277  7791 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.214712  7864 raft_consensus.cc:3060] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.218712  7864 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 3.
I20260709 13:14:55.219414  7790 raft_consensus.cc:2468] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 3.
I20260709 13:14:55.219832  7907 leader_election.cc:304] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:55.220829  8082 raft_consensus.cc:2804] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:55.221124  7791 raft_consensus.cc:515] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.222247  8082 raft_consensus.cc:697] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Becoming Leader. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:55.223701  7791 leader_election.cc:290] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 5 election: Requested vote from peers 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667), feaf6574b83848eeaad2feff0195dbfe (127.7.122.67:33743)
I20260709 13:14:55.224193  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:55.224861  7864 raft_consensus.cc:3055] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:14:55.224970  7938 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "252c6bd217b44f2b9009c97343185baf" candidate_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
I20260709 13:14:55.225155  7864 raft_consensus.cc:740] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:55.225394  7938 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.225814  7864 consensus_queue.cc:260] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.226588  7864 raft_consensus.cc:3060] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:14:55.223238  8082 consensus_queue.cc:237] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.230998  7864 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 5.
I20260709 13:14:55.231050  7938 raft_consensus.cc:2468] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cb9ef2ac44944a518cd82b0b6c33a83b in term 5.
I20260709 13:14:55.232748  7758 leader_election.cc:304] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44ed36e244d445128d242d86f036d3d0, cb9ef2ac44944a518cd82b0b6c33a83b; no voters: 
I20260709 13:14:55.233996  8126 raft_consensus.cc:2804] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:14:55.234500  8126 raft_consensus.cc:697] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 5 LEADER]: Becoming Leader. State: Replica: cb9ef2ac44944a518cd82b0b6c33a83b, State: Running, Role: LEADER
I20260709 13:14:55.235369  8126 consensus_queue.cc:237] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } }
I20260709 13:14:55.236073  7685 catalog_manager.cc:5697] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe reported cstate change: term changed from 2 to 3, leader changed from 44ed36e244d445128d242d86f036d3d0 (127.7.122.66) to feaf6574b83848eeaad2feff0195dbfe (127.7.122.67). New cstate: current_term: 3 leader_uuid: "feaf6574b83848eeaad2feff0195dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:55.244117  7687 catalog_manager.cc:5697] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b reported cstate change: term changed from 4 to 5, leader changed from 44ed36e244d445128d242d86f036d3d0 (127.7.122.66) to cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65). New cstate: current_term: 5 leader_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:55.446396  8075 raft_consensus.cc:993] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: : Instructing follower feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:55.446905  8125 raft_consensus.cc:1081] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Signalling peer feaf6574b83848eeaad2feff0195dbfe to start an election
I20260709 13:14:55.448664  7938 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666"
dest_uuid: "feaf6574b83848eeaad2feff0195dbfe"
 from {username='slave'} at 127.0.0.1:54882
I20260709 13:14:55.449098  7938 raft_consensus.cc:493] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:55.449335  7938 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.453905  7938 raft_consensus.cc:515] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:55.455585  7938 leader_election.cc:290] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 3 election: Requested vote from peers cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265), 44ed36e244d445128d242d86f036d3d0 (127.7.122.66:44667)
I20260709 13:14:55.456621  7791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b"
I20260709 13:14:55.456734  7864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da7b1a9f8d8a49438f2bf81f4c9ba666" candidate_uuid: "feaf6574b83848eeaad2feff0195dbfe" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "44ed36e244d445128d242d86f036d3d0"
I20260709 13:14:55.457406  7864 raft_consensus.cc:3055] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:14:55.457314  7791 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.457921  7864 raft_consensus.cc:740] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 44ed36e244d445128d242d86f036d3d0, State: Running, Role: LEADER
I20260709 13:14:55.458720  7864 consensus_queue.cc:260] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:55.459648  7864 raft_consensus.cc:3060] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:14:55.463014  7791 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 3.
I20260709 13:14:55.464111  7864 raft_consensus.cc:2468] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate feaf6574b83848eeaad2feff0195dbfe in term 3.
I20260709 13:14:55.464341  7906 leader_election.cc:304] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cb9ef2ac44944a518cd82b0b6c33a83b, feaf6574b83848eeaad2feff0195dbfe; no voters: 
I20260709 13:14:55.465215  8082 raft_consensus.cc:2804] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:14:55.465639  8082 raft_consensus.cc:697] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Becoming Leader. State: Replica: feaf6574b83848eeaad2feff0195dbfe, State: Running, Role: LEADER
I20260709 13:14:55.466432  8082 consensus_queue.cc:237] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } }
I20260709 13:14:55.473690  7687 catalog_manager.cc:5697] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe reported cstate change: term changed from 2 to 3, leader changed from 44ed36e244d445128d242d86f036d3d0 (127.7.122.66) to feaf6574b83848eeaad2feff0195dbfe (127.7.122.67). New cstate: current_term: 3 leader_uuid: "feaf6574b83848eeaad2feff0195dbfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:55.510862  7864 raft_consensus.cc:1275] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Refusing update from remote peer cb9ef2ac44944a518cd82b0b6c33a83b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.512306  8126 consensus_queue.cc:1048] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:55.524272  7938 raft_consensus.cc:1275] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Refusing update from remote peer cb9ef2ac44944a518cd82b0b6c33a83b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.525794  8140 consensus_queue.cc:1048] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:14:55.603420  7938 raft_consensus.cc:1275] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Refusing update from remote peer cb9ef2ac44944a518cd82b0b6c33a83b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:55.604833  8140 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:55.614104  7864 raft_consensus.cc:1275] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Refusing update from remote peer cb9ef2ac44944a518cd82b0b6c33a83b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:14:55.615892  8126 consensus_queue.cc:1048] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:14:55.709924  7864 raft_consensus.cc:1275] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.711141  8082 consensus_queue.cc:1048] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:55.721060  7791 raft_consensus.cc:1275] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.722568  8082 consensus_queue.cc:1048] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:55.780014  7864 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 5 FOLLOWER]: Refusing update from remote peer cb9ef2ac44944a518cd82b0b6c33a83b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:55.781553  8126 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:14:55.792512  7938 raft_consensus.cc:1275] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 5 FOLLOWER]: Refusing update from remote peer cb9ef2ac44944a518cd82b0b6c33a83b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:14:55.793892  8126 consensus_queue.cc:1048] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [LEADER]: Connected to new peer: Peer: permanent_uuid: "feaf6574b83848eeaad2feff0195dbfe" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:14:55.915297  7864 raft_consensus.cc:1275] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.916953  8082 consensus_queue.cc:1048] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "44ed36e244d445128d242d86f036d3d0" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:55.927062  7791 raft_consensus.cc:1275] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Refusing update from remote peer feaf6574b83848eeaad2feff0195dbfe: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:14:55.928591  8082 consensus_queue.cc:1048] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb9ef2ac44944a518cd82b0b6c33a83b" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 40265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:14:56.030606  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:14:56.037849  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
I20260709 13:14:56.069849  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.070750  7657 tablet_replica.cc:333] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.071866  7657 raft_consensus.cc:2243] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.072469  7657 raft_consensus.cc:2272] T baa058df02a044b399f3ade3259234d2 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.074782  7657 tablet_replica.cc:333] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.075258  7657 raft_consensus.cc:2243] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.075927  7657 raft_consensus.cc:2272] T 4662c2f169ed4abcbc03e999437cceda P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.078003  7657 tablet_replica.cc:333] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.078464  7657 raft_consensus.cc:2243] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.078807  7657 raft_consensus.cc:2272] T 2d1d1e5708184507a711d1e20d3200a1 P cb9ef2ac44944a518cd82b0b6c33a83b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.080442  7657 tablet_replica.cc:333] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.081012  7657 raft_consensus.cc:2243] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.081396  7657 raft_consensus.cc:2272] T da7b1a9f8d8a49438f2bf81f4c9ba666 P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.083501  7657 tablet_replica.cc:333] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.083958  7657 raft_consensus.cc:2243] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.084422  7657 raft_consensus.cc:2272] T 8864945e8f044382b236030d9debf946 P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.086247  7657 tablet_replica.cc:333] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.086826  7657 raft_consensus.cc:2243] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.087366  7657 raft_consensus.cc:2272] T 95ca8b7932f045b9b7954185f2d0678c P cb9ef2ac44944a518cd82b0b6c33a83b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.089908  7657 tablet_replica.cc:333] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.090577  7657 raft_consensus.cc:2243] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.091502  7657 raft_consensus.cc:2272] T 14ec9c1f361848a6acb2067b1c2f7a80 P cb9ef2ac44944a518cd82b0b6c33a83b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.093672  7657 tablet_replica.cc:333] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.094110  7657 raft_consensus.cc:2243] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.094561  7657 raft_consensus.cc:2272] T e9803c38748b4bd0bc1629b84dad115e P cb9ef2ac44944a518cd82b0b6c33a83b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.097455  7657 tablet_replica.cc:333] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b: stopping tablet replica
I20260709 13:14:56.097966  7657 raft_consensus.cc:2243] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.098832  7657 raft_consensus.cc:2272] T 252c6bd217b44f2b9009c97343185baf P cb9ef2ac44944a518cd82b0b6c33a83b [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:14:56.100201  7832 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:14:56.103556  7832 consensus_peers.cc:597] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 -> Peer cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265): Couldn't send request to peer cb9ef2ac44944a518cd82b0b6c33a83b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.232802  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
W20260709 13:14:56.234609  7832 consensus_peers.cc:597] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 -> Peer cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265): Couldn't send request to peer cb9ef2ac44944a518cd82b0b6c33a83b. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:40265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.235145  7832 consensus_peers.cc:597] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 -> Peer cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265): Couldn't send request to peer cb9ef2ac44944a518cd82b0b6c33a83b. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:40265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:14:56.235932  7906 consensus_peers.cc:597] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe -> Peer cb9ef2ac44944a518cd82b0b6c33a83b (127.7.122.65:40265): Couldn't send request to peer cb9ef2ac44944a518cd82b0b6c33a83b. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:40265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:14:56.253813  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
I20260709 13:14:56.280041  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.280751  7657 tablet_replica.cc:333] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.281482  7657 raft_consensus.cc:2243] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.281980  7657 raft_consensus.cc:2272] T 252c6bd217b44f2b9009c97343185baf P 44ed36e244d445128d242d86f036d3d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.284312  7657 tablet_replica.cc:333] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.284932  7657 raft_consensus.cc:2243] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.285358  7657 raft_consensus.cc:2272] T baa058df02a044b399f3ade3259234d2 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.287096  7657 tablet_replica.cc:333] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.287792  7657 raft_consensus.cc:2243] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.288578  7657 raft_consensus.cc:2272] T 8864945e8f044382b236030d9debf946 P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.290280  7657 tablet_replica.cc:333] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.290766  7657 raft_consensus.cc:2243] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.291164  7657 raft_consensus.cc:2272] T 14ec9c1f361848a6acb2067b1c2f7a80 P 44ed36e244d445128d242d86f036d3d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.293134  7657 tablet_replica.cc:333] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.293637  7657 raft_consensus.cc:2243] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.294039  7657 raft_consensus.cc:2272] T e9803c38748b4bd0bc1629b84dad115e P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.296128  7657 tablet_replica.cc:333] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.296643  7657 raft_consensus.cc:2243] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.297397  7657 raft_consensus.cc:2272] T 2d1d1e5708184507a711d1e20d3200a1 P 44ed36e244d445128d242d86f036d3d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.299067  7657 tablet_replica.cc:333] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.299569  7657 raft_consensus.cc:2243] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.300006  7657 raft_consensus.cc:2272] T 4662c2f169ed4abcbc03e999437cceda P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.302193  7657 tablet_replica.cc:333] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.302704  7657 raft_consensus.cc:2243] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.303112  7657 raft_consensus.cc:2272] T da7b1a9f8d8a49438f2bf81f4c9ba666 P 44ed36e244d445128d242d86f036d3d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.305266  7657 tablet_replica.cc:333] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0: stopping tablet replica
I20260709 13:14:56.305706  7657 raft_consensus.cc:2243] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.306417  7657 raft_consensus.cc:2272] T 95ca8b7932f045b9b7954185f2d0678c P 44ed36e244d445128d242d86f036d3d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.334964  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
I20260709 13:14:56.353605  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
I20260709 13:14:56.391475  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:14:56.392222  7657 tablet_replica.cc:333] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.393205  7657 raft_consensus.cc:2243] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.394019  7657 raft_consensus.cc:2272] T baa058df02a044b399f3ade3259234d2 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.395764  7657 tablet_replica.cc:333] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.396306  7657 raft_consensus.cc:2243] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.397200  7657 raft_consensus.cc:2272] T 8864945e8f044382b236030d9debf946 P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.399300  7657 tablet_replica.cc:333] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.399996  7657 raft_consensus.cc:2243] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.400480  7657 raft_consensus.cc:2272] T 252c6bd217b44f2b9009c97343185baf P feaf6574b83848eeaad2feff0195dbfe [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.403295  7657 tablet_replica.cc:333] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.403879  7657 raft_consensus.cc:2243] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.404306  7657 raft_consensus.cc:2272] T 4662c2f169ed4abcbc03e999437cceda P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.406512  7657 tablet_replica.cc:333] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.407043  7657 raft_consensus.cc:2243] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.407473  7657 raft_consensus.cc:2272] T 2d1d1e5708184507a711d1e20d3200a1 P feaf6574b83848eeaad2feff0195dbfe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.409471  7657 tablet_replica.cc:333] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.410002  7657 raft_consensus.cc:2243] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.410449  7657 raft_consensus.cc:2272] T 95ca8b7932f045b9b7954185f2d0678c P feaf6574b83848eeaad2feff0195dbfe [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.412202  7657 tablet_replica.cc:333] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.412684  7657 raft_consensus.cc:2243] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.413432  7657 raft_consensus.cc:2272] T e9803c38748b4bd0bc1629b84dad115e P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.415314  7657 tablet_replica.cc:333] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.415797  7657 raft_consensus.cc:2243] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:14:56.416234  7657 raft_consensus.cc:2272] T 14ec9c1f361848a6acb2067b1c2f7a80 P feaf6574b83848eeaad2feff0195dbfe [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.418747  7657 tablet_replica.cc:333] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe: stopping tablet replica
I20260709 13:14:56.419338  7657 raft_consensus.cc:2243] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.420265  7657 raft_consensus.cc:2272] T da7b1a9f8d8a49438f2bf81f4c9ba666 P feaf6574b83848eeaad2feff0195dbfe [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.451079  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
I20260709 13:14:56.469888  7657 master.cc:562] Master@127.7.122.126:36083 shutting down...
I20260709 13:14:56.678396  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:14:56.678990  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:14:56.679392  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4e862cccafe54f3ba06372d53e2e7766: stopping tablet replica
I20260709 13:14:56.698484  7657 master.cc:584] Master@127.7.122.126:36083 shutdown complete.
44ed36e244d445128d242d86f036d3d0  4
cb9ef2ac44944a518cd82b0b6c33a83b  4
feaf6574b83848eeaad2feff0195dbfe  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (13007 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:14:56.741506  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:43391
I20260709 13:14:56.742708  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:56.749014  8157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.748978  8158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.750195  8160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.750999  7657 server_base.cc:1061] running on GCE node
I20260709 13:14:56.751910  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.752106  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.752220  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602896752209 us; error 0 us; skew 500 ppm
I20260709 13:14:56.752676  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.755420  7657 webserver.cc:533] Webserver started at http://127.7.122.126:44679/ using document root <none> and password file <none>
I20260709 13:14:56.755883  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.756057  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.756290  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.757494  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "a43d8e6eb7974c2ebd47e994a43bca86"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-078m"
I20260709 13:14:56.762089  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:14:56.765655  8165 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.766718  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:14:56.766994  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "a43d8e6eb7974c2ebd47e994a43bca86"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-078m"
I20260709 13:14:56.767247  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:56.782590  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:56.783838  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:56.827725  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:43391
I20260709 13:14:56.827884  8216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:43391 every 8 connection(s)
I20260709 13:14:56.831846  8217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:56.842203  8217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86: Bootstrap starting.
I20260709 13:14:56.847007  8217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:56.852015  8217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86: No bootstrap required, opened a new log
I20260709 13:14:56.854290  8217 raft_consensus.cc:359] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" member_type: VOTER }
I20260709 13:14:56.854939  8217 raft_consensus.cc:385] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:56.855271  8217 raft_consensus.cc:740] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a43d8e6eb7974c2ebd47e994a43bca86, State: Initialized, Role: FOLLOWER
I20260709 13:14:56.855942  8217 consensus_queue.cc:260] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" member_type: VOTER }
I20260709 13:14:56.856431  8217 raft_consensus.cc:399] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:14:56.856683  8217 raft_consensus.cc:493] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:14:56.856989  8217 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:56.861366  8217 raft_consensus.cc:515] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" member_type: VOTER }
I20260709 13:14:56.862002  8217 leader_election.cc:304] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a43d8e6eb7974c2ebd47e994a43bca86; no voters: 
I20260709 13:14:56.863233  8217 leader_election.cc:290] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:14:56.863680  8220 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:56.865147  8220 raft_consensus.cc:697] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 1 LEADER]: Becoming Leader. State: Replica: a43d8e6eb7974c2ebd47e994a43bca86, State: Running, Role: LEADER
I20260709 13:14:56.865844  8220 consensus_queue.cc:237] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" member_type: VOTER }
I20260709 13:14:56.866328  8217 sys_catalog.cc:565] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:14:56.870806  8221 sys_catalog.cc:455] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" member_type: VOTER } }
I20260709 13:14:56.870986  8222 sys_catalog.cc:455] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a43d8e6eb7974c2ebd47e994a43bca86. Latest consensus state: current_term: 1 leader_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a43d8e6eb7974c2ebd47e994a43bca86" member_type: VOTER } }
I20260709 13:14:56.871673  8221 sys_catalog.cc:458] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:56.871971  8222 sys_catalog.cc:458] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [sys.catalog]: This master's current role is: LEADER
I20260709 13:14:56.875885  8226 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:14:56.884416  8226 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:14:56.887089  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:14:56.894940  8226 catalog_manager.cc:1383] Generated new cluster ID: a8781ee0d2744c989e24595e6bc292c8
I20260709 13:14:56.895265  8226 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:14:56.921813  8226 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:14:56.923146  8226 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:14:56.935874  8226 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86: Generated new TSK 0
I20260709 13:14:56.936640  8226 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:14:56.954182  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:56.962746  8238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:56.964154  8239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.967820  7657 server_base.cc:1061] running on GCE node
W20260709 13:14:56.967922  8241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:56.969228  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:56.969697  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:56.969923  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602896969903 us; error 0 us; skew 500 ppm
I20260709 13:14:56.970583  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:56.973819  7657 webserver.cc:533] Webserver started at http://127.7.122.65:35953/ using document root <none> and password file <none>
I20260709 13:14:56.974454  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:56.974797  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:56.975219  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:56.976333  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "b83afb25703c427cb58d3ca95cdd2d20"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-078m"
I20260709 13:14:56.982131  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:14:56.987082  8246 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:56.987967  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:56.988323  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "b83afb25703c427cb58d3ca95cdd2d20"
format_stamp: "Formatted at 2026-07-09 13:14:56 on dist-test-slave-078m"
I20260709 13:14:56.988657  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:57.000294  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:57.001673  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:57.003248  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:57.005654  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:57.006119  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.006428  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:57.006781  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.051263  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:36881
I20260709 13:14:57.051422  8308 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:36881 every 8 connection(s)
I20260709 13:14:57.056447  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:57.064381  8313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.065385  8314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.067289  8316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.069070  7657 server_base.cc:1061] running on GCE node
I20260709 13:14:57.070178  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:57.070369  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:57.070564  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602897070546 us; error 0 us; skew 500 ppm
I20260709 13:14:57.071126  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:57.074534  7657 webserver.cc:533] Webserver started at http://127.7.122.66:45795/ using document root <none> and password file <none>
I20260709 13:14:57.075199  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:57.075457  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:57.075793  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:57.076236  8309 heartbeater.cc:344] Connected to a master server at 127.7.122.126:43391
I20260709 13:14:57.076628  8309 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:57.077339  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "5235dec0eb314d1688c7e2161443ff70"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-078m"
I20260709 13:14:57.077543  8309 heartbeater.cc:507] Master 127.7.122.126:43391 requested a full tablet report, sending...
I20260709 13:14:57.079996  8182 ts_manager.cc:194] Registered new tserver with Master: b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881)
I20260709 13:14:57.082547  8182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49736
I20260709 13:14:57.083400  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:14:57.087637  8321 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.088565  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:14:57.088821  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "5235dec0eb314d1688c7e2161443ff70"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-078m"
I20260709 13:14:57.089148  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:57.099756  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:57.101039  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:57.102494  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:57.104811  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:57.105098  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.105392  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:57.105541  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.154942  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:39603
I20260709 13:14:57.155076  8383 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:39603 every 8 connection(s)
I20260709 13:14:57.159955  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:14:57.167806  8387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.169852  8388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:14:57.172178  8390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:14:57.172391  7657 server_base.cc:1061] running on GCE node
I20260709 13:14:57.173523  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:14:57.173759  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:14:57.173964  8384 heartbeater.cc:344] Connected to a master server at 127.7.122.126:43391
I20260709 13:14:57.173985  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602897173963 us; error 0 us; skew 500 ppm
I20260709 13:14:57.174461  8384 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:57.174916  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:14:57.175367  8384 heartbeater.cc:507] Master 127.7.122.126:43391 requested a full tablet report, sending...
I20260709 13:14:57.177865  8182 ts_manager.cc:194] Registered new tserver with Master: 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:14:57.177961  7657 webserver.cc:533] Webserver started at http://127.7.122.67:45893/ using document root <none> and password file <none>
I20260709 13:14:57.178573  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:14:57.178774  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:14:57.179051  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:14:57.179426  8182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49752
I20260709 13:14:57.180197  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "d9cd7125082b4d228f8545585f5342b1"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-078m"
I20260709 13:14:57.185245  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:14:57.188733  8395 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.189765  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:14:57.190204  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "d9cd7125082b4d228f8545585f5342b1"
format_stamp: "Formatted at 2026-07-09 13:14:57 on dist-test-slave-078m"
I20260709 13:14:57.190548  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:14:57.212419  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:14:57.213837  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:14:57.215337  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:14:57.217648  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:14:57.217888  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.218143  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:14:57.218324  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:14:57.262900  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:34009
I20260709 13:14:57.262998  8457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:34009 every 8 connection(s)
I20260709 13:14:57.278182  8458 heartbeater.cc:344] Connected to a master server at 127.7.122.126:43391
I20260709 13:14:57.278723  8458 heartbeater.cc:461] Registering TS with master...
I20260709 13:14:57.279546  8458 heartbeater.cc:507] Master 127.7.122.126:43391 requested a full tablet report, sending...
I20260709 13:14:57.281785  8182 ts_manager.cc:194] Registered new tserver with Master: d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:57.282030  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015734711s
I20260709 13:14:57.283706  8182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49768
I20260709 13:14:57.311843  8182 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49780:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:14:57.315215  8182 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:14:57.405875  8274 tablet_service.cc:1511] Processing CreateTablet for tablet e96e357931c940e4a1a63080d6913a10 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:57.407691  8274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96e357931c940e4a1a63080d6913a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.409587  8349 tablet_service.cc:1511] Processing CreateTablet for tablet e96e357931c940e4a1a63080d6913a10 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:57.411039  8349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96e357931c940e4a1a63080d6913a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.410629  8347 tablet_service.cc:1511] Processing CreateTablet for tablet 22d818391bec461f9fad4c0623eb8449 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:57.412117  8347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d818391bec461f9fad4c0623eb8449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.413792  8348 tablet_service.cc:1511] Processing CreateTablet for tablet 496ba00f41074061bac2a02b2c3dc254 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:57.414582  8273 tablet_service.cc:1511] Processing CreateTablet for tablet 496ba00f41074061bac2a02b2c3dc254 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:57.415330  8348 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496ba00f41074061bac2a02b2c3dc254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.415956  8273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496ba00f41074061bac2a02b2c3dc254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.422801  8272 tablet_service.cc:1511] Processing CreateTablet for tablet 22d818391bec461f9fad4c0623eb8449 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:57.424517  8272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d818391bec461f9fad4c0623eb8449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.426280  8346 tablet_service.cc:1511] Processing CreateTablet for tablet 72aa2532c218495996f5b42375a7a955 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:57.427814  8346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72aa2532c218495996f5b42375a7a955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.433498  8423 tablet_service.cc:1511] Processing CreateTablet for tablet e96e357931c940e4a1a63080d6913a10 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:14:57.435148  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96e357931c940e4a1a63080d6913a10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.435650  8345 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0dfa246db944d7848d1916d949acc1 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:57.437045  8345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0dfa246db944d7848d1916d949acc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.438136  8271 tablet_service.cc:1511] Processing CreateTablet for tablet 72aa2532c218495996f5b42375a7a955 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:57.439612  8271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72aa2532c218495996f5b42375a7a955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.442524  8422 tablet_service.cc:1511] Processing CreateTablet for tablet 496ba00f41074061bac2a02b2c3dc254 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:14:57.443939  8422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 496ba00f41074061bac2a02b2c3dc254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.447117  8344 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7da4b61f0f40ea8ca7f446bbd15f3d (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:57.448503  8344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7da4b61f0f40ea8ca7f446bbd15f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.446986  8270 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0dfa246db944d7848d1916d949acc1 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:57.449824  8270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0dfa246db944d7848d1916d949acc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.449957  8269 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7da4b61f0f40ea8ca7f446bbd15f3d (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:57.450357  8267 tablet_service.cc:1511] Processing CreateTablet for tablet 7db7cd20495149528c4a919b5d85efc4 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:57.450390  8421 tablet_service.cc:1511] Processing CreateTablet for tablet 22d818391bec461f9fad4c0623eb8449 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:14:57.451572  8269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7da4b61f0f40ea8ca7f446bbd15f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.452237  8267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7cd20495149528c4a919b5d85efc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.452059  8421 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22d818391bec461f9fad4c0623eb8449. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.453365  8268 tablet_service.cc:1511] Processing CreateTablet for tablet 758529d6fb8646a5836f5b2c67aab305 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:57.454828  8268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758529d6fb8646a5836f5b2c67aab305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.466248  8343 tablet_service.cc:1511] Processing CreateTablet for tablet 758529d6fb8646a5836f5b2c67aab305 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:57.467783  8343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758529d6fb8646a5836f5b2c67aab305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.468533  8420 tablet_service.cc:1511] Processing CreateTablet for tablet 72aa2532c218495996f5b42375a7a955 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:14:57.470000  8420 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72aa2532c218495996f5b42375a7a955. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.476660  8419 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0dfa246db944d7848d1916d949acc1 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:14:57.478205  8419 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0dfa246db944d7848d1916d949acc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.483740  8342 tablet_service.cc:1511] Processing CreateTablet for tablet 7db7cd20495149528c4a919b5d85efc4 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:57.485663  8341 tablet_service.cc:1511] Processing CreateTablet for tablet 378f26ce98eb48f5aa696d33f74af6ac (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:57.487686  8342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7cd20495149528c4a919b5d85efc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.488760  8341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378f26ce98eb48f5aa696d33f74af6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.489805  8266 tablet_service.cc:1511] Processing CreateTablet for tablet 378f26ce98eb48f5aa696d33f74af6ac (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:57.491267  8266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378f26ce98eb48f5aa696d33f74af6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.506945  8418 tablet_service.cc:1511] Processing CreateTablet for tablet 4e7da4b61f0f40ea8ca7f446bbd15f3d (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:14:57.508410  8418 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e7da4b61f0f40ea8ca7f446bbd15f3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.510138  8417 tablet_service.cc:1511] Processing CreateTablet for tablet 758529d6fb8646a5836f5b2c67aab305 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:14:57.511653  8417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 758529d6fb8646a5836f5b2c67aab305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.517084  8416 tablet_service.cc:1511] Processing CreateTablet for tablet 7db7cd20495149528c4a919b5d85efc4 (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:14:57.529402  8416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7db7cd20495149528c4a919b5d85efc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.547937  8474 tablet_bootstrap.cc:492] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:57.548571  8473 tablet_bootstrap.cc:492] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.556407  8415 tablet_service.cc:1511] Processing CreateTablet for tablet 378f26ce98eb48f5aa696d33f74af6ac (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:14:57.557934  8415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 378f26ce98eb48f5aa696d33f74af6ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.569475  8273 tablet_service.cc:1511] Processing CreateTablet for tablet a9eb55db01fa46fca0fef800343bb6df (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:57.569949  8344 tablet_service.cc:1511] Processing CreateTablet for tablet a9eb55db01fa46fca0fef800343bb6df (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:57.571635  8344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9eb55db01fa46fca0fef800343bb6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.572408  8273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9eb55db01fa46fca0fef800343bb6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.572557  8423 tablet_service.cc:1511] Processing CreateTablet for tablet a9eb55db01fa46fca0fef800343bb6df (DEFAULT_TABLE table=test-workload [id=4672e5bdcad44586a2b70b434d5cb7d8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:14:57.583086  8474 tablet_bootstrap.cc:654] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.615370  8475 tablet_bootstrap.cc:492] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:57.617799  8423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9eb55db01fa46fca0fef800343bb6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:14:57.619792  8474 tablet_bootstrap.cc:492] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:57.622527  8474 ts_tablet_manager.cc:1403] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.075s	user 0.020s	sys 0.017s
I20260709 13:14:57.625429  8473 tablet_bootstrap.cc:654] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.641426  8475 tablet_bootstrap.cc:654] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.643602  8474 raft_consensus.cc:359] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.644387  8474 raft_consensus.cc:385] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.644815  8474 raft_consensus.cc:740] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.646811  8474 consensus_queue.cc:260] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.653403  8473 tablet_bootstrap.cc:492] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.654290  8473 ts_tablet_manager.cc:1403] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.006s
I20260709 13:14:57.656991  8309 heartbeater.cc:499] Master 127.7.122.126:43391 was elected leader, sending a full tablet report...
I20260709 13:14:57.657801  8475 tablet_bootstrap.cc:492] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:57.658317  8475 ts_tablet_manager.cc:1403] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.003s
I20260709 13:14:57.658051  8473 raft_consensus.cc:359] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.659319  8473 raft_consensus.cc:385] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.659818  8473 raft_consensus.cc:740] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.660601  8473 consensus_queue.cc:260] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.662001  8475 raft_consensus.cc:359] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.662598  8474 ts_tablet_manager.cc:1434] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.006s
I20260709 13:14:57.663141  8475 raft_consensus.cc:385] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.663544  8475 raft_consensus.cc:740] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.664546  8474 tablet_bootstrap.cc:492] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:57.664347  8475 consensus_queue.cc:260] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.676404  8474 tablet_bootstrap.cc:654] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.681950  8384 heartbeater.cc:499] Master 127.7.122.126:43391 was elected leader, sending a full tablet report...
I20260709 13:14:57.682998  8473 ts_tablet_manager.cc:1434] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.010s
I20260709 13:14:57.684016  8473 tablet_bootstrap.cc:492] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.691479  8473 tablet_bootstrap.cc:654] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.695163  8479 raft_consensus.cc:493] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.695894  8479 raft_consensus.cc:515] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.715934  8479 leader_election.cc:290] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:57.726152  8458 heartbeater.cc:499] Master 127.7.122.126:43391 was elected leader, sending a full tablet report...
I20260709 13:14:57.726764  8475 ts_tablet_manager.cc:1434] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.068s	user 0.041s	sys 0.027s
I20260709 13:14:57.727739  8475 tablet_bootstrap.cc:492] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:57.734849  8475 tablet_bootstrap.cc:654] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.740335  8473 tablet_bootstrap.cc:492] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.741557  8473 ts_tablet_manager.cc:1403] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.058s	user 0.030s	sys 0.026s
I20260709 13:14:57.746132  8473 raft_consensus.cc:359] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.747298  8473 raft_consensus.cc:385] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.747809  8473 raft_consensus.cc:740] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.748937  8473 consensus_queue.cc:260] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.756274  8473 ts_tablet_manager.cc:1434] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:14:57.757869  8473 tablet_bootstrap.cc:492] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.770967  8473 tablet_bootstrap.cc:654] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.783968  8474 tablet_bootstrap.cc:492] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:57.784510  8474 ts_tablet_manager.cc:1403] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.120s	user 0.033s	sys 0.029s
I20260709 13:14:57.784765  8473 tablet_bootstrap.cc:492] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.785300  8473 ts_tablet_manager.cc:1403] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 13:14:57.788257  8473 raft_consensus.cc:359] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.789057  8473 raft_consensus.cc:385] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.789482  8473 raft_consensus.cc:740] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.790360  8473 consensus_queue.cc:260] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.791574  8474 raft_consensus.cc:359] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.792564  8474 raft_consensus.cc:385] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.792972  8474 raft_consensus.cc:740] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.793183  8481 raft_consensus.cc:493] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.793851  8481 raft_consensus.cc:515] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.793960  8474 consensus_queue.cc:260] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.799796  8473 ts_tablet_manager.cc:1434] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:14:57.803395  8473 tablet_bootstrap.cc:492] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.809986  8473 tablet_bootstrap.cc:654] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.813910  8474 ts_tablet_manager.cc:1434] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.005s
I20260709 13:14:57.815407  8474 tablet_bootstrap.cc:492] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:57.821861  8473 tablet_bootstrap.cc:492] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.822384  8473 ts_tablet_manager.cc:1403] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:14:57.823014  8474 tablet_bootstrap.cc:654] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.823943  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:57.824954  8433 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:57.825474  8473 raft_consensus.cc:359] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.826387  8473 raft_consensus.cc:385] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.826812  8473 raft_consensus.cc:740] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.827127  8249 leader_election.cc:304] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:57.829282  8473 consensus_queue.cc:260] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.828066  8481 leader_election.cc:290] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:57.834687  8474 tablet_bootstrap.cc:492] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:57.834965  8473 ts_tablet_manager.cc:1434] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:14:57.835211  8474 ts_tablet_manager.cc:1403] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:14:57.835947  8473 tablet_bootstrap.cc:492] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.838275  8474 raft_consensus.cc:359] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.839032  8474 raft_consensus.cc:385] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.839368  8474 raft_consensus.cc:740] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.840176  8474 consensus_queue.cc:260] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.842963  8473 tablet_bootstrap.cc:654] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.845989  8479 raft_consensus.cc:2804] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.842960  8474 ts_tablet_manager.cc:1434] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:14:57.846439  8479 raft_consensus.cc:493] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.846818  8479 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.847307  8474 tablet_bootstrap.cc:492] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:57.854408  8474 tablet_bootstrap.cc:654] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.854792  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:57.855739  8359 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:57.860031  8473 tablet_bootstrap.cc:492] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.860985  8473 ts_tablet_manager.cc:1403] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:14:57.865489  8473 raft_consensus.cc:359] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.866865  8473 raft_consensus.cc:385] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.867383  8473 raft_consensus.cc:740] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.868840  8473 consensus_queue.cc:260] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.860175  8479 raft_consensus.cc:515] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.872368  8473 ts_tablet_manager.cc:1434] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:14:57.873860  8473 tablet_bootstrap.cc:492] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.874171  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:57.874859  8359 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.885360  8474 tablet_bootstrap.cc:492] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:57.885921  8474 ts_tablet_manager.cc:1403] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.019s
W20260709 13:14:57.887284  8230 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:14:57.888742  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:57.889366  8433 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.889456  8479 leader_election.cc:290] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:57.890125  8479 raft_consensus.cc:493] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:57.890559  8479 raft_consensus.cc:515] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.892316  8473 tablet_bootstrap.cc:654] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.893759  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72aa2532c218495996f5b42375a7a955" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:57.894448  8358 raft_consensus.cc:2468] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:57.896617  8248 leader_election.cc:304] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:57.897986  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72aa2532c218495996f5b42375a7a955" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:57.901999  8359 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
W20260709 13:14:57.905786  8249 leader_election.cc:343] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.906459  8248 leader_election.cc:304] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:57.907825  8475 tablet_bootstrap.cc:492] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:57.909155  8475 ts_tablet_manager.cc:1403] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.182s	user 0.070s	sys 0.089s
I20260709 13:14:57.901669  8474 raft_consensus.cc:359] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.892773  8479 leader_election.cc:290] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:57.910790  8474 raft_consensus.cc:385] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.896426  8433 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:57.918531  8479 raft_consensus.cc:2804] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:57.919088  8479 raft_consensus.cc:493] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:57.919549  8479 raft_consensus.cc:3060] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.926543  8475 raft_consensus.cc:359] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.927408  8475 raft_consensus.cc:385] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.927718  8475 raft_consensus.cc:740] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.923776  8474 raft_consensus.cc:740] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.929785  8474 consensus_queue.cc:260] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.932289  8474 ts_tablet_manager.cc:1434] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.001s
I20260709 13:14:57.933327  8474 tablet_bootstrap.cc:492] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:57.935465  8497 raft_consensus.cc:2804] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.936381  8497 raft_consensus.cc:697] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:57.937469  8473 tablet_bootstrap.cc:492] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.938028  8473 ts_tablet_manager.cc:1403] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.064s	user 0.032s	sys 0.007s
I20260709 13:14:57.938176  8497 consensus_queue.cc:237] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.937498  8475 consensus_queue.cc:260] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.936959  8479 raft_consensus.cc:515] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.941295  8473 raft_consensus.cc:359] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.942093  8473 raft_consensus.cc:385] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.942462  8473 raft_consensus.cc:740] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.943044  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72aa2532c218495996f5b42375a7a955" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:57.943360  8473 consensus_queue.cc:260] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.943732  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
W20260709 13:14:57.944463  8249 leader_election.cc:343] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:57.945988  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72aa2532c218495996f5b42375a7a955" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:57.946559  8359 raft_consensus.cc:3060] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:57.948920  8473 ts_tablet_manager.cc:1434] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:14:57.950028  8473 tablet_bootstrap.cc:492] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.953096  8479 leader_election.cc:290] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:57.953457  8474 tablet_bootstrap.cc:654] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.955996  8359 raft_consensus.cc:2468] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:57.955878  8475 ts_tablet_manager.cc:1434] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.003s
I20260709 13:14:57.964130  8475 tablet_bootstrap.cc:492] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:57.965337  8248 leader_election.cc:304] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:57.966447  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:57.967563  8433 raft_consensus.cc:2393] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5235dec0eb314d1688c7e2161443ff70 in current term 1: Already voted for candidate b83afb25703c427cb58d3ca95cdd2d20 in this term.
I20260709 13:14:57.970669  8475 tablet_bootstrap.cc:654] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.969962  8182 catalog_manager.cc:5697] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:57.971657  8324 leader_election.cc:304] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70; no voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:57.957484  8473 tablet_bootstrap.cc:654] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.973151  8479 raft_consensus.cc:2804] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:57.973853  8479 raft_consensus.cc:697] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:57.975404  8481 raft_consensus.cc:2749] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:57.974763  8479 consensus_queue.cc:237] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.978376  8474 tablet_bootstrap.cc:492] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:57.978909  8474 ts_tablet_manager.cc:1403] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.012s
I20260709 13:14:57.982374  8473 tablet_bootstrap.cc:492] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:57.983026  8473 ts_tablet_manager.cc:1403] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:14:57.982818  8474 raft_consensus.cc:359] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.983575  8474 raft_consensus.cc:385] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.983898  8474 raft_consensus.cc:740] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.984581  8475 tablet_bootstrap.cc:492] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:57.984659  8474 consensus_queue.cc:260] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.985765  8475 ts_tablet_manager.cc:1403] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:14:57.986037  8473 raft_consensus.cc:359] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.986796  8473 raft_consensus.cc:385] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.987154  8474 ts_tablet_manager.cc:1434] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:14:57.987097  8473 raft_consensus.cc:740] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.987943  8473 consensus_queue.cc:260] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.988588  8474 tablet_bootstrap.cc:492] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:57.989976  8475 raft_consensus.cc:359] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.990242  8473 ts_tablet_manager.cc:1434] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:57.990850  8475 raft_consensus.cc:385] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:57.991258  8475 raft_consensus.cc:740] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:57.991592  8473 tablet_bootstrap.cc:492] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:57.992338  8475 consensus_queue.cc:260] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:57.995952  8474 tablet_bootstrap.cc:654] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:57.997828  8475 ts_tablet_manager.cc:1434] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:14:57.998966  8475 tablet_bootstrap.cc:492] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:57.999229  8473 tablet_bootstrap.cc:654] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.005800  8475 tablet_bootstrap.cc:654] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.009549  8474 tablet_bootstrap.cc:492] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:58.010315  8474 ts_tablet_manager.cc:1403] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.009s
I20260709 13:14:58.014519  8474 raft_consensus.cc:359] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.015566  8474 raft_consensus.cc:385] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.016005  8474 raft_consensus.cc:740] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.017707  8474 consensus_queue.cc:260] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.019793  8473 tablet_bootstrap.cc:492] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:58.020270  8473 ts_tablet_manager.cc:1403] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.014s
I20260709 13:14:58.020337  8474 ts_tablet_manager.cc:1434] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:14:58.020972  8475 tablet_bootstrap.cc:492] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.021490  8474 tablet_bootstrap.cc:492] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:58.021963  8475 ts_tablet_manager.cc:1403] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 13:14:58.025204  8475 raft_consensus.cc:359] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.026041  8475 raft_consensus.cc:385] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.026405  8475 raft_consensus.cc:740] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.027278  8475 consensus_queue.cc:260] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.029026  8474 tablet_bootstrap.cc:654] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.029994  8475 ts_tablet_manager.cc:1434] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:14:58.030540  8473 raft_consensus.cc:359] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.031231  8473 raft_consensus.cc:385] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.031553  8473 raft_consensus.cc:740] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.032203  8182 catalog_manager.cc:5697] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.032500  8473 consensus_queue.cc:260] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.035566  8475 tablet_bootstrap.cc:492] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:58.039037  8473 ts_tablet_manager.cc:1434] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:14:58.039976  8473 tablet_bootstrap.cc:492] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:58.040659  8474 tablet_bootstrap.cc:492] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:58.041152  8474 ts_tablet_manager.cc:1403] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.014s
I20260709 13:14:58.043001  8475 tablet_bootstrap.cc:654] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.044124  8474 raft_consensus.cc:359] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.044898  8474 raft_consensus.cc:385] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.045198  8474 raft_consensus.cc:740] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.045748  8473 tablet_bootstrap.cc:654] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.046195  8474 consensus_queue.cc:260] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.048988  8474 ts_tablet_manager.cc:1434] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:14:58.050329  8474 tablet_bootstrap.cc:492] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:58.061214  8481 raft_consensus.cc:493] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.062215  8481 raft_consensus.cc:515] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.063017  8474 tablet_bootstrap.cc:654] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.065125  8481 leader_election.cc:290] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.067215  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.068840  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.069490  8479 raft_consensus.cc:493] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.072553  8479 raft_consensus.cc:515] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.076081  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.076813  8359 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
W20260709 13:14:58.076956  8324 leader_election.cc:343] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.077492  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
W20260709 13:14:58.077654  8324 leader_election.cc:343] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.078105  8324 leader_election.cc:304] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70; no voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:58.078142  8248 leader_election.cc:304] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
W20260709 13:14:58.078892  8249 leader_election.cc:343] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.079164  8488 raft_consensus.cc:2749] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.076138  8479 leader_election.cc:290] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.079532  8497 raft_consensus.cc:2804] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.080046  8497 raft_consensus.cc:493] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.080405  8497 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.080842  8475 tablet_bootstrap.cc:492] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.081372  8475 ts_tablet_manager.cc:1403] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.046s	user 0.018s	sys 0.018s
I20260709 13:14:58.083722  8475 raft_consensus.cc:359] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.084299  8475 raft_consensus.cc:385] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.084564  8475 raft_consensus.cc:740] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.071864  8481 raft_consensus.cc:493] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.085306  8475 consensus_queue.cc:260] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.085448  8481 raft_consensus.cc:515] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.087728  8473 tablet_bootstrap.cc:492] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:58.088241  8473 ts_tablet_manager.cc:1403] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.012s
I20260709 13:14:58.088479  8481 leader_election.cc:290] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.088577  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.090056  8284 raft_consensus.cc:2468] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 0.
I20260709 13:14:58.091387  8473 raft_consensus.cc:359] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.092206  8473 raft_consensus.cc:385] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.092541  8473 raft_consensus.cc:740] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.092756  8475 ts_tablet_manager.cc:1434] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.002s
I20260709 13:14:58.093791  8475 tablet_bootstrap.cc:492] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:58.093447  8473 consensus_queue.cc:260] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.095624  8473 ts_tablet_manager.cc:1434] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:14:58.096535  8473 tablet_bootstrap.cc:492] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70: Bootstrap starting.
I20260709 13:14:58.098508  8324 leader_election.cc:304] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.099403  8488 raft_consensus.cc:2804] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.099781  8488 raft_consensus.cc:493] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.100116  8488 raft_consensus.cc:3060] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.103879  8473 tablet_bootstrap.cc:654] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.091310  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.105191  8433 raft_consensus.cc:2468] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 0.
I20260709 13:14:58.106594  8474 tablet_bootstrap.cc:492] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:58.107054  8474 ts_tablet_manager.cc:1403] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.057s	user 0.028s	sys 0.009s
I20260709 13:14:58.109604  8481 raft_consensus.cc:493] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.109747  8474 raft_consensus.cc:359] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.110556  8474 raft_consensus.cc:385] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.110879  8474 raft_consensus.cc:740] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.110361  8481 raft_consensus.cc:515] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.111568  8474 consensus_queue.cc:260] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.113936  8474 ts_tablet_manager.cc:1434] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:14:58.114432  8488 raft_consensus.cc:515] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.115446  8474 tablet_bootstrap.cc:492] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:58.117877  8481 leader_election.cc:290] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.120343  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.122044  8474 tablet_bootstrap.cc:654] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.121938  8479 raft_consensus.cc:493] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.122495  8479 raft_consensus.cc:515] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.124846  8479 leader_election.cc:290] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.126351  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.128618  8359 raft_consensus.cc:2468] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.126549  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.132019  8480 raft_consensus.cc:493] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.132746  8480 raft_consensus.cc:515] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.139883  8475 tablet_bootstrap.cc:654] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
W20260709 13:14:58.140224  8249 leader_election.cc:343] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.141561  8248 leader_election.cc:304] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: d9cd7125082b4d228f8545585f5342b1
W20260709 13:14:58.126959  8324 leader_election.cc:343] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.148551  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.149521  8433 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 0.
I20260709 13:14:58.150676  8479 raft_consensus.cc:2804] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.151203  8479 raft_consensus.cc:493] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.151727  8479 raft_consensus.cc:3060] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.136655  8480 leader_election.cc:290] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:14:58.154871  8475 tablet_bootstrap.cc:492] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.155625  8475 ts_tablet_manager.cc:1403] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.011s
I20260709 13:14:58.159813  8475 raft_consensus.cc:359] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.160936  8475 raft_consensus.cc:385] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.161369  8475 raft_consensus.cc:740] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.162724  8475 consensus_queue.cc:260] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.166115  8494 raft_consensus.cc:493] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.166513  8475 ts_tablet_manager.cc:1434] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:14:58.166735  8494 raft_consensus.cc:515] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.168109  8475 tablet_bootstrap.cc:492] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:58.170063  8494 leader_election.cc:290] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.172973  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.174093  8359 raft_consensus.cc:2468] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.175971  8248 leader_election.cc:304] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.177305  8494 raft_consensus.cc:2804] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.177826  8494 raft_consensus.cc:493] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.178279  8494 raft_consensus.cc:3060] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.182821  8475 tablet_bootstrap.cc:654] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.187608  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:58.188516  8284 raft_consensus.cc:3060] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.197095  8497 raft_consensus.cc:515] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.201350  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:58.202409  8359 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.215880  8488 leader_election.cc:290] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.223704  8324 leader_election.cc:304] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.232685  8488 raft_consensus.cc:2804] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.233296  8488 raft_consensus.cc:493] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.233737  8488 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.242787  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.243702  8433 raft_consensus.cc:2468] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.245421  8481 raft_consensus.cc:493] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.246078  8481 raft_consensus.cc:515] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.248828  8481 leader_election.cc:290] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.250952  8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.251679  8283 raft_consensus.cc:2468] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 0.
I20260709 13:14:58.252341  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.252956  8433 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.252993  8324 leader_election.cc:304] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.254074  8481 raft_consensus.cc:2804] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.254549  8481 raft_consensus.cc:493] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.254977  8481 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.268252  8497 leader_election.cc:290] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.269693  8480 raft_consensus.cc:493] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.270460  8480 raft_consensus.cc:515] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.273355  8480 leader_election.cc:290] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:14:58.275096  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.275904  8432 raft_consensus.cc:3060] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.307874  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
W20260709 13:14:58.309399  8324 leader_election.cc:343] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.312497  8432 raft_consensus.cc:2468] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 1.
I20260709 13:14:58.316152  8284 raft_consensus.cc:2468] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 1.
I20260709 13:14:58.318128  8324 leader_election.cc:304] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.323982  8479 raft_consensus.cc:515] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.343789  8519 raft_consensus.cc:2804] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.345745  8494 raft_consensus.cc:515] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.358736  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:58.359598  8358 raft_consensus.cc:3060] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.372527  8481 raft_consensus.cc:515] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.373255  8474 tablet_bootstrap.cc:492] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:58.373747  8474 ts_tablet_manager.cc:1403] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.258s	user 0.078s	sys 0.153s
I20260709 13:14:58.374740  8481 leader_election.cc:290] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.376499  8474 raft_consensus.cc:359] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.377241  8474 raft_consensus.cc:385] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.377539  8474 raft_consensus.cc:740] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.377677  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.378237  8474 consensus_queue.cc:260] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.379724  8358 raft_consensus.cc:2468] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.380195  8474 ts_tablet_manager.cc:1434] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:14:58.381111  8474 tablet_bootstrap.cc:492] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: Bootstrap starting.
I20260709 13:14:58.381814  8248 leader_election.cc:304] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.382871  8473 tablet_bootstrap.cc:492] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70: No bootstrap required, opened a new log
I20260709 13:14:58.383324  8473 ts_tablet_manager.cc:1403] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70: Time spent bootstrapping tablet: real 0.287s	user 0.110s	sys 0.125s
I20260709 13:14:58.383052  8359 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.388954  8519 raft_consensus.cc:697] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:58.390657  8248 leader_election.cc:304] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.387086  8497 raft_consensus.cc:2804] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.392720  8475 tablet_bootstrap.cc:492] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.392848  8473 raft_consensus.cc:359] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.393435  8475 ts_tablet_manager.cc:1403] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.226s	user 0.079s	sys 0.122s
I20260709 13:14:58.393702  8473 raft_consensus.cc:385] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.394027  8473 raft_consensus.cc:740] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Initialized, Role: FOLLOWER
W20260709 13:14:58.384763  8324 leader_election.cc:343] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.398017  8473 consensus_queue.cc:260] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.401026  8519 consensus_queue.cc:237] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.402484  8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.402957  8282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72aa2532c218495996f5b42375a7a955" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.403223  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.403826  8432 raft_consensus.cc:3060] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.404914  8494 leader_election.cc:290] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.405587  8494 raft_consensus.cc:2804] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.406224  8494 raft_consensus.cc:697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:58.407087  8494 consensus_queue.cc:237] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.409869  8473 ts_tablet_manager.cc:1434] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:14:58.399183  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:58.411202  8284 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.412725  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
W20260709 13:14:58.414194  8249 leader_election.cc:343] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:14:58.410490  8488 raft_consensus.cc:515] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.421061  8475 raft_consensus.cc:359] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.417601  8433 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.418613  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.418613  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72aa2532c218495996f5b42375a7a955" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.420486  8432 raft_consensus.cc:2468] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.421782  8475 raft_consensus.cc:385] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.422734  8358 raft_consensus.cc:2393] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9cd7125082b4d228f8545585f5342b1 in current term 1: Already voted for candidate b83afb25703c427cb58d3ca95cdd2d20 in this term.
I20260709 13:14:58.422732  8359 raft_consensus.cc:2393] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9cd7125082b4d228f8545585f5342b1 in current term 1: Already voted for candidate b83afb25703c427cb58d3ca95cdd2d20 in this term.
I20260709 13:14:58.416160  8497 raft_consensus.cc:697] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:58.415181  8479 leader_election.cc:290] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.427706  8397 leader_election.cc:304] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9cd7125082b4d228f8545585f5342b1; no voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.428095  8488 leader_election.cc:290] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.428575  8282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:58.429222  8282 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.423394  8475 raft_consensus.cc:740] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.430348  8480 raft_consensus.cc:3060] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.431620  8475 consensus_queue.cc:260] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.433995  8497 consensus_queue.cc:237] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.437091  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:58.437731  8359 raft_consensus.cc:3060] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.441412  8182 catalog_manager.cc:5697] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.443703  8480 raft_consensus.cc:2749] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.444456  8359 raft_consensus.cc:2468] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.448285  8474 tablet_bootstrap.cc:654] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.450002  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.453890  8433 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.455053  8475 ts_tablet_manager.cc:1434] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.061s	user 0.012s	sys 0.006s
I20260709 13:14:58.455500  8248 leader_election.cc:304] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:58.456197  8475 tablet_bootstrap.cc:492] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:58.456620  8479 raft_consensus.cc:2804] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.457242  8479 raft_consensus.cc:697] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:58.458881  8479 consensus_queue.cc:237] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.465291  8475 tablet_bootstrap.cc:654] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.452370  8284 raft_consensus.cc:2468] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 1.
I20260709 13:14:58.444460  8282 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 1.
I20260709 13:14:58.471287  8324 leader_election.cc:304] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:58.471313  8521 consensus_queue.cc:1048] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.473052  8519 raft_consensus.cc:2804] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.473739  8519 raft_consensus.cc:697] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:58.474947  8519 consensus_queue.cc:237] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.476078  8433 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 1.
I20260709 13:14:58.479012  8324 leader_election.cc:304] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.480716  8488 raft_consensus.cc:2804] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.481331  8488 raft_consensus.cc:697] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:58.482183  8488 consensus_queue.cc:237] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.497725  8398 leader_election.cc:304] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9cd7125082b4d228f8545585f5342b1; no voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.498618  8524 raft_consensus.cc:2749] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.508723  8475 tablet_bootstrap.cc:492] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.509516  8475 ts_tablet_manager.cc:1403] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.006s
I20260709 13:14:58.510092  8182 catalog_manager.cc:5697] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.513077  8182 catalog_manager.cc:5697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.513899  8475 raft_consensus.cc:359] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.515584  8475 raft_consensus.cc:385] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.515874  8475 raft_consensus.cc:740] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.516583  8475 consensus_queue.cc:260] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.518926  8475 ts_tablet_manager.cc:1434] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:14:58.519973  8475 tablet_bootstrap.cc:492] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:58.521065  8474 tablet_bootstrap.cc:492] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: No bootstrap required, opened a new log
I20260709 13:14:58.522737  8474 ts_tablet_manager.cc:1403] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: Time spent bootstrapping tablet: real 0.142s	user 0.008s	sys 0.016s
I20260709 13:14:58.525895  8474 raft_consensus.cc:359] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.526818  8474 raft_consensus.cc:385] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.527226  8474 raft_consensus.cc:740] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.527976  8474 consensus_queue.cc:260] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.529048  8521 consensus_queue.cc:1048] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.535461  8475 tablet_bootstrap.cc:654] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.536199  8474 ts_tablet_manager.cc:1434] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:14:58.542176  8178 catalog_manager.cc:5697] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.544569  8178 catalog_manager.cc:5697] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.545552  8522 consensus_queue.cc:1048] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.552115  8475 tablet_bootstrap.cc:492] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.552641  8475 ts_tablet_manager.cc:1403] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:14:58.557683  8475 raft_consensus.cc:359] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.558362  8475 raft_consensus.cc:385] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.558600  8475 raft_consensus.cc:740] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.559334  8475 consensus_queue.cc:260] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.566316  8182 catalog_manager.cc:5697] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.569059  8521 consensus_queue.cc:1048] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.574182  8475 ts_tablet_manager.cc:1434] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:14:58.575093  8475 tablet_bootstrap.cc:492] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1: Bootstrap starting.
I20260709 13:14:58.584589  8475 tablet_bootstrap.cc:654] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:14:58.611500  8521 raft_consensus.cc:493] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.612110  8521 raft_consensus.cc:515] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.614485  8521 leader_election.cc:290] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.615572  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.616611  8359 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.618274  8248 leader_election.cc:304] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.618888  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.619556  8432 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.619963  8475 tablet_bootstrap.cc:492] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1: No bootstrap required, opened a new log
I20260709 13:14:58.620481  8475 ts_tablet_manager.cc:1403] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.010s
I20260709 13:14:58.621104  8521 raft_consensus.cc:2804] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.621495  8521 raft_consensus.cc:493] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.621831  8521 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.623512  8475 raft_consensus.cc:359] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.624219  8475 raft_consensus.cc:385] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:14:58.624639  8475 raft_consensus.cc:740] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Initialized, Role: FOLLOWER
I20260709 13:14:58.625442  8475 consensus_queue.cc:260] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.627676  8475 ts_tablet_manager.cc:1434] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:14:58.628234  8521 raft_consensus.cc:515] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.630995  8521 leader_election.cc:290] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.631498  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:58.632102  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.632467  8359 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.632758  8432 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.638286  8359 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.639394  8248 leader_election.cc:304] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:58.639583  8432 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.640190  8521 raft_consensus.cc:2804] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.640674  8521 raft_consensus.cc:697] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:58.641389  8521 consensus_queue.cc:237] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.649727  8182 catalog_manager.cc:5697] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.662040  8480 raft_consensus.cc:493] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.662562  8480 raft_consensus.cc:515] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.664358  8480 leader_election.cc:290] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:14:58.665550  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.665550  8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.666580  8359 raft_consensus.cc:2393] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9cd7125082b4d228f8545585f5342b1 in current term 1: Already voted for candidate b83afb25703c427cb58d3ca95cdd2d20 in this term.
I20260709 13:14:58.667621  8397 leader_election.cc:304] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9cd7125082b4d228f8545585f5342b1; no voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.668298  8480 raft_consensus.cc:3060] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.673106  8480 raft_consensus.cc:2749] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.753093  8521 raft_consensus.cc:493] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.753547  8521 raft_consensus.cc:515] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.755740  8521 leader_election.cc:290] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.756497  8488 raft_consensus.cc:493] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.756744  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.756862  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.757052  8488 raft_consensus.cc:515] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.757457  8432 raft_consensus.cc:2468] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.757999  8359 raft_consensus.cc:2468] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 0.
I20260709 13:14:58.758662  8249 leader_election.cc:304] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:58.759378  8488 leader_election.cc:290] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.759853  8521 raft_consensus.cc:2804] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.760246  8521 raft_consensus.cc:493] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.760267  8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.760708  8521 raft_consensus.cc:3060] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.760650  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1" is_pre_election: true
I20260709 13:14:58.761363  8432 raft_consensus.cc:2468] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 0.
I20260709 13:14:58.762336  8324 leader_election.cc:304] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:58.763008  8488 raft_consensus.cc:2804] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:14:58.763321  8488 raft_consensus.cc:493] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:14:58.763609  8488 raft_consensus.cc:3060] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.766007  8521 raft_consensus.cc:515] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.767109  8283 raft_consensus.cc:2393] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5235dec0eb314d1688c7e2161443ff70 in current term 1: Already voted for candidate b83afb25703c427cb58d3ca95cdd2d20 in this term.
I20260709 13:14:58.768662  8521 leader_election.cc:290] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.768471  8488 raft_consensus.cc:515] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.768981  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:58.769661  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.769891  8359 raft_consensus.cc:2393] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b83afb25703c427cb58d3ca95cdd2d20 in current term 1: Already voted for candidate 5235dec0eb314d1688c7e2161443ff70 in this term.
I20260709 13:14:58.770350  8432 raft_consensus.cc:3060] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.770596  8488 leader_election.cc:290] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.771922  8283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:58.771960  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:58.772595  8283 raft_consensus.cc:2393] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5235dec0eb314d1688c7e2161443ff70 in current term 1: Already voted for candidate b83afb25703c427cb58d3ca95cdd2d20 in this term.
I20260709 13:14:58.773675  8324 leader_election.cc:304] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70; no voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:58.774478  8488 raft_consensus.cc:2749] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:14:58.776547  8432 raft_consensus.cc:2468] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 1.
I20260709 13:14:58.777614  8249 leader_election.cc:304] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 5235dec0eb314d1688c7e2161443ff70
I20260709 13:14:58.778364  8521 raft_consensus.cc:2804] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:14:58.778863  8521 raft_consensus.cc:697] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:58.779630  8521 consensus_queue.cc:237] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.786290  8182 catalog_manager.cc:5697] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 0 to 1, leader changed from <none> to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:58.808375  8521 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.819446  8479 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.869240  8479 consensus_queue.cc:1048] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.883509  8494 consensus_queue.cc:1048] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.897658  8359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:36982
I20260709 13:14:58.898242  8359 raft_consensus.cc:606] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.907492  8359 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:36982
I20260709 13:14:58.908043  8359 raft_consensus.cc:606] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.928651  8283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:56130
I20260709 13:14:58.929665  8283 raft_consensus.cc:606] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Received request to transfer leadership to TS 5235dec0eb314d1688c7e2161443ff70
I20260709 13:14:58.935808  8283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:56130
I20260709 13:14:58.936367  8283 raft_consensus.cc:606] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Received request to transfer leadership to TS 5235dec0eb314d1688c7e2161443ff70
I20260709 13:14:58.947845  8283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:56130
I20260709 13:14:58.947803  8519 consensus_queue.cc:1048] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.948597  8283 raft_consensus.cc:606] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Received request to transfer leadership to TS 5235dec0eb314d1688c7e2161443ff70
I20260709 13:14:58.948740  8488 consensus_queue.cc:1048] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:58.952682  8521 consensus_queue.cc:1048] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.955955  8282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:56130
I20260709 13:14:58.956656  8282 raft_consensus.cc:606] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Received request to transfer leadership to TS d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:58.961261  8521 consensus_queue.cc:1048] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:58.971182  8494 raft_consensus.cc:993] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:14:58.971727  8494 raft_consensus.cc:1081] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Signalling peer 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:14:58.976962  8480 raft_consensus.cc:493] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:14:58.977497  8480 raft_consensus.cc:515] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.979550  8359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:14:58.981407  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5235dec0eb314d1688c7e2161443ff70" is_pre_election: true
I20260709 13:14:58.981834  8480 leader_election.cc:290] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:14:58.981912  8282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20" is_pre_election: true
I20260709 13:14:58.982717  8282 raft_consensus.cc:2393] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d9cd7125082b4d228f8545585f5342b1 in current term 1: Already voted for candidate 5235dec0eb314d1688c7e2161443ff70 in this term.
I20260709 13:14:58.980480  8359 raft_consensus.cc:493] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:58.983507  8359 raft_consensus.cc:3060] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:58.984557  8398 leader_election.cc:304] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d9cd7125082b4d228f8545585f5342b1; no voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:14:58.986285  8480 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:14:58.992524  8359 raft_consensus.cc:515] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:58.998999  8359 leader_election.cc:290] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:58.999744  8480 raft_consensus.cc:2749] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:14:59.000181  8282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:59.000880  8282 raft_consensus.cc:3055] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.001207  8282 raft_consensus.cc:740] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:59.001695  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "378f26ce98eb48f5aa696d33f74af6ac" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:59.002319  8433 raft_consensus.cc:3060] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.002038  8282 consensus_queue.cc:260] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.003363  8282 raft_consensus.cc:3060] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.013159  8520 raft_consensus.cc:993] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:14:59.013854  8520 raft_consensus.cc:1081] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:14:59.018646  8281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:14:59.019538  8281 raft_consensus.cc:493] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.020036  8281 raft_consensus.cc:3060] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.020383  8433 raft_consensus.cc:2468] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:14:59.025322  8282 raft_consensus.cc:2468] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:14:59.025233  8324 leader_election.cc:304] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:59.026348  8520 raft_consensus.cc:2804] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.026906  8520 raft_consensus.cc:697] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:59.027863  8520 consensus_queue.cc:237] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.031883  8281 raft_consensus.cc:515] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.034981  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:59.035161  8281 leader_election.cc:290] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 2 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:59.035650  8359 raft_consensus.cc:3055] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.035852  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22d818391bec461f9fad4c0623eb8449" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:59.036041  8359 raft_consensus.cc:740] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:59.037154  8433 raft_consensus.cc:3060] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.036983  8359 consensus_queue.cc:260] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.038322  8359 raft_consensus.cc:3060] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.044494  8433 raft_consensus.cc:2468] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 2.
I20260709 13:14:59.045840  8249 leader_election.cc:304] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:59.046635  8521 raft_consensus.cc:2804] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.047058  8521 raft_consensus.cc:697] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:59.047070  8359 raft_consensus.cc:2468] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 2.
I20260709 13:14:59.047942  8521 consensus_queue.cc:237] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.053009  8179 catalog_manager.cc:5697] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 1 to 2, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.061349  8177 catalog_manager.cc:5697] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 1 to 2, leader changed from 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.066710  8521 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.074386  8519 consensus_queue.cc:1048] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.074738  8520 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.085768  8520 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.086324  8521 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.098719  8521 raft_consensus.cc:993] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:14:59.099234  8521 raft_consensus.cc:1081] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Signalling peer 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:14:59.101778  8359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:14:59.102428  8359 raft_consensus.cc:493] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.102830  8359 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.108132  8488 raft_consensus.cc:993] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:14:59.109827  8488 raft_consensus.cc:1081] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:14:59.110818  8488 consensus_queue.cc:1048] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:59.110766  8359 raft_consensus.cc:515] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.114310  8282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:14:59.114966  8282 raft_consensus.cc:493] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.115479  8282 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.119189  8359 leader_election.cc:290] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:59.122112  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:59.122984  8284 raft_consensus.cc:3055] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.123333  8284 raft_consensus.cc:740] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:59.123914  8282 raft_consensus.cc:515] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.125514  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:59.126762  8282 leader_election.cc:290] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 2 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:59.127470  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:59.127835  8432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:59.128074  8358 raft_consensus.cc:3055] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.124220  8284 consensus_queue.cc:260] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.128427  8358 raft_consensus.cc:740] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:59.129410  8284 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.129446  8358 consensus_queue.cc:260] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.130630  8358 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.126449  8433 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.136440  8284 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:14:59.138341  8358 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 2.
I20260709 13:14:59.140056  8248 leader_election.cc:304] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: d9cd7125082b4d228f8545585f5342b1
I20260709 13:14:59.140913  8497 raft_consensus.cc:2804] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.141445  8497 raft_consensus.cc:697] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:59.141296  8324 leader_election.cc:304] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:14:59.141834  8433 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:14:59.142486  8488 raft_consensus.cc:2804] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.142298  8497 consensus_queue.cc:237] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.142977  8488 raft_consensus.cc:697] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:59.143888  8488 consensus_queue.cc:237] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.152267  8177 catalog_manager.cc:5697] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 1 to 2, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.154670  8180 catalog_manager.cc:5697] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 1 to 2, leader changed from 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.210651  8497 consensus_queue.cc:1048] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.217792  8521 raft_consensus.cc:993] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:14:59.218307  8479 raft_consensus.cc:1081] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Signalling peer d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:14:59.220811  8433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:46176
I20260709 13:14:59.222548  8433 raft_consensus.cc:493] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.222981  8433 raft_consensus.cc:3060] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.222913  8521 consensus_queue.cc:1048] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:14:59.230659  8433 raft_consensus.cc:515] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.236042  8433 leader_election.cc:290] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 2 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:14:59.236739  8281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:59.237227  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9eb55db01fa46fca0fef800343bb6df" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:14:59.237704  8281 raft_consensus.cc:3055] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.237845  8358 raft_consensus.cc:3060] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.238085  8281 raft_consensus.cc:740] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:59.238965  8281 consensus_queue.cc:260] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.240212  8281 raft_consensus.cc:3060] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.244774  8358 raft_consensus.cc:2468] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 2.
I20260709 13:14:59.247925  8281 raft_consensus.cc:2468] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 2.
I20260709 13:14:59.249114  8398 leader_election.cc:304] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:59.250063  8480 raft_consensus.cc:2804] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.250583  8480 raft_consensus.cc:697] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Becoming Leader. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:14:59.251384  8480 consensus_queue.cc:237] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.259358  8179 catalog_manager.cc:5697] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 reported cstate change: term changed from 1 to 2, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to d9cd7125082b4d228f8545585f5342b1 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "d9cd7125082b4d228f8545585f5342b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: HEALTHY } } }
I20260709 13:14:59.279327  8497 raft_consensus.cc:993] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:14:59.279812  8521 raft_consensus.cc:1081] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Signalling peer 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:14:59.281723  8358 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:14:59.282270  8358 raft_consensus.cc:493] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:14:59.282615  8358 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.288992  8358 raft_consensus.cc:515] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.291280  8358 leader_election.cc:290] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:14:59.291975  8281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:14:59.292565  8281 raft_consensus.cc:3055] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:14:59.292922  8281 raft_consensus.cc:740] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:14:59.293119  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:14:59.293658  8433 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.293711  8281 consensus_queue.cc:260] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.295702  8281 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.300727  8433 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:14:59.302824  8281 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:14:59.302892  8324 leader_election.cc:304] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:14:59.303764  8488 raft_consensus.cc:2804] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:14:59.304260  8488 raft_consensus.cc:697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:14:59.305116  8488 consensus_queue.cc:237] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:14:59.314666  8179 catalog_manager.cc:5697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 1 to 2, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:14:59.549896  8359 raft_consensus.cc:1275] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.551251  8433 raft_consensus.cc:1275] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.551576  8521 consensus_queue.cc:1048] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.552772  8488 consensus_queue.cc:1048] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.559890  8431 raft_consensus.cc:1275] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.561590  8497 consensus_queue.cc:1048] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.571161  8281 raft_consensus.cc:1275] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.573179  8488 consensus_queue.cc:1048] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.625133  8433 raft_consensus.cc:1275] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.626368  8488 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.635939  8281 raft_consensus.cc:1275] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.636749  8433 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:14:59.637823  8520 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.646255  8433 raft_consensus.cc:1275] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.647643  8497 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:14:59.657202  8359 raft_consensus.cc:1275] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.660008  8358 raft_consensus.cc:1275] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.661569  8480 consensus_queue.cc:1048] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.662609  8497 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.671315  8281 raft_consensus.cc:1275] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.673607  8562 consensus_queue.cc:1048] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:14:59.832336  8281 raft_consensus.cc:1275] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.833910  8488 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:14:59.844558  8433 raft_consensus.cc:1275] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:14:59.846153  8564 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:02.001313  7657 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:02.002303  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:02.021780  8281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:56146
I20260709 13:15:02.022430  8281 raft_consensus.cc:606] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Received request to transfer leadership to TS d9cd7125082b4d228f8545585f5342b1
I20260709 13:15:02.025959  8281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:56146
I20260709 13:15:02.026875  8281 raft_consensus.cc:606] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Received request to transfer leadership to TS d9cd7125082b4d228f8545585f5342b1
I20260709 13:15:02.028106  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:02.028905  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:02.054366  8566 raft_consensus.cc:993] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:02.054855  8566 raft_consensus.cc:1081] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Signalling peer d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:02.056649  8433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:46176
I20260709 13:15:02.057121  8433 raft_consensus.cc:493] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.057384  8433 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.061491  8433 raft_consensus.cc:515] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:02.062943  8433 leader_election.cc:290] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 2 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:15:02.063838  8281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:15:02.064133  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:02.064952  8281 raft_consensus.cc:3055] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:02.064952  8358 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.065367  8281 raft_consensus.cc:740] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:02.066263  8281 consensus_queue.cc:260] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:02.067958  8281 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:02.074712  8358 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 2.
I20260709 13:15:02.076316  8397 leader_election.cc:304] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:02.077817  8281 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 2.
I20260709 13:15:02.084056  8562 raft_consensus.cc:2804] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:02.085738  8562 raft_consensus.cc:697] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Becoming Leader. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:15:02.086920  8562 consensus_queue.cc:237] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:02.098237  8177 catalog_manager.cc:5697] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 reported cstate change: term changed from 1 to 2, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to d9cd7125082b4d228f8545585f5342b1 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "d9cd7125082b4d228f8545585f5342b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.475292  8358 raft_consensus.cc:1275] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.477340  8562 consensus_queue.cc:1048] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:02.492260  8281 raft_consensus.cc:1275] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:02.494063  8562 consensus_queue.cc:1048] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:02.536839  8566 raft_consensus.cc:993] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:02.537425  8570 raft_consensus.cc:1081] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Signalling peer d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:02.538865  8433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:46176
I20260709 13:15:02.539330  8433 raft_consensus.cc:493] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:02.539705  8433 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.543792  8433 raft_consensus.cc:515] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:02.545308  8433 leader_election.cc:290] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 3 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881)
I20260709 13:15:02.546190  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:02.546550  8281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:15:02.546833  8358 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.547088  8281 raft_consensus.cc:3055] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:02.547411  8281 raft_consensus.cc:740] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:02.548242  8281 consensus_queue.cc:260] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:02.549494  8281 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:02.554046  8358 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 3.
I20260709 13:15:02.555482  8397 leader_election.cc:304] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:02.556123  8281 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 3.
I20260709 13:15:02.556247  8571 raft_consensus.cc:2804] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:02.556768  8571 raft_consensus.cc:697] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 LEADER]: Becoming Leader. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:15:02.557600  8571 consensus_queue.cc:237] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:02.564823  8179 catalog_manager.cc:5697] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 reported cstate change: term changed from 2 to 3, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to d9cd7125082b4d228f8545585f5342b1 (127.7.122.67). New cstate: current_term: 3 leader_uuid: "d9cd7125082b4d228f8545585f5342b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:02.970099  8281 raft_consensus.cc:1275] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:02.972230  8562 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:02.983522  8358 raft_consensus.cc:1275] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:02.985199  8571 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.030051  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:03.055671  8433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:15:03.056322  8433 raft_consensus.cc:606] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:15:03.062426  8433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:46200
I20260709 13:15:03.063119  8433 raft_consensus.cc:606] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:15:03.079010  8358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:36982
I20260709 13:15:03.079661  8358 raft_consensus.cc:606] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:15:03.085714  8358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:36982
I20260709 13:15:03.086351  8358 raft_consensus.cc:606] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:15:03.092361  8358 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
mode: GRACEFUL
new_leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:36982
I20260709 13:15:03.092991  8358 raft_consensus.cc:606] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Received request to transfer leadership to TS b83afb25703c427cb58d3ca95cdd2d20
I20260709 13:15:03.258335  8584 raft_consensus.cc:993] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.258836  8584 raft_consensus.cc:1081] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.260566  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:15:03.261040  8284 raft_consensus.cc:493] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:03.261303  8284 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.266072  8284 raft_consensus.cc:515] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.267807  8284 leader_election.cc:290] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 3 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:03.268821  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:03.268646  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:03.269425  8433 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.269493  8358 raft_consensus.cc:3055] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:03.269850  8358 raft_consensus.cc:740] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:15:03.270673  8358 consensus_queue.cc:260] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.271857  8358 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.275911  8433 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 3.
I20260709 13:15:03.277236  8249 leader_election.cc:304] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:03.277945  8570 raft_consensus.cc:2804] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.278337  8358 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 3.
I20260709 13:15:03.279137  8570 raft_consensus.cc:697] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:03.280051  8570 consensus_queue.cc:237] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.286871  8179 catalog_manager.cc:5697] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 2 to 3, leader changed from 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.358104  8564 raft_consensus.cc:993] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.358582  8584 raft_consensus.cc:1081] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.360432  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:15:03.360929  8284 raft_consensus.cc:493] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:03.361186  8284 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:03.367311  8586 raft_consensus.cc:993] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.367056  8284 raft_consensus.cc:515] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.367799  8571 raft_consensus.cc:1081] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.369199  8284 leader_election.cc:290] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 2 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:03.369343  8281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56114
I20260709 13:15:03.369915  8281 raft_consensus.cc:493] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:03.369863  8358 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:03.370379  8281 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.370517  8358 raft_consensus.cc:3055] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:03.370872  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:03.370851  8358 raft_consensus.cc:740] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:15:03.371369  8433 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:03.371870  8358 consensus_queue.cc:260] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.373143  8358 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:03.375871  8433 raft_consensus.cc:2468] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 2.
I20260709 13:15:03.377477  8249 leader_election.cc:304] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:03.377614  8281 raft_consensus.cc:515] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.378827  8570 raft_consensus.cc:2804] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:03.379421  8570 raft_consensus.cc:697] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:03.380225  8570 consensus_queue.cc:237] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.380765  8358 raft_consensus.cc:2468] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 2.
I20260709 13:15:03.380826  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:03.381495  8359 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.387712  8586 raft_consensus.cc:993] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.388516  8571 raft_consensus.cc:1081] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.389146  8359 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 3.
I20260709 13:15:03.390463  8281 leader_election.cc:290] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 3 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:03.390508  8248 leader_election.cc:304] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:15:03.391794  8591 raft_consensus.cc:2804] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.391974  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56114
I20260709 13:15:03.392366  8591 raft_consensus.cc:697] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:03.392665  8284 raft_consensus.cc:493] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:03.393211  8284 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.393500  8591 consensus_queue.cc:237] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.395658  8433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "496ba00f41074061bac2a02b2c3dc254" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:03.396219  8433 raft_consensus.cc:3055] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:03.396518  8433 raft_consensus.cc:740] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:15:03.397275  8433 consensus_queue.cc:260] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.397511  8179 catalog_manager.cc:5697] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 1 to 2, leader changed from 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.398506  8433 raft_consensus.cc:3060] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.400468  8284 raft_consensus.cc:515] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.403311  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:03.403878  8359 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.404709  8284 leader_election.cc:290] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 4 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:03.404942  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96e357931c940e4a1a63080d6913a10" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:03.405503  8431 raft_consensus.cc:3055] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:03.405833  8431 raft_consensus.cc:740] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:15:03.406689  8431 consensus_queue.cc:260] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.407971  8431 raft_consensus.cc:3060] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:03.407339  8433 raft_consensus.cc:2468] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 3.
I20260709 13:15:03.410888  8359 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 4.
I20260709 13:15:03.412029  8248 leader_election.cc:304] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, b83afb25703c427cb58d3ca95cdd2d20; no voters: 
I20260709 13:15:03.412846  8591 raft_consensus.cc:2804] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:03.413429  8591 raft_consensus.cc:697] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:03.412923  8179 catalog_manager.cc:5697] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 2 to 3, leader changed from d9cd7125082b4d228f8545585f5342b1 (127.7.122.67) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.414590  8431 raft_consensus.cc:2468] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 4.
I20260709 13:15:03.414247  8591 consensus_queue.cc:237] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.427467  8179 catalog_manager.cc:5697] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 3 to 4, leader changed from d9cd7125082b4d228f8545585f5342b1 (127.7.122.67) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 4 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.478309  8564 raft_consensus.cc:993] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: : Instructing follower b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.478776  8584 raft_consensus.cc:1081] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Signalling peer b83afb25703c427cb58d3ca95cdd2d20 to start an election
I20260709 13:15:03.481006  8284 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
 from {username='slave'} at 127.0.0.1:56106
I20260709 13:15:03.481654  8284 raft_consensus.cc:493] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:03.482057  8284 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.487396  8284 raft_consensus.cc:515] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.489272  8284 leader_election.cc:290] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 3 election: Requested vote from peers 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:03.490224  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:03.490506  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "b83afb25703c427cb58d3ca95cdd2d20" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:03.490917  8359 raft_consensus.cc:3055] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:03.491179  8431 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.491318  8359 raft_consensus.cc:740] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:15:03.492343  8359 consensus_queue.cc:260] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.493340  8359 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:03.497115  8431 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 3.
I20260709 13:15:03.498337  8359 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b83afb25703c427cb58d3ca95cdd2d20 in term 3.
I20260709 13:15:03.498294  8249 leader_election.cc:304] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b83afb25703c427cb58d3ca95cdd2d20, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:03.499389  8591 raft_consensus.cc:2804] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:03.499903  8591 raft_consensus.cc:697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Becoming Leader. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:03.500595  8591 consensus_queue.cc:237] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:03.508337  8179 catalog_manager.cc:5697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 reported cstate change: term changed from 2 to 3, leader changed from 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66) to b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "b83afb25703c427cb58d3ca95cdd2d20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:03.768177  8431 raft_consensus.cc:1275] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.769944  8591 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.782015  8359 raft_consensus.cc:1275] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.785948  8601 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.861557  8359 raft_consensus.cc:1275] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:03.863461  8601 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:03.876718  8431 raft_consensus.cc:1275] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:03.879514  8601 consensus_queue.cc:1048] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:03.976460  8359 raft_consensus.cc:1275] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.978395  8601 consensus_queue.cc:1048] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:03.991051  8431 raft_consensus.cc:1275] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.992447  8359 raft_consensus.cc:1275] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:03.993053  8570 consensus_queue.cc:1048] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:03.994935  8601 consensus_queue.cc:1048] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:03.996920  8431 raft_consensus.cc:1275] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:03.998482  8601 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:04.008893  8433 raft_consensus.cc:1275] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:04.012542  8609 consensus_queue.cc:1048] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:15:04.035825  8359 raft_consensus.cc:1275] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Refusing update from remote peer b83afb25703c427cb58d3ca95cdd2d20: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:04.038069  8609 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:06.102049  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:06.110314  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:56146
I20260709 13:15:06.111207  8284 raft_consensus.cc:606] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Received request to transfer leadership to TS 5235dec0eb314d1688c7e2161443ff70
I20260709 13:15:06.114702  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:56146
I20260709 13:15:06.115381  8284 raft_consensus.cc:606] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Received request to transfer leadership to TS d9cd7125082b4d228f8545585f5342b1
I20260709 13:15:06.118665  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:56146
I20260709 13:15:06.119280  8284 raft_consensus.cc:606] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Received request to transfer leadership to TS d9cd7125082b4d228f8545585f5342b1
I20260709 13:15:06.122421  8284 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4"
dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
mode: GRACEFUL
new_leader_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:56146
I20260709 13:15:06.123049  8284 raft_consensus.cc:606] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Received request to transfer leadership to TS 5235dec0eb314d1688c7e2161443ff70
I20260709 13:15:06.124295  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:06.124782  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:06.281373  8614 raft_consensus.cc:993] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:06.281838  8614 raft_consensus.cc:1081] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Signalling peer d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:06.283684  8431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:46176
I20260709 13:15:06.284230  8431 raft_consensus.cc:493] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.284638  8431 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.290766  8431 raft_consensus.cc:515] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.292811  8431 leader_election.cc:290] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 4 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:15:06.294111  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:15:06.294107  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "758529d6fb8646a5836f5b2c67aab305" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:06.294910  8284 raft_consensus.cc:3055] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.295003  8359 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.295251  8284 raft_consensus.cc:740] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:06.296106  8284 consensus_queue.cc:260] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.297222  8284 raft_consensus.cc:3060] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.301328  8359 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 4.
I20260709 13:15:06.302675  8397 leader_election.cc:304] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:06.302977  8284 raft_consensus.cc:2468] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 4.
I20260709 13:15:06.303452  8611 raft_consensus.cc:2804] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:06.304960  8611 raft_consensus.cc:697] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 4 LEADER]: Becoming Leader. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:15:06.305804  8611 consensus_queue.cc:237] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.313606  8179 catalog_manager.cc:5697] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 reported cstate change: term changed from 3 to 4, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to d9cd7125082b4d228f8545585f5342b1 (127.7.122.67). New cstate: current_term: 4 leader_uuid: "d9cd7125082b4d228f8545585f5342b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.334489  8615 raft_consensus.cc:993] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:15:06.335023  8615 raft_consensus.cc:1081] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Signalling peer 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:15:06.336791  8359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:15:06.337532  8359 raft_consensus.cc:493] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.337977  8359 raft_consensus.cc:3060] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.344169  8359 raft_consensus.cc:515] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.346117  8359 leader_election.cc:290] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:06.347199  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:15:06.347630  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0dfa246db944d7848d1916d949acc1" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:06.347886  8284 raft_consensus.cc:3055] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:06.348197  8431 raft_consensus.cc:3060] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.348237  8284 raft_consensus.cc:740] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:06.349448  8284 consensus_queue.cc:260] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.350822  8284 raft_consensus.cc:3060] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:06.356762  8431 raft_consensus.cc:2468] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:15:06.358465  8324 leader_election.cc:304] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:06.358476  8284 raft_consensus.cc:2468] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 2.
I20260709 13:15:06.359508  8584 raft_consensus.cc:2804] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:06.361091  8584 raft_consensus.cc:697] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:15:06.361923  8584 consensus_queue.cc:237] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.379192  8179 catalog_manager.cc:5697] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 1 to 2, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.607347  8614 raft_consensus.cc:993] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:15:06.607860  8615 raft_consensus.cc:1081] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Signalling peer 5235dec0eb314d1688c7e2161443ff70 to start an election
I20260709 13:15:06.609565  8359 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4"
dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
 from {username='slave'} at 127.0.0.1:36958
I20260709 13:15:06.610010  8359 raft_consensus.cc:493] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.610253  8359 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.614544  8359 raft_consensus.cc:515] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.615994  8359 leader_election.cc:290] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 3 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), d9cd7125082b4d228f8545585f5342b1 (127.7.122.67:34009)
I20260709 13:15:06.617111  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:15:06.617386  8431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7db7cd20495149528c4a919b5d85efc4" candidate_uuid: "5235dec0eb314d1688c7e2161443ff70" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
I20260709 13:15:06.617626  8284 raft_consensus.cc:3055] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:06.617954  8431 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.617959  8284 raft_consensus.cc:740] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:06.619128  8284 consensus_queue.cc:260] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.620198  8284 raft_consensus.cc:3060] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:06.624372  8431 raft_consensus.cc:2468] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 3.
I20260709 13:15:06.626111  8324 leader_election.cc:304] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:06.626551  8284 raft_consensus.cc:2468] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5235dec0eb314d1688c7e2161443ff70 in term 3.
I20260709 13:15:06.627167  8584 raft_consensus.cc:2804] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:06.627823  8584 raft_consensus.cc:697] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 3 LEADER]: Becoming Leader. State: Replica: 5235dec0eb314d1688c7e2161443ff70, State: Running, Role: LEADER
I20260709 13:15:06.629204  8584 consensus_queue.cc:237] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.637028  8179 catalog_manager.cc:5697] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 reported cstate change: term changed from 2 to 3, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "5235dec0eb314d1688c7e2161443ff70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:06.693789  8614 raft_consensus.cc:993] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: : Instructing follower d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:06.694501  8615 raft_consensus.cc:1081] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Signalling peer d9cd7125082b4d228f8545585f5342b1 to start an election
I20260709 13:15:06.697109  8431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d"
dest_uuid: "d9cd7125082b4d228f8545585f5342b1"
 from {username='slave'} at 127.0.0.1:46176
I20260709 13:15:06.697698  8431 raft_consensus.cc:493] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:06.698184  8431 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.703280  8431 raft_consensus.cc:515] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.705117  8431 leader_election.cc:290] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 4 election: Requested vote from peers b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881), 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603)
I20260709 13:15:06.706115  8284 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b83afb25703c427cb58d3ca95cdd2d20"
I20260709 13:15:06.706243  8359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e7da4b61f0f40ea8ca7f446bbd15f3d" candidate_uuid: "d9cd7125082b4d228f8545585f5342b1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5235dec0eb314d1688c7e2161443ff70"
I20260709 13:15:06.706696  8284 raft_consensus.cc:3055] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:06.706823  8359 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.707024  8284 raft_consensus.cc:740] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b83afb25703c427cb58d3ca95cdd2d20, State: Running, Role: LEADER
I20260709 13:15:06.707787  8284 consensus_queue.cc:260] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.708720  8284 raft_consensus.cc:3060] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:06.711541  8359 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 4.
I20260709 13:15:06.712702  8397 leader_election.cc:304] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5235dec0eb314d1688c7e2161443ff70, d9cd7125082b4d228f8545585f5342b1; no voters: 
I20260709 13:15:06.713555  8611 raft_consensus.cc:2804] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:06.714008  8611 raft_consensus.cc:697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 4 LEADER]: Becoming Leader. State: Replica: d9cd7125082b4d228f8545585f5342b1, State: Running, Role: LEADER
I20260709 13:15:06.714252  8284 raft_consensus.cc:2468] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9cd7125082b4d228f8545585f5342b1 in term 4.
I20260709 13:15:06.714865  8611 consensus_queue.cc:237] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } }
I20260709 13:15:06.723248  8179 catalog_manager.cc:5697] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 reported cstate change: term changed from 3 to 4, leader changed from b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65) to d9cd7125082b4d228f8545585f5342b1 (127.7.122.67). New cstate: current_term: 4 leader_uuid: "d9cd7125082b4d228f8545585f5342b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:06.816642  8284 raft_consensus.cc:1275] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.817899  8611 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.832827  8359 raft_consensus.cc:1275] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:06.834631  8616 consensus_queue.cc:1048] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:06.842737  8431 raft_consensus.cc:1275] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:06.844059  8584 consensus_queue.cc:1048] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:06.855971  8284 raft_consensus.cc:1275] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:06.858127  8584 consensus_queue.cc:1048] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:07.116513  8284 raft_consensus.cc:1275] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:07.117997  8616 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b83afb25703c427cb58d3ca95cdd2d20" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 36881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:07.125784  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:07.128654  8359 raft_consensus.cc:1275] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Refusing update from remote peer d9cd7125082b4d228f8545585f5342b1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:07.130484  8611 consensus_queue.cc:1048] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5235dec0eb314d1688c7e2161443ff70" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 39603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:07.139551  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
W20260709 13:15:07.157796  8324 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 13:15:07.164111  8324 consensus_peers.cc:597] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 -> Peer b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881): Couldn't send request to peer b83afb25703c427cb58d3ca95cdd2d20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:07.184582  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:07.185572  7657 tablet_replica.cc:333] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.186357  7657 raft_consensus.cc:2243] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.187023  7657 raft_consensus.cc:2272] T a9eb55db01fa46fca0fef800343bb6df P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.189211  7657 tablet_replica.cc:333] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.189786  7657 raft_consensus.cc:2243] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.190688  7657 raft_consensus.cc:2272] T e96e357931c940e4a1a63080d6913a10 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.192818  7657 tablet_replica.cc:333] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.193365  7657 raft_consensus.cc:2243] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.193832  7657 raft_consensus.cc:2272] T 758529d6fb8646a5836f5b2c67aab305 P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.197362  7657 tablet_replica.cc:333] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.198269  7657 raft_consensus.cc:2243] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.198800  7657 raft_consensus.cc:2272] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P b83afb25703c427cb58d3ca95cdd2d20 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.201256  7657 tablet_replica.cc:333] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.201821  7657 raft_consensus.cc:2243] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.202229  7657 raft_consensus.cc:2272] T 7db7cd20495149528c4a919b5d85efc4 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.203939  7657 tablet_replica.cc:333] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.204456  7657 raft_consensus.cc:2243] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.204977  7657 raft_consensus.cc:2272] T 378f26ce98eb48f5aa696d33f74af6ac P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.206732  7657 tablet_replica.cc:333] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.207501  7657 raft_consensus.cc:2243] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.208637  7657 raft_consensus.cc:2272] T 22d818391bec461f9fad4c0623eb8449 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.210776  7657 tablet_replica.cc:333] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.211462  7657 raft_consensus.cc:2243] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.211967  7657 raft_consensus.cc:2272] T 3a0dfa246db944d7848d1916d949acc1 P b83afb25703c427cb58d3ca95cdd2d20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.214370  7657 tablet_replica.cc:333] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.214903  7657 raft_consensus.cc:2243] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.215713  7657 raft_consensus.cc:2272] T 72aa2532c218495996f5b42375a7a955 P b83afb25703c427cb58d3ca95cdd2d20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.217621  7657 tablet_replica.cc:333] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20: stopping tablet replica
I20260709 13:15:07.218111  7657 raft_consensus.cc:2243] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.218807  7657 raft_consensus.cc:2272] T 496ba00f41074061bac2a02b2c3dc254 P b83afb25703c427cb58d3ca95cdd2d20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.229192  8431 raft_consensus.cc:1275] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Refusing update from remote peer 5235dec0eb314d1688c7e2161443ff70: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:07.231226  8633 consensus_queue.cc:1048] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d9cd7125082b4d228f8545585f5342b1" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:07.248106  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
W20260709 13:15:07.258630  8398 consensus_peers.cc:597] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 -> Peer b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881): Couldn't send request to peer b83afb25703c427cb58d3ca95cdd2d20. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:36881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:07.272285  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
W20260709 13:15:07.314137  8398 consensus_peers.cc:597] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 -> Peer b83afb25703c427cb58d3ca95cdd2d20 (127.7.122.65:36881): Couldn't send request to peer b83afb25703c427cb58d3ca95cdd2d20. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:36881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:07.314379  8397 consensus_peers.cc:597] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 -> Peer 5235dec0eb314d1688c7e2161443ff70 (127.7.122.66:39603): Couldn't send request to peer 5235dec0eb314d1688c7e2161443ff70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:07.315382  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:07.316112  7657 tablet_replica.cc:333] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.316812  7657 raft_consensus.cc:2243] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.317421  7657 raft_consensus.cc:2272] T a9eb55db01fa46fca0fef800343bb6df P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.319393  7657 tablet_replica.cc:333] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.320019  7657 raft_consensus.cc:2243] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.320952  7657 raft_consensus.cc:2272] T 378f26ce98eb48f5aa696d33f74af6ac P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.322803  7657 tablet_replica.cc:333] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.323457  7657 raft_consensus.cc:2243] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.324249  7657 raft_consensus.cc:2272] T 3a0dfa246db944d7848d1916d949acc1 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.326452  7657 tablet_replica.cc:333] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.327113  7657 raft_consensus.cc:2243] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.327968  7657 raft_consensus.cc:2272] T 7db7cd20495149528c4a919b5d85efc4 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.331113  7657 tablet_replica.cc:333] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.331785  7657 raft_consensus.cc:2243] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.332304  7657 raft_consensus.cc:2272] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.334769  7657 tablet_replica.cc:333] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.335304  7657 raft_consensus.cc:2243] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.335726  7657 raft_consensus.cc:2272] T 72aa2532c218495996f5b42375a7a955 P 5235dec0eb314d1688c7e2161443ff70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.337805  7657 tablet_replica.cc:333] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.338336  7657 raft_consensus.cc:2243] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.338740  7657 raft_consensus.cc:2272] T 758529d6fb8646a5836f5b2c67aab305 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.341445  7657 tablet_replica.cc:333] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.342011  7657 raft_consensus.cc:2243] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.342417  7657 raft_consensus.cc:2272] T 496ba00f41074061bac2a02b2c3dc254 P 5235dec0eb314d1688c7e2161443ff70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.344107  7657 tablet_replica.cc:333] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.344573  7657 raft_consensus.cc:2243] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.345060  7657 raft_consensus.cc:2272] T 22d818391bec461f9fad4c0623eb8449 P 5235dec0eb314d1688c7e2161443ff70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.346982  7657 tablet_replica.cc:333] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70: stopping tablet replica
I20260709 13:15:07.347424  7657 raft_consensus.cc:2243] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.347805  7657 raft_consensus.cc:2272] T e96e357931c940e4a1a63080d6913a10 P 5235dec0eb314d1688c7e2161443ff70 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.379822  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
I20260709 13:15:07.404836  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
I20260709 13:15:07.438119  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:07.438967  7657 tablet_replica.cc:333] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.439639  7657 raft_consensus.cc:2243] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.440704  7657 raft_consensus.cc:2272] T a9eb55db01fa46fca0fef800343bb6df P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.442792  7657 tablet_replica.cc:333] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.443369  7657 raft_consensus.cc:2243] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.443871  7657 raft_consensus.cc:2272] T 378f26ce98eb48f5aa696d33f74af6ac P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.445895  7657 tablet_replica.cc:333] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.446552  7657 raft_consensus.cc:2243] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.447027  7657 raft_consensus.cc:2272] T 7db7cd20495149528c4a919b5d85efc4 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.449631  7657 tablet_replica.cc:333] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.450239  7657 raft_consensus.cc:2243] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.451095  7657 raft_consensus.cc:2272] T 758529d6fb8646a5836f5b2c67aab305 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.453743  7657 tablet_replica.cc:333] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.454708  7657 raft_consensus.cc:2243] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.455644  7657 raft_consensus.cc:2272] T 4e7da4b61f0f40ea8ca7f446bbd15f3d P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.457885  7657 tablet_replica.cc:333] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.458482  7657 raft_consensus.cc:2243] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.458943  7657 raft_consensus.cc:2272] T 72aa2532c218495996f5b42375a7a955 P d9cd7125082b4d228f8545585f5342b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.460698  7657 tablet_replica.cc:333] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.461236  7657 raft_consensus.cc:2243] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.461764  7657 raft_consensus.cc:2272] T 3a0dfa246db944d7848d1916d949acc1 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.463824  7657 tablet_replica.cc:333] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.464458  7657 raft_consensus.cc:2243] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.464956  7657 raft_consensus.cc:2272] T 22d818391bec461f9fad4c0623eb8449 P d9cd7125082b4d228f8545585f5342b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.466701  7657 tablet_replica.cc:333] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.467133  7657 raft_consensus.cc:2243] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.467634  7657 raft_consensus.cc:2272] T e96e357931c940e4a1a63080d6913a10 P d9cd7125082b4d228f8545585f5342b1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.469631  7657 tablet_replica.cc:333] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1: stopping tablet replica
I20260709 13:15:07.470041  7657 raft_consensus.cc:2243] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:07.470443  7657 raft_consensus.cc:2272] T 496ba00f41074061bac2a02b2c3dc254 P d9cd7125082b4d228f8545585f5342b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.503687  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
I20260709 13:15:07.527930  7657 master.cc:562] Master@127.7.122.126:43391 shutting down...
I20260709 13:15:07.556171  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:07.556766  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:07.557178  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P a43d8e6eb7974c2ebd47e994a43bca86: stopping tablet replica
I20260709 13:15:07.578732  7657 master.cc:584] Master@127.7.122.126:43391 shutdown complete.
5235dec0eb314d1688c7e2161443ff70  4
b83afb25703c427cb58d3ca95cdd2d20  5
d9cd7125082b4d228f8545585f5342b1  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10882 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:07.624620  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:41961
I20260709 13:15:07.625931  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.634966  8643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.634989  8642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.635471  7657 server_base.cc:1061] running on GCE node
W20260709 13:15:07.634989  8645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.636940  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:07.637169  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.637487  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602907637271 us; error 0 us; skew 500 ppm
I20260709 13:15:07.638391  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.641642  7657 webserver.cc:533] Webserver started at http://127.7.122.126:36671/ using document root <none> and password file <none>
I20260709 13:15:07.642220  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.642396  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.643190  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.645139  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-078m"
I20260709 13:15:07.652710  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:15:07.658670  8650 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.659781  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:15:07.660115  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-078m"
I20260709 13:15:07.660391  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:07.694723  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:07.696038  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:07.745486  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:41961
I20260709 13:15:07.745612  8701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:41961 every 8 connection(s)
I20260709 13:15:07.750031  8702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:07.760251  8702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Bootstrap starting.
I20260709 13:15:07.765277  8702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:07.769785  8702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: No bootstrap required, opened a new log
I20260709 13:15:07.772061  8702 raft_consensus.cc:359] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" member_type: VOTER }
I20260709 13:15:07.772462  8702 raft_consensus.cc:385] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:07.772722  8702 raft_consensus.cc:740] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea3bb54fdd140bfadbad5c24f3a0fa7, State: Initialized, Role: FOLLOWER
I20260709 13:15:07.773336  8702 consensus_queue.cc:260] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" member_type: VOTER }
I20260709 13:15:07.773802  8702 raft_consensus.cc:399] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:07.774022  8702 raft_consensus.cc:493] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:07.774327  8702 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:07.778771  8702 raft_consensus.cc:515] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" member_type: VOTER }
I20260709 13:15:07.779346  8702 leader_election.cc:304] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bea3bb54fdd140bfadbad5c24f3a0fa7; no voters: 
I20260709 13:15:07.780521  8702 leader_election.cc:290] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:07.780871  8705 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:07.782414  8705 raft_consensus.cc:697] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 1 LEADER]: Becoming Leader. State: Replica: bea3bb54fdd140bfadbad5c24f3a0fa7, State: Running, Role: LEADER
I20260709 13:15:07.783218  8705 consensus_queue.cc:237] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" member_type: VOTER }
I20260709 13:15:07.783818  8702 sys_catalog.cc:565] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:07.788980  8707 sys_catalog.cc:455] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bea3bb54fdd140bfadbad5c24f3a0fa7. Latest consensus state: current_term: 1 leader_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" member_type: VOTER } }
I20260709 13:15:07.788918  8706 sys_catalog.cc:455] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bea3bb54fdd140bfadbad5c24f3a0fa7" member_type: VOTER } }
I20260709 13:15:07.789803  8707 sys_catalog.cc:458] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:07.789841  8706 sys_catalog.cc:458] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:07.792049  8713 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:07.800078  8713 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:07.801131  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:07.809047  8713 catalog_manager.cc:1383] Generated new cluster ID: cf4fe03a1cfa459f848773b33d9725cc
I20260709 13:15:07.809348  8713 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:07.833441  8713 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:07.834918  8713 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:07.849537  8713 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Generated new TSK 0
I20260709 13:15:07.850176  8713 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:07.868268  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.874681  8723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.876053  8724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.877226  7657 server_base.cc:1061] running on GCE node
W20260709 13:15:07.877190  8726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.878374  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:07.878559  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.878679  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602907878668 us; error 0 us; skew 500 ppm
I20260709 13:15:07.879145  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.881732  7657 webserver.cc:533] Webserver started at http://127.7.122.65:45451/ using document root <none> and password file <none>
I20260709 13:15:07.882194  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.882346  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.882563  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.883718  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-078m"
I20260709 13:15:07.888712  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:07.892391  8731 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.893430  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:15:07.893882  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-078m"
I20260709 13:15:07.894218  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:07.917858  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:07.919162  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:07.920733  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:07.923277  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:07.923519  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.923774  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:07.923964  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:07.969291  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:33017
I20260709 13:15:07.969398  8793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:33017 every 8 connection(s)
I20260709 13:15:07.974756  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:07.983560  8799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.984635  8798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:07.986771  8801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:07.989307  7657 server_base.cc:1061] running on GCE node
I20260709 13:15:07.990247  8794 heartbeater.cc:344] Connected to a master server at 127.7.122.126:41961
I20260709 13:15:07.990674  8794 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:07.990785  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:07.991073  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:07.991269  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602907991249 us; error 0 us; skew 500 ppm
I20260709 13:15:07.991638  8794 heartbeater.cc:507] Master 127.7.122.126:41961 requested a full tablet report, sending...
I20260709 13:15:07.992116  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:07.994247  8667 ts_manager.cc:194] Registered new tserver with Master: 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:07.995252  7657 webserver.cc:533] Webserver started at http://127.7.122.66:34207/ using document root <none> and password file <none>
I20260709 13:15:07.995924  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:07.996174  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:07.996490  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:07.996779  8667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40530
I20260709 13:15:07.998126  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "773340b2958e4af5b2010b902b9e9c04"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-078m"
I20260709 13:15:08.004161  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:15:08.008925  8806 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:08.009913  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:15:08.010265  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "773340b2958e4af5b2010b902b9e9c04"
format_stamp: "Formatted at 2026-07-09 13:15:07 on dist-test-slave-078m"
I20260709 13:15:08.010540  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:08.029793  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:08.031142  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:08.032943  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:08.035697  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:08.035983  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:08.036499  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:08.036692  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:08.083477  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:32843
I20260709 13:15:08.083600  8868 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:32843 every 8 connection(s)
I20260709 13:15:08.088492  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:08.097730  8872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:08.097976  8873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:08.100318  8875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:08.102921  7657 server_base.cc:1061] running on GCE node
I20260709 13:15:08.104094  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:08.104354  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:08.104552  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602908104531 us; error 0 us; skew 500 ppm
I20260709 13:15:08.105408  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:08.106948  8869 heartbeater.cc:344] Connected to a master server at 127.7.122.126:41961
I20260709 13:15:08.107410  8869 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:08.108361  8869 heartbeater.cc:507] Master 127.7.122.126:41961 requested a full tablet report, sending...
I20260709 13:15:08.108920  7657 webserver.cc:533] Webserver started at http://127.7.122.67:33355/ using document root <none> and password file <none>
I20260709 13:15:08.109602  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:08.109849  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:08.110177  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:08.111177  8667 ts_manager.cc:194] Registered new tserver with Master: 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:08.111822  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "bdb96be202c2447586477b2077b7d5bf"
format_stamp: "Formatted at 2026-07-09 13:15:08 on dist-test-slave-078m"
I20260709 13:15:08.113140  8667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40536
I20260709 13:15:08.117780  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:08.121657  8880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:08.122870  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:15:08.123193  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "bdb96be202c2447586477b2077b7d5bf"
format_stamp: "Formatted at 2026-07-09 13:15:08 on dist-test-slave-078m"
I20260709 13:15:08.123567  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:08.147662  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:08.148990  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:08.150548  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:08.153040  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:08.153291  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:08.153551  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:08.153750  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:08.198240  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:39883
I20260709 13:15:08.198333  8942 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:39883 every 8 connection(s)
I20260709 13:15:08.213518  8943 heartbeater.cc:344] Connected to a master server at 127.7.122.126:41961
I20260709 13:15:08.213943  8943 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:08.214793  8943 heartbeater.cc:507] Master 127.7.122.126:41961 requested a full tablet report, sending...
I20260709 13:15:08.216789  8667 ts_manager.cc:194] Registered new tserver with Master: bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:08.217610  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016112151s
I20260709 13:15:08.218202  8667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40540
I20260709 13:15:08.246148  8667 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40552:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:08.253005  8667 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:08.470883  8758 tablet_service.cc:1511] Processing CreateTablet for tablet 022d4a4680cb42e4bc9970d8a4f604f1 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:08.471431  8757 tablet_service.cc:1511] Processing CreateTablet for tablet d1d69638bb504813949178c6aee64727 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:08.472466  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022d4a4680cb42e4bc9970d8a4f604f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.473706  8756 tablet_service.cc:1511] Processing CreateTablet for tablet bccdb4728c764cc0a333f593ab71c511 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:08.475097  8759 tablet_service.cc:1511] Processing CreateTablet for tablet e3a106d574bc4cfeaa6e7b1240430c4b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:08.475118  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccdb4728c764cc0a333f593ab71c511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.479858  8834 tablet_service.cc:1511] Processing CreateTablet for tablet e3a106d574bc4cfeaa6e7b1240430c4b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:08.481369  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106d574bc4cfeaa6e7b1240430c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.481891  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106d574bc4cfeaa6e7b1240430c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.481537  8753 tablet_service.cc:1511] Processing CreateTablet for tablet 860647fd65b141d8842fde1bd4f9a549 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:08.482973  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860647fd65b141d8842fde1bd4f9a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.479885  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 002c4018f5264a23a9d3f93713b6fffe (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:08.486366  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c4018f5264a23a9d3f93713b6fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.491446  8752 tablet_service.cc:1511] Processing CreateTablet for tablet aa48bba2a08c4fcdae35a029b7107f70 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:08.491639  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 022d4a4680cb42e4bc9970d8a4f604f1 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:08.493003  8832 tablet_service.cc:1511] Processing CreateTablet for tablet d1d69638bb504813949178c6aee64727 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:08.478749  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 2c71888f7c2e471db00d7e83cf31ebf3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:08.494140  8751 tablet_service.cc:1511] Processing CreateTablet for tablet 430f59d9e22342829896b185b2da7cf3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:08.494886  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022d4a4680cb42e4bc9970d8a4f604f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.496819  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 4128699de59a470a9275f001cbd35515 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:08.497349  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d69638bb504813949178c6aee64727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.496846  8831 tablet_service.cc:1511] Processing CreateTablet for tablet bccdb4728c764cc0a333f593ab71c511 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:08.499817  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccdb4728c764cc0a333f593ab71c511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.501204  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d69638bb504813949178c6aee64727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.505251  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c71888f7c2e471db00d7e83cf31ebf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.506194  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430f59d9e22342829896b185b2da7cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.508574  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa48bba2a08c4fcdae35a029b7107f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.509940  8830 tablet_service.cc:1511] Processing CreateTablet for tablet 2c71888f7c2e471db00d7e83cf31ebf3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:08.511385  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c71888f7c2e471db00d7e83cf31ebf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.512953  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4128699de59a470a9275f001cbd35515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.550421  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 002c4018f5264a23a9d3f93713b6fffe (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:08.551839  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c4018f5264a23a9d3f93713b6fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.551501  8829 tablet_service.cc:1511] Processing CreateTablet for tablet 860647fd65b141d8842fde1bd4f9a549 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:08.552832  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860647fd65b141d8842fde1bd4f9a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.558804  8828 tablet_service.cc:1511] Processing CreateTablet for tablet aa48bba2a08c4fcdae35a029b7107f70 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:08.568392  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 430f59d9e22342829896b185b2da7cf3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:08.569908  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa48bba2a08c4fcdae35a029b7107f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.579973  8900 tablet_service.cc:1511] Processing CreateTablet for tablet 430f59d9e22342829896b185b2da7cf3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:08.580111  8904 tablet_service.cc:1511] Processing CreateTablet for tablet 2c71888f7c2e471db00d7e83cf31ebf3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:08.581406  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430f59d9e22342829896b185b2da7cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.582093  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 002c4018f5264a23a9d3f93713b6fffe (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:08.584295  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 860647fd65b141d8842fde1bd4f9a549 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:08.586104  8907 tablet_service.cc:1511] Processing CreateTablet for tablet 022d4a4680cb42e4bc9970d8a4f604f1 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:08.586609  8756 tablet_service.cc:1511] Processing CreateTablet for tablet b3f50214a4c94ba0b85876c02e10b9ac (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:08.586469  8901 tablet_service.cc:1511] Processing CreateTablet for tablet aa48bba2a08c4fcdae35a029b7107f70 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:08.587888  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f50214a4c94ba0b85876c02e10b9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.588245  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c4018f5264a23a9d3f93713b6fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.588613  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 4128699de59a470a9275f001cbd35515 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:08.589962  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4128699de59a470a9275f001cbd35515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.593642  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860647fd65b141d8842fde1bd4f9a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.595358  8750 tablet_service.cc:1511] Processing CreateTablet for tablet ef624fe5958542fa8714cedf17ca4940 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:08.573734  8958 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:08.575696  8906 tablet_service.cc:1511] Processing CreateTablet for tablet d1d69638bb504813949178c6aee64727 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:08.577534  8908 tablet_service.cc:1511] Processing CreateTablet for tablet e3a106d574bc4cfeaa6e7b1240430c4b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:08.577445  8905 tablet_service.cc:1511] Processing CreateTablet for tablet bccdb4728c764cc0a333f593ab71c511 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:08.597592  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022d4a4680cb42e4bc9970d8a4f604f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.601950  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106d574bc4cfeaa6e7b1240430c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.602670  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa48bba2a08c4fcdae35a029b7107f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.602520  8757 tablet_service.cc:1511] Processing CreateTablet for tablet c79353780ac54a25bd9999800873bbeb (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:08.603773  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccdb4728c764cc0a333f593ab71c511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.604653  8827 tablet_service.cc:1511] Processing CreateTablet for tablet 4128699de59a470a9275f001cbd35515 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:08.589221  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430f59d9e22342829896b185b2da7cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.607177  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c71888f7c2e471db00d7e83cf31ebf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.610586  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d69638bb504813949178c6aee64727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.611044  8959 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:08.613257  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4128699de59a470a9275f001cbd35515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.625279  8752 tablet_service.cc:1511] Processing CreateTablet for tablet a85c28eb5f2e4741b40ca8723a62f870 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:08.638446  8832 tablet_service.cc:1511] Processing CreateTablet for tablet b3f50214a4c94ba0b85876c02e10b9ac (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:08.639801  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f50214a4c94ba0b85876c02e10b9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.643438  8826 tablet_service.cc:1511] Processing CreateTablet for tablet c79353780ac54a25bd9999800873bbeb (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:08.646186  8825 tablet_service.cc:1511] Processing CreateTablet for tablet a85c28eb5f2e4741b40ca8723a62f870 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:08.646099  8833 tablet_service.cc:1511] Processing CreateTablet for tablet ef624fe5958542fa8714cedf17ca4940 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:08.621222  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79353780ac54a25bd9999800873bbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.648073  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79353780ac54a25bd9999800873bbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.657388  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85c28eb5f2e4741b40ca8723a62f870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.659307  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef624fe5958542fa8714cedf17ca4940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.660303  8830 tablet_service.cc:1511] Processing CreateTablet for tablet 49a7db9f466c48ccb2c5c350cb6351b3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:08.662278  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a7db9f466c48ccb2c5c350cb6351b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.665032  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85c28eb5f2e4741b40ca8723a62f870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.666821  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef624fe5958542fa8714cedf17ca4940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.666668  8834 tablet_service.cc:1511] Processing CreateTablet for tablet f045ce88a76f4620ad6c717c8245982a (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:08.668633  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045ce88a76f4620ad6c717c8245982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.689451  8958 tablet_bootstrap.cc:654] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.671928  8758 tablet_service.cc:1511] Processing CreateTablet for tablet 49a7db9f466c48ccb2c5c350cb6351b3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:08.693780  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a7db9f466c48ccb2c5c350cb6351b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.694203  8960 tablet_bootstrap.cc:492] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:08.679407  8751 tablet_service.cc:1511] Processing CreateTablet for tablet f045ce88a76f4620ad6c717c8245982a (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:08.697729  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045ce88a76f4620ad6c717c8245982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.698653  8899 tablet_service.cc:1511] Processing CreateTablet for tablet b3f50214a4c94ba0b85876c02e10b9ac (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:08.718840  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3f50214a4c94ba0b85876c02e10b9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.682798  8828 tablet_service.cc:1511] Processing CreateTablet for tablet 5380dc645e984447aefd4408bca2f2af (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:08.724048  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380dc645e984447aefd4408bca2f2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.759864  8959 tablet_bootstrap.cc:654] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.759584  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 5380dc645e984447aefd4408bca2f2af (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:08.768405  8829 tablet_service.cc:1511] Processing CreateTablet for tablet e3373a354d754ec48ac0cc05829af66f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:08.789501  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380dc645e984447aefd4408bca2f2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.772375  8756 tablet_service.cc:1511] Processing CreateTablet for tablet c65b41257e7e4b66b28805964b4e7d16 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:08.797526  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b41257e7e4b66b28805964b4e7d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.799368  8960 tablet_bootstrap.cc:654] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:08.760533  8827 tablet_service.cc:1511] Processing CreateTablet for tablet c4b840458e6048cd9c4444bf516cf39a (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:08.792402  8831 tablet_service.cc:1511] Processing CreateTablet for tablet c65b41257e7e4b66b28805964b4e7d16 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
W20260709 13:15:08.803377  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:08.809094  8907 tablet_service.cc:1511] Processing CreateTablet for tablet a85c28eb5f2e4741b40ca8723a62f870 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:08.810933  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85c28eb5f2e4741b40ca8723a62f870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.813462  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3373a354d754ec48ac0cc05829af66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.814131  8900 tablet_service.cc:1511] Processing CreateTablet for tablet ef624fe5958542fa8714cedf17ca4940 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:08.815819  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef624fe5958542fa8714cedf17ca4940. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.820245  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b41257e7e4b66b28805964b4e7d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.825917  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b840458e6048cd9c4444bf516cf39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.835201  8826 tablet_service.cc:1511] Processing CreateTablet for tablet bac07da6a99849fb8f972372c187ee7b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:08.836525  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac07da6a99849fb8f972372c187ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.838017  8902 tablet_service.cc:1511] Processing CreateTablet for tablet c79353780ac54a25bd9999800873bbeb (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:08.839349  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79353780ac54a25bd9999800873bbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.850018  8752 tablet_service.cc:1511] Processing CreateTablet for tablet c4b840458e6048cd9c4444bf516cf39a (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:08.854666  8903 tablet_service.cc:1511] Processing CreateTablet for tablet c4b840458e6048cd9c4444bf516cf39a (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:08.855996  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b840458e6048cd9c4444bf516cf39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.860343  8754 tablet_service.cc:1511] Processing CreateTablet for tablet e3373a354d754ec48ac0cc05829af66f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:08.861160  8908 tablet_service.cc:1511] Processing CreateTablet for tablet f045ce88a76f4620ad6c717c8245982a (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:08.863507  8958 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:08.876436  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 7689b80937134444a5933a16f9aa7d64 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:08.877784  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4b840458e6048cd9c4444bf516cf39a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.878422  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3373a354d754ec48ac0cc05829af66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.879853  8753 tablet_service.cc:1511] Processing CreateTablet for tablet bac07da6a99849fb8f972372c187ee7b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:08.881022  8958 ts_tablet_manager.cc:1403] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.308s	user 0.009s	sys 0.009s
I20260709 13:15:08.867120  8756 tablet_service.cc:1511] Processing CreateTablet for tablet a034d186214a4f03b519e7c03f58788f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:08.874773  8751 tablet_service.cc:1511] Processing CreateTablet for tablet ba1bacaaff25445c9eccef8932f745d1 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:08.852385  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 49a7db9f466c48ccb2c5c350cb6351b3 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:08.884438  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 5380dc645e984447aefd4408bca2f2af (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:08.881992  8759 tablet_service.cc:1511] Processing CreateTablet for tablet da988855757643ccbb2593bad676d78d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:08.886933  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045ce88a76f4620ad6c717c8245982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.898857  8830 tablet_service.cc:1511] Processing CreateTablet for tablet a034d186214a4f03b519e7c03f58788f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:08.900220  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a034d186214a4f03b519e7c03f58788f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.900622  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a7db9f466c48ccb2c5c350cb6351b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.884193  8958 raft_consensus.cc:359] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:08.889868  8757 tablet_service.cc:1511] Processing CreateTablet for tablet fb4847af9abd4172bff3a603da47325c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:08.889868  8904 tablet_service.cc:1511] Processing CreateTablet for tablet c65b41257e7e4b66b28805964b4e7d16 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:08.901863  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7689b80937134444a5933a16f9aa7d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.912432  8832 tablet_service.cc:1511] Processing CreateTablet for tablet af46285a3b87458b8b247dc8610ab80b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:08.913331  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac07da6a99849fb8f972372c187ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.902310  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380dc645e984447aefd4408bca2f2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.914186  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af46285a3b87458b8b247dc8610ab80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.909723  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 7689b80937134444a5933a16f9aa7d64 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:08.901122  8958 raft_consensus.cc:385] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.916445  8958 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.914700  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a034d186214a4f03b519e7c03f58788f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.917451  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da988855757643ccbb2593bad676d78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.917276  8958 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:08.918064  8901 tablet_service.cc:1511] Processing CreateTablet for tablet e3373a354d754ec48ac0cc05829af66f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:08.918825  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4847af9abd4172bff3a603da47325c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.920889  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1bacaaff25445c9eccef8932f745d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.921700  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7689b80937134444a5933a16f9aa7d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.924176  8960 tablet_bootstrap.cc:492] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:08.924659  8960 ts_tablet_manager.cc:1403] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.231s	user 0.008s	sys 0.014s
I20260709 13:15:08.905769  8827 tablet_service.cc:1511] Processing CreateTablet for tablet ba1bacaaff25445c9eccef8932f745d1 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:08.915869  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b41257e7e4b66b28805964b4e7d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.937798  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1bacaaff25445c9eccef8932f745d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.939092  8960 raft_consensus.cc:359] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:08.939982  8960 raft_consensus.cc:385] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.941268  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3373a354d754ec48ac0cc05829af66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.945585  8959 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:08.946110  8959 ts_tablet_manager.cc:1403] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.335s	user 0.019s	sys 0.014s
I20260709 13:15:08.947685  8826 tablet_service.cc:1511] Processing CreateTablet for tablet da988855757643ccbb2593bad676d78d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:08.948212  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 2a15a66fec474b05b1f3ad99f61f1104 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:08.949091  8959 raft_consensus.cc:359] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:08.949838  8959 raft_consensus.cc:385] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:08.949883  8869 heartbeater.cc:499] Master 127.7.122.126:41961 was elected leader, sending a full tablet report...
I20260709 13:15:08.950243  8959 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.960186  8828 tablet_service.cc:1511] Processing CreateTablet for tablet 2a15a66fec474b05b1f3ad99f61f1104 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:08.961159  8959 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:08.962792  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 2c10a9719c7f4cf5a813c2dc4c5e3739 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:08.964567  8907 tablet_service.cc:1511] Processing CreateTablet for tablet a034d186214a4f03b519e7c03f58788f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:08.940371  8960 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:08.972360  8754 tablet_service.cc:1511] Processing CreateTablet for tablet af46285a3b87458b8b247dc8610ab80b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:08.983187  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da988855757643ccbb2593bad676d78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.952258  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 102be8dba78c4bc998ed8bf52775bec5 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:08.987783  8958 ts_tablet_manager.cc:1434] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.006s
I20260709 13:15:08.988919  8958 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:08.987311  8960 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:08.995194  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af46285a3b87458b8b247dc8610ab80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.001116  8794 heartbeater.cc:499] Master 127.7.122.126:41961 was elected leader, sending a full tablet report...
I20260709 13:15:09.001398  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c10a9719c7f4cf5a813c2dc4c5e3739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:08.990167  8752 tablet_service.cc:1511] Processing CreateTablet for tablet 2c10a9719c7f4cf5a813c2dc4c5e3739 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:08.972360  8829 tablet_service.cc:1511] Processing CreateTablet for tablet 51c7e309721f4da1bcd1626da407d364 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:09.015901  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a15a66fec474b05b1f3ad99f61f1104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.011389  8834 tablet_service.cc:1511] Processing CreateTablet for tablet fb4847af9abd4172bff3a603da47325c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:09.021839  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a034d186214a4f03b519e7c03f58788f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.019168  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102be8dba78c4bc998ed8bf52775bec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.035473  8960 ts_tablet_manager.cc:1434] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.110s	user 0.015s	sys 0.002s
I20260709 13:15:09.036407  8943 heartbeater.cc:499] Master 127.7.122.126:41961 was elected leader, sending a full tablet report...
I20260709 13:15:09.037271  8959 ts_tablet_manager.cc:1434] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.005s
I20260709 13:15:09.052160  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 7689b80937134444a5933a16f9aa7d64 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:09.055848  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7689b80937134444a5933a16f9aa7d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.066303  8900 tablet_service.cc:1511] Processing CreateTablet for tablet bac07da6a99849fb8f972372c187ee7b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:09.075120  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac07da6a99849fb8f972372c187ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.075387  8906 tablet_service.cc:1511] Processing CreateTablet for tablet ba1bacaaff25445c9eccef8932f745d1 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:09.076762  8960 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:09.076826  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1bacaaff25445c9eccef8932f745d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.081040  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a15a66fec474b05b1f3ad99f61f1104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.102938  8902 tablet_service.cc:1511] Processing CreateTablet for tablet da988855757643ccbb2593bad676d78d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:09.100946  8826 tablet_service.cc:1511] Processing CreateTablet for tablet f2fb7e71822c4226a7ee8579013bfe9f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:09.104928  8758 tablet_service.cc:1511] Processing CreateTablet for tablet 102be8dba78c4bc998ed8bf52775bec5 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:09.107645  8959 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:09.106223  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102be8dba78c4bc998ed8bf52775bec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.110889  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4847af9abd4172bff3a603da47325c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.111451  8964 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.111943  8964 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.114598  8964 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.117254  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c10a9719c7f4cf5a813c2dc4c5e3739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.120939  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 51c7e309721f4da1bcd1626da407d364 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:09.123828  8753 tablet_service.cc:1511] Processing CreateTablet for tablet f2fb7e71822c4226a7ee8579013bfe9f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:09.125095  8965 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.125614  8965 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.129634  8965 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.133423  8959 tablet_bootstrap.cc:654] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.117254  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fb7e71822c4226a7ee8579013bfe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.151224  8830 tablet_service.cc:1511] Processing CreateTablet for tablet cbb9c9a8b7c641fb839da3aa2a309c0b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:09.152593  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb9c9a8b7c641fb839da3aa2a309c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.142635  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da988855757643ccbb2593bad676d78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.172538  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c7e309721f4da1bcd1626da407d364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.183171  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fb7e71822c4226a7ee8579013bfe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.186825  8751 tablet_service.cc:1511] Processing CreateTablet for tablet e8a8035ad96048ea978033b357465875 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:09.189388  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c7e309721f4da1bcd1626da407d364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.194622  8756 tablet_service.cc:1511] Processing CreateTablet for tablet cbb9c9a8b7c641fb839da3aa2a309c0b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:09.195014  8759 tablet_service.cc:1511] Processing CreateTablet for tablet 672045bd655a4cbea707258aa0718564 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:09.202611  8904 tablet_service.cc:1511] Processing CreateTablet for tablet 2a15a66fec474b05b1f3ad99f61f1104 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:09.214538  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a15a66fec474b05b1f3ad99f61f1104. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.217425  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb9c9a8b7c641fb839da3aa2a309c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.218087  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a8035ad96048ea978033b357465875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.132851  8903 tablet_service.cc:1511] Processing CreateTablet for tablet fb4847af9abd4172bff3a603da47325c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:09.219044  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 512bfb8ae84244418d0107564d88e5bb (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:09.220223  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4847af9abd4172bff3a603da47325c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.220337  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512bfb8ae84244418d0107564d88e5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.221966  8905 tablet_service.cc:1511] Processing CreateTablet for tablet af46285a3b87458b8b247dc8610ab80b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:09.223248  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af46285a3b87458b8b247dc8610ab80b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.227238  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 94e939be989f4d59b1983955951ab90f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:09.227566  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 512bfb8ae84244418d0107564d88e5bb (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:09.230729  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e939be989f4d59b1983955951ab90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.230921  8958 tablet_bootstrap.cc:654] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.233183  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672045bd655a4cbea707258aa0718564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.235216  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 2c10a9719c7f4cf5a813c2dc4c5e3739 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:09.236563  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c10a9719c7f4cf5a813c2dc4c5e3739. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.211323  8960 tablet_bootstrap.cc:654] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.136802  8831 tablet_service.cc:1511] Processing CreateTablet for tablet e8a8035ad96048ea978033b357465875 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:09.204910  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 672045bd655a4cbea707258aa0718564 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:09.228840  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512bfb8ae84244418d0107564d88e5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.275041  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:09.276352  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.290098  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 102be8dba78c4bc998ed8bf52775bec5 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:09.291469  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 102be8dba78c4bc998ed8bf52775bec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.301107  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672045bd655a4cbea707258aa0718564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.316442  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:09.317243  8959 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:09.317938  8959 ts_tablet_manager.cc:1403] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.210s	user 0.027s	sys 0.017s
I20260709 13:15:09.322896  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a8035ad96048ea978033b357465875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.322244  8959 raft_consensus.cc:359] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.327559  8752 tablet_service.cc:1511] Processing CreateTablet for tablet 019a0cde8c994b9a83ff212e5c02437c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:09.327876  8959 raft_consensus.cc:385] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.329895  8959 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.332091  8959 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.332898  8828 tablet_service.cc:1511] Processing CreateTablet for tablet 94e939be989f4d59b1983955951ab90f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:09.334636  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e939be989f4d59b1983955951ab90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.342128  8959 ts_tablet_manager.cc:1434] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.001s
I20260709 13:15:09.353294  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 51c7e309721f4da1bcd1626da407d364 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:09.355261  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c7e309721f4da1bcd1626da407d364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.366122  8827 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:09.367476  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.370015  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 011917cac276499ba01c77d911c67d8d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:09.373557  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a0cde8c994b9a83ff212e5c02437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.374033  8758 tablet_service.cc:1511] Processing CreateTablet for tablet 968e06ae5d2744aeb0b947873b369af8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:09.375407  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e06ae5d2744aeb0b947873b369af8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:09.377358  8807 leader_election.cc:343] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.380510  8759 tablet_service.cc:1511] Processing CreateTablet for tablet 76badded6ebe4972ad520c819a7fc3ae (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:09.382426  8960 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:09.383869  8960 ts_tablet_manager.cc:1403] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.307s	user 0.009s	sys 0.013s
I20260709 13:15:09.396106  8899 tablet_service.cc:1511] Processing CreateTablet for tablet f2fb7e71822c4226a7ee8579013bfe9f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:09.403875  8966 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.404562  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fb7e71822c4226a7ee8579013bfe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.404596  8966 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.407440  8905 tablet_service.cc:1511] Processing CreateTablet for tablet e8a8035ad96048ea978033b357465875 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:09.402981  8958 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:09.409402  8958 ts_tablet_manager.cc:1403] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.421s	user 0.009s	sys 0.009s
I20260709 13:15:09.416160  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8a8035ad96048ea978033b357465875. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.431916  8900 tablet_service.cc:1511] Processing CreateTablet for tablet cbb9c9a8b7c641fb839da3aa2a309c0b (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:09.476358  8829 tablet_service.cc:1511] Processing CreateTablet for tablet 282538f07daf4dcdb59352e756a62ba8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:09.477499  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb9c9a8b7c641fb839da3aa2a309c0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.409698  8826 tablet_service.cc:1511] Processing CreateTablet for tablet 019a0cde8c994b9a83ff212e5c02437c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:09.435963  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:09.437371  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76badded6ebe4972ad520c819a7fc3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.439323  8753 tablet_service.cc:1511] Processing CreateTablet for tablet 282538f07daf4dcdb59352e756a62ba8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:09.442651  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 589fb2d6cab941e09bb87a5254bc9d48 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:09.412793  8966 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:09.444384  8960 raft_consensus.cc:359] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.445266  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 273b1043e8dc4b13a6a84b35f19ff2a8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:09.448271  8959 tablet_bootstrap.cc:492] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:09.454665  8751 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd2a06b32904b5db18230a954b8d7fe (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:09.484903  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011917cac276499ba01c77d911c67d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.485737  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273b1043e8dc4b13a6a84b35f19ff2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.486972  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282538f07daf4dcdb59352e756a62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.485181  8960 raft_consensus.cc:385] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.427331  8830 tablet_service.cc:1511] Processing CreateTablet for tablet 011917cac276499ba01c77d911c67d8d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:09.487303  8960 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.488387  8960 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.490679  8960 ts_tablet_manager.cc:1434] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 13:15:09.492153  8960 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:09.495397  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:09.496197  8844 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:09.497659  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a0cde8c994b9a83ff212e5c02437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.458019  8756 tablet_service.cc:1511] Processing CreateTablet for tablet 6e56e66e882c455cb86d4e08fd5555d2 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:09.459837  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 672045bd655a4cbea707258aa0718564 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:09.467196  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 589fb2d6cab941e09bb87a5254bc9d48 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:09.483824  8769 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:09.505378  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589fb2d6cab941e09bb87a5254bc9d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.510052  8735 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:09.511336  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:09.512533  8959 tablet_bootstrap.cc:654] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.464548  8907 tablet_service.cc:1511] Processing CreateTablet for tablet 512bfb8ae84244418d0107564d88e5bb (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:09.458005  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 968e06ae5d2744aeb0b947873b369af8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:09.514101  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 76badded6ebe4972ad520c819a7fc3ae (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:09.482879  8958 raft_consensus.cc:359] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:09.545645  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:09.532826  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd2a06b32904b5db18230a954b8d7fe (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:09.545184  8904 tablet_service.cc:1511] Processing CreateTablet for tablet 94e939be989f4d59b1983955951ab90f (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:09.558706  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 273b1043e8dc4b13a6a84b35f19ff2a8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:09.553998  8965 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:09.561260  8965 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.561712  8965 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.548357  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 019a0cde8c994b9a83ff212e5c02437c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
W20260709 13:15:09.553826  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44021.8us
I20260709 13:15:09.532826  8750 tablet_service.cc:1511] Processing CreateTablet for tablet af7776ba20a14a499de5919550fdada6 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 13:15:09.560356  8732 leader_election.cc:343] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.552332  8808 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:09.566766  8964 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:09.567417  8964 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:09.567813  8964 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:09.556728  8958 raft_consensus.cc:385] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.573499  8958 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.574246  8958 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:09.551009  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 672045bd655a4cbea707258aa0718564. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.577178  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.579180  8827 tablet_service.cc:1511] Processing CreateTablet for tablet 6e56e66e882c455cb86d4e08fd5555d2 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:09.580698  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 512bfb8ae84244418d0107564d88e5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.585451  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a0cde8c994b9a83ff212e5c02437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.587466  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94e939be989f4d59b1983955951ab90f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.552914  8751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd2a06b32904b5db18230a954b8d7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.590072  8828 tablet_service.cc:1511] Processing CreateTablet for tablet af7776ba20a14a499de5919550fdada6 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:09.587054  8906 tablet_service.cc:1511] Processing CreateTablet for tablet 011917cac276499ba01c77d911c67d8d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:09.537201  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282538f07daf4dcdb59352e756a62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.594383  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589fb2d6cab941e09bb87a5254bc9d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.594802  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7776ba20a14a499de5919550fdada6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.595317  8964 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.597692  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e06ae5d2744aeb0b947873b369af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.598835  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:09.599050  8964 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.600188  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:09.601553  8807 leader_election.cc:343] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.603015  8965 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.604594  8769 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:09.605245  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011917cac276499ba01c77d911c67d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.605245  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 011917cac276499ba01c77d911c67d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.612512  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e56e66e882c455cb86d4e08fd5555d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.612141  8808 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:09.614702  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:09.588891  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 2da23dcb2ee347e7a43e2150a082fe62 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:09.634245  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e56e66e882c455cb86d4e08fd5555d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.647390  8844 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:09.689108  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76badded6ebe4972ad520c819a7fc3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.689559  8983 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.689513  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 968e06ae5d2744aeb0b947873b369af8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:09.686514  8964 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:09.690910  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 968e06ae5d2744aeb0b947873b369af8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.694262  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273b1043e8dc4b13a6a84b35f19ff2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.696295  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da23dcb2ee347e7a43e2150a082fe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.710387  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd2a06b32904b5db18230a954b8d7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.690266  8983 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.713532  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7776ba20a14a499de5919550fdada6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:09.728317  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 116283us
I20260709 13:15:09.730674  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:09.731870  8826 tablet_service.cc:1511] Processing CreateTablet for tablet 2da23dcb2ee347e7a43e2150a082fe62 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:15:09.732352  8735 leader_election.cc:343] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.733551  8983 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.734861  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:09.735621  8960 tablet_bootstrap.cc:700] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent opening tablet: real 0.135s	user 0.004s	sys 0.004s
I20260709 13:15:09.736373  8960 tablet_bootstrap.cc:654] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:09.736713  8732 leader_election.cc:343] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.737248  8732 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:09.738157  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 282538f07daf4dcdb59352e756a62ba8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:09.738511  8983 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:09.739538  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282538f07daf4dcdb59352e756a62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.748399  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:09.750181  8732 leader_election.cc:343] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.750666  8732 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:09.751591  8965 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.752525  8965 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:09.757581  8959 tablet_bootstrap.cc:492] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:09.758176  8959 ts_tablet_manager.cc:1403] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.310s	user 0.019s	sys 0.011s
I20260709 13:15:09.760123  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:09.761873  8882 leader_election.cc:343] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.766218  8958 ts_tablet_manager.cc:1434] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.339s	user 0.007s	sys 0.013s
I20260709 13:15:09.780539  8753 tablet_service.cc:1511] Processing CreateTablet for tablet c6f1fe9f34b9476fb981c06a43a1fb1d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:09.782488  8753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f1fe9f34b9476fb981c06a43a1fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.767612  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da23dcb2ee347e7a43e2150a082fe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.794486  8958 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:09.768240  8900 tablet_service.cc:1511] Processing CreateTablet for tablet 76badded6ebe4972ad520c819a7fc3ae (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:09.796654  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76badded6ebe4972ad520c819a7fc3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.803155  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 273b1043e8dc4b13a6a84b35f19ff2a8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:09.805301  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 2e090a13858f439f934f3a0277b08f18 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:15:09.806100  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:09.807077  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e090a13858f439f934f3a0277b08f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.773851  8959 raft_consensus.cc:359] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.807641  8959 raft_consensus.cc:385] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.807835  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:09.777685  8754 tablet_service.cc:1511] Processing CreateTablet for tablet 191959ae05ea40fd8a7fb0e027de5b86 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:09.809118  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191959ae05ea40fd8a7fb0e027de5b86. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:09.809659  8884 leader_election.cc:343] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.810122  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:09.810166  8757 tablet_service.cc:1511] Processing CreateTablet for tablet 9f42b63da74d4bcf8db95f4956d8d75c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:09.811331  8966 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:09.811655  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f42b63da74d4bcf8db95f4956d8d75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.803159  8825 tablet_service.cc:1511] Processing CreateTablet for tablet 405e426995614183bb2a212fc38e04b0 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:09.807132  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 273b1043e8dc4b13a6a84b35f19ff2a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.807993  8959 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.813556  8959 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.815734  8959 ts_tablet_manager.cc:1434] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:15:09.774467  8752 tablet_service.cc:1511] Processing CreateTablet for tablet 405e426995614183bb2a212fc38e04b0 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:09.816888  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e426995614183bb2a212fc38e04b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.817509  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e426995614183bb2a212fc38e04b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.822590  8959 tablet_bootstrap.cc:492] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:09.823307  8966 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.823801  8966 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.826040  8966 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:09.827991  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:09.829754  8882 leader_election.cc:343] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.830133  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:09.831688  8884 leader_election.cc:343] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.832163  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:09.833024  8966 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:09.837531  8960 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:09.838088  8960 ts_tablet_manager.cc:1403] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.346s	user 0.012s	sys 0.007s
I20260709 13:15:09.767642  8759 tablet_service.cc:1511] Processing CreateTablet for tablet 2e090a13858f439f934f3a0277b08f18 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:09.846922  8904 tablet_service.cc:1511] Processing CreateTablet for tablet 589fb2d6cab941e09bb87a5254bc9d48 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:09.848302  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589fb2d6cab941e09bb87a5254bc9d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.850404  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 9bd2a06b32904b5db18230a954b8d7fe (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:09.852355  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 6e56e66e882c455cb86d4e08fd5555d2 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:09.854557  8903 tablet_service.cc:1511] Processing CreateTablet for tablet af7776ba20a14a499de5919550fdada6 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:09.857556  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e090a13858f439f934f3a0277b08f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.863528  8754 tablet_service.cc:1511] Processing CreateTablet for tablet b0cebd36d7c3434a9e438125a626bf29 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:09.866122  8755 tablet_service.cc:1511] Processing CreateTablet for tablet f095ec4c4cb343308d8bd14544fe8b4e (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:09.867501  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e56e66e882c455cb86d4e08fd5555d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.868161  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd2a06b32904b5db18230a954b8d7fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.868836  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7776ba20a14a499de5919550fdada6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.867033  8960 raft_consensus.cc:359] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.869846  8960 raft_consensus.cc:385] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:09.869623  8758 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:09.873107  8834 tablet_service.cc:1511] Processing CreateTablet for tablet 191959ae05ea40fd8a7fb0e027de5b86 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:09.874529  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191959ae05ea40fd8a7fb0e027de5b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.850944  8959 tablet_bootstrap.cc:654] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.879925  8750 tablet_service.cc:1511] Processing CreateTablet for tablet 9d82cf960a5f4fb4acb573fe580b10ed (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:09.870167  8960 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:09.864766  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0cebd36d7c3434a9e438125a626bf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.883863  8964 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.900784  8902 tablet_service.cc:1511] Processing CreateTablet for tablet 2e090a13858f439f934f3a0277b08f18 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:09.903028  8964 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:09.931023  8828 tablet_service.cc:1511] Processing CreateTablet for tablet c6f1fe9f34b9476fb981c06a43a1fb1d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:09.934989  8828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f1fe9f34b9476fb981c06a43a1fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.892699  8907 tablet_service.cc:1511] Processing CreateTablet for tablet 2da23dcb2ee347e7a43e2150a082fe62 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:09.932200  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:09.933074  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:09.954743  8808 leader_election.cc:343] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:09.955663  8807 leader_election.cc:343] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:09.956270  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:09.933359  8829 tablet_service.cc:1511] Processing CreateTablet for tablet 9f42b63da74d4bcf8db95f4956d8d75c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:09.933719  8964 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.908509  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.959240  8900 tablet_service.cc:1511] Processing CreateTablet for tablet c6f1fe9f34b9476fb981c06a43a1fb1d (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:09.961568  8958 tablet_bootstrap.cc:654] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:09.961971  8750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d82cf960a5f4fb4acb573fe580b10ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.962913  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f095ec4c4cb343308d8bd14544fe8b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.965855  8829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f42b63da74d4bcf8db95f4956d8d75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.935299  8902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e090a13858f439f934f3a0277b08f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.937136  8825 tablet_service.cc:1511] Processing CreateTablet for tablet b0cebd36d7c3434a9e438125a626bf29 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:09.917439  8752 tablet_service.cc:1511] Processing CreateTablet for tablet 8447f76afbaa45b385add1219d08771c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:09.923256  8960 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.958969  8982 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:09.977480  8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8447f76afbaa45b385add1219d08771c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.982079  8825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0cebd36d7c3434a9e438125a626bf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.985232  8983 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.986017  8983 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.988129  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da23dcb2ee347e7a43e2150a082fe62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:09.996632  8966 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:09.996346  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 191959ae05ea40fd8a7fb0e027de5b86 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:09.997135  8966 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:09.997570  8983 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:09.999260  8966 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:09.999680  8960 ts_tablet_manager.cc:1434] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.161s	user 0.010s	sys 0.001s
I20260709 13:15:09.999930  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.000646  8918 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:10.001060  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.001224  8960 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.002285  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:10.003743  8735 leader_election.cc:343] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:10.005273  8884 leader_election.cc:343] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.006604  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:10.005191  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.009116  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6f1fe9f34b9476fb981c06a43a1fb1d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:10.012710  8882 leader_election.cc:343] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.013281  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:10.014084  8966 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.014474  8983 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.015112  8983 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.015502  8983 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.021559  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 191959ae05ea40fd8a7fb0e027de5b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.028085  8983 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.031389  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:10.033020  8735 leader_election.cc:343] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.037204  8899 tablet_service.cc:1511] Processing CreateTablet for tablet 405e426995614183bb2a212fc38e04b0 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:10.039120  8899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e426995614183bb2a212fc38e04b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.042794  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:10.043819  8918 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.042943  8983 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.042403  8827 tablet_service.cc:1511] Processing CreateTablet for tablet f095ec4c4cb343308d8bd14544fe8b4e (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:10.057927  8918 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:10.059432  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:10.061388  8983 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.062916  8983 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:10.060281  8832 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:10.063956  8983 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.074625  8959 tablet_bootstrap.cc:492] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.075179  8959 ts_tablet_manager.cc:1403] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.253s	user 0.031s	sys 0.034s
I20260709 13:15:10.083209  8959 raft_consensus.cc:359] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.084657  8826 tablet_service.cc:1511] Processing CreateTablet for tablet 9d82cf960a5f4fb4acb573fe580b10ed (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:10.085147  8959 raft_consensus.cc:385] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.085575  8959 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.086211  8827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f095ec4c4cb343308d8bd14544fe8b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.086498  8958 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.086432  8959 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.087110  8958 ts_tablet_manager.cc:1403] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.293s	user 0.067s	sys 0.036s
I20260709 13:15:10.090826  8958 raft_consensus.cc:359] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.091754  8958 raft_consensus.cc:385] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.092089  8958 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.090843  8665 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.094238  8958 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.096570  8958 ts_tablet_manager.cc:1434] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:15:10.097400  8826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d82cf960a5f4fb4acb573fe580b10ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.101303  8959 ts_tablet_manager.cc:1434] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 13:15:10.106058  8904 tablet_service.cc:1511] Processing CreateTablet for tablet b0cebd36d7c3434a9e438125a626bf29 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:10.062294  8908 tablet_service.cc:1511] Processing CreateTablet for tablet 9f42b63da74d4bcf8db95f4956d8d75c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:10.112313  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f42b63da74d4bcf8db95f4956d8d75c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.114780  8959 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.112445  8833 tablet_service.cc:1511] Processing CreateTablet for tablet 8447f76afbaa45b385add1219d08771c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:10.120548  8830 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40098 (request call id 39) took 1035 ms. Trace:
I20260709 13:15:10.121495  8830 rpcz_store.cc:276] 0709 13:15:09.085255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.403582 (+318327us) service_pool.cc:224] Handling call
0709 13:15:09.523808 (+120226us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74dce831 00007fce74dabac3 00007fce74d5a400 00007fce6e1dfaf4 00007fce6e1dfa82 00007fce6e1df9b1
0709 13:15:09.523965 (+   157us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:09.524065 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:09.910532 (+386467us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:10.104943 (+194411us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:10.120479 (+ 15536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28041600}
I20260709 13:15:10.123909  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8447f76afbaa45b385add1219d08771c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.130168  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0cebd36d7c3434a9e438125a626bf29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.141978  8958 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.159921  8900 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:10.153591  8960 tablet_bootstrap.cc:654] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.153704  8906 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:42810 (request call id 39) took 1065 ms. Trace:
I20260709 13:15:10.173482  8982 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.173357  8906 rpcz_store.cc:276] 0709 13:15:09.088366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:09.586106 (+497740us) service_pool.cc:224] Handling call
0709 13:15:09.599595 (+ 13489us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:09.599708 (+   113us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:09.887696 (+287988us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:10.153112 (+265416us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:10.153637 (+   525us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:10.173990  8982 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.153808  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.176251  8982 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.179467  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.140851  8959 tablet_bootstrap.cc:654] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.180158  8769 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:10.181315  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:10.182960  8807 leader_election.cc:343] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.162611  8903 tablet_service.cc:1511] Processing CreateTablet for tablet 9d82cf960a5f4fb4acb573fe580b10ed (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:10.184233  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.167120  8901 tablet_service.cc:1511] Processing CreateTablet for tablet 8447f76afbaa45b385add1219d08771c (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:10.185539  8982 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.161293  8900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.148828  8905 tablet_service.cc:1511] Processing CreateTablet for tablet f095ec4c4cb343308d8bd14544fe8b4e (DEFAULT_TABLE table=test-workload [id=a1cdac957b3743c5b70c4686042fbd14]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:10.186009  8982 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.186560  8982 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.187005  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f095ec4c4cb343308d8bd14544fe8b4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.193264  8903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d82cf960a5f4fb4acb573fe580b10ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.193949  8901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8447f76afbaa45b385add1219d08771c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.219866  8982 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.235369  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.236003  8769 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.226986  8958 tablet_bootstrap.cc:654] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.242074  8769 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:10.243146  8982 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.243373  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:10.245124  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:10.247273  8807 leader_election.cc:343] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.249681  8960 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.250198  8960 ts_tablet_manager.cc:1403] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.249s	user 0.030s	sys 0.024s
I20260709 13:15:10.250311  8959 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.250960  8959 ts_tablet_manager.cc:1403] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.136s	user 0.010s	sys 0.010s
I20260709 13:15:10.253279  8960 raft_consensus.cc:359] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.253904  8960 raft_consensus.cc:385] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.254184  8960 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.254865  8960 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.254889  8959 raft_consensus.cc:359] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.255939  8959 raft_consensus.cc:385] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.256336  8959 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.257206  8982 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.257715  8982 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:10.257532  8959 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.259284  8958 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.258561  8982 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.259805  8958 ts_tablet_manager.cc:1403] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.118s	user 0.020s	sys 0.000s
I20260709 13:15:10.262893  8959 ts_tablet_manager.cc:1434] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:15:10.263384  8960 ts_tablet_manager.cc:1434] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 13:15:10.264389  8959 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.264397  8960 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.262661  8958 raft_consensus.cc:359] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.269090  8958 raft_consensus.cc:385] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.269578  8958 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.270731  8958 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.273941  8958 ts_tablet_manager.cc:1434] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:15:10.274677  8960 tablet_bootstrap.cc:654] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.275336  8958 tablet_bootstrap.cc:492] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.282064  8959 tablet_bootstrap.cc:654] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.287252  8960 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.287810  8960 ts_tablet_manager.cc:1403] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:15:10.291126  8983 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.291236  8960 raft_consensus.cc:359] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.292177  8960 raft_consensus.cc:385] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.292371  8958 tablet_bootstrap.cc:654] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.292026  8983 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.292618  8960 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.293738  8960 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.295845  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.298605  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.299841  8960 ts_tablet_manager.cc:1434] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
W20260709 13:15:10.300763  8735 leader_election.cc:343] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.301326  8960 tablet_bootstrap.cc:492] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
W20260709 13:15:10.302481  8732 leader_election.cc:343] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.303171  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.304407  8965 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.307329  8958 tablet_bootstrap.cc:492] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.307996  8958 ts_tablet_manager.cc:1403] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.005s
I20260709 13:15:10.309854  8960 tablet_bootstrap.cc:654] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.311722  8958 raft_consensus.cc:359] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.313176  8958 raft_consensus.cc:385] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.313716  8958 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.315848  8983 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.318514  8665 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.314975  8958 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.322413  8960 tablet_bootstrap.cc:492] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.323031  8960 ts_tablet_manager.cc:1403] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 13:15:10.324710  8958 ts_tablet_manager.cc:1434] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:15:10.326116  8958 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.326848  8960 raft_consensus.cc:359] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.327709  8960 raft_consensus.cc:385] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.328065  8960 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.329064  8960 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.330909  8959 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.331396  8959 ts_tablet_manager.cc:1403] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.022s
I20260709 13:15:10.334486  8958 tablet_bootstrap.cc:654] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.334717  8959 raft_consensus.cc:359] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.335493  8959 raft_consensus.cc:385] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.335814  8959 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.336697  8959 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.342056  8960 ts_tablet_manager.cc:1434] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.001s
I20260709 13:15:10.342447  8959 ts_tablet_manager.cc:1434] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:15:10.343597  8959 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.344653  8958 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.345218  8958 ts_tablet_manager.cc:1403] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:15:10.346938  8960 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.348277  8958 raft_consensus.cc:359] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.349112  8958 raft_consensus.cc:385] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.349480  8958 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.350440  8958 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.351023  8959 tablet_bootstrap.cc:654] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.352587  8966 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.353197  8966 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.355978  8966 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.356524  8958 ts_tablet_manager.cc:1434] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:15:10.357717  8958 tablet_bootstrap.cc:492] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.360116  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.363626  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.364403  8960 tablet_bootstrap.cc:654] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.364822  8958 tablet_bootstrap.cc:654] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.364615  8843 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
W20260709 13:15:10.365648  8882 leader_election.cc:343] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.366797  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.367987  8966 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.368399  8966 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.368748  8966 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.373298  8982 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.373987  8982 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.377451  8982 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.379221  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.379376  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.380314  8958 tablet_bootstrap.cc:492] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
W20260709 13:15:10.380849  8807 leader_election.cc:343] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:10.381412  8808 leader_election.cc:343] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.381994  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.382963  8982 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.380904  8958 ts_tablet_manager.cc:1403] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 13:15:10.391770  8966 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.396297  8958 raft_consensus.cc:359] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.396716  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.397735  8958 raft_consensus.cc:385] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.398303  8958 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
W20260709 13:15:10.399361  8882 leader_election.cc:343] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.402273  8966 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.399556  8958 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.402541  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:10.403232  8843 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.404976  8958 ts_tablet_manager.cc:1434] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:15:10.406880  8959 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.407709  8959 ts_tablet_manager.cc:1403] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.029s
I20260709 13:15:10.409408  8960 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.410163  8960 ts_tablet_manager.cc:1403] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.009s
I20260709 13:15:10.411707  8843 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:10.411851  8959 raft_consensus.cc:359] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.412818  8959 raft_consensus.cc:385] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.413043  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.413506  8960 raft_consensus.cc:359] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.414243  8960 raft_consensus.cc:385] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.414274  8966 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.414472  8958 tablet_bootstrap.cc:492] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.414737  8960 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.415730  8960 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.413218  8959 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.419845  8959 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.421715  8966 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:10.423452  8958 tablet_bootstrap.cc:654] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.423084  8966 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.428447  8960 ts_tablet_manager.cc:1434] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.012s
I20260709 13:15:10.429013  8959 ts_tablet_manager.cc:1434] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:15:10.429590  8960 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.430001  8959 tablet_bootstrap.cc:492] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.437095  8959 tablet_bootstrap.cc:654] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.437597  8958 tablet_bootstrap.cc:492] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.438153  8958 ts_tablet_manager.cc:1403] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.001s
I20260709 13:15:10.438853  8960 tablet_bootstrap.cc:654] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.441114  8958 raft_consensus.cc:359] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.441906  8958 raft_consensus.cc:385] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.442262  8958 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.443001  8958 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.442973  8667 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.443809  8959 tablet_bootstrap.cc:492] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.444456  8959 ts_tablet_manager.cc:1403] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:15:10.445458  8958 ts_tablet_manager.cc:1434] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:10.446936  8960 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.447439  8960 ts_tablet_manager.cc:1403] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.001s
I20260709 13:15:10.447304  8959 raft_consensus.cc:359] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.448109  8959 raft_consensus.cc:385] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.448468  8959 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.449229  8959 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.450614  8960 raft_consensus.cc:359] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:10.451589  8960 raft_consensus.cc:385] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.451879  8960 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.452541  8960 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:10.454656  8960 ts_tablet_manager.cc:1434] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:10.455765  8958 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.457279  8959 ts_tablet_manager.cc:1434] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:10.458243  8959 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.462996  8958 tablet_bootstrap.cc:654] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.464178  8960 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.469828  8960 tablet_bootstrap.cc:654] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.472254  8959 tablet_bootstrap.cc:654] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.473205  8982 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.474053  8982 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.475423  8958 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.475994  8958 ts_tablet_manager.cc:1403] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:15:10.478637  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.479375  8918 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:10.479378  8958 raft_consensus.cc:359] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.480233  8958 raft_consensus.cc:385] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.480554  8958 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.481809  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:10.482173  8958 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.482822  8964 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.483357  8964 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.483539  8960 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.483804  8964 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.484054  8960 ts_tablet_manager.cc:1403] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:15:10.487200  8960 raft_consensus.cc:359] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.487947  8959 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.488018  8960 raft_consensus.cc:385] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.488554  8960 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.488756  8959 ts_tablet_manager.cc:1403] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.011s
I20260709 13:15:10.480536  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.489506  8769 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:10.489784  8982 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.489526  8960 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.496832  8960 ts_tablet_manager.cc:1434] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:15:10.498157  8960 tablet_bootstrap.cc:492] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.504528  8964 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.505420  8959 raft_consensus.cc:359] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.506394  8959 raft_consensus.cc:385] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.506780  8959 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.507663  8959 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.508988  8964 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.510038  8959 ts_tablet_manager.cc:1434] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:15:10.508558  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.510239  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:10.510847  8918 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.510756  8769 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.511713  8960 tablet_bootstrap.cc:654] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.512032  8958 ts_tablet_manager.cc:1434] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.036s	user 0.013s	sys 0.019s
I20260709 13:15:10.513644  8959 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.519263  8958 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.526892  8959 tablet_bootstrap.cc:654] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.527271  8769 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:10.528061  8958 tablet_bootstrap.cc:654] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.528916  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:10.529490  8918 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:10.530509  9013 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.531543  9013 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:10.534035  9013 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.541141  8983 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.541671  8983 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.542768  8958 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.543254  8958 ts_tablet_manager.cc:1403] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:15:10.544108  8983 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.545811  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.545938  8958 raft_consensus.cc:359] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.546597  8958 raft_consensus.cc:385] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.546917  8958 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.547639  8958 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.549357  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.550680  8958 ts_tablet_manager.cc:1434] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
W20260709 13:15:10.551133  8735 leader_election.cc:343] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.552073  8964 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.553272  8964 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:10.553781  8732 leader_election.cc:343] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.554299  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.555608  8960 tablet_bootstrap.cc:492] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.555553  8964 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.556196  8960 ts_tablet_manager.cc:1403] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.021s
I20260709 13:15:10.551900  8958 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.558058  8966 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.558557  8966 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.559252  8960 raft_consensus.cc:359] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.559983  8960 raft_consensus.cc:385] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.560278  8960 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.560456  8666 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.560817  8966 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.567067  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.560969  8960 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.567759  8918 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:10.565107  8983 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.564795  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.569734  8960 ts_tablet_manager.cc:1434] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:15:10.561463  8959 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.567838  8958 tablet_bootstrap.cc:654] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.566181  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.570652  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:10.570904  8959 ts_tablet_manager.cc:1403] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.012s
I20260709 13:15:10.571249  8768 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:15:10.571468  8808 leader_election.cc:343] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.566772  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.573776  8959 raft_consensus.cc:359] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.574175  8882 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:10.574512  8959 raft_consensus.cc:385] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.574903  8959 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.575323  8966 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.575887  8959 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.581190  9013 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.581708  9013 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.582088  9013 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.586475  8959 ts_tablet_manager.cc:1434] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:10.587586  8959 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.588080  8960 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.587313  8983 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:10.593393  8958 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.594786  8958 ts_tablet_manager.cc:1403] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.013s
I20260709 13:15:10.599777  8959 tablet_bootstrap.cc:654] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.600425  8966 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.604717  8958 raft_consensus.cc:359] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.611382  8958 raft_consensus.cc:385] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.611899  8958 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.612460  8843 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.613374  8958 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.615792  8958 ts_tablet_manager.cc:1434] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:10.619629  8958 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.621490  9013 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.626158  8960 tablet_bootstrap.cc:654] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.630439  8983 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:10.635440  8959 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.635936  8959 ts_tablet_manager.cc:1403] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.012s
I20260709 13:15:10.637172  9013 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.644032  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:10.644362  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.644800  8918 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.645321  8958 tablet_bootstrap.cc:654] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:10.646050  8808 leader_election.cc:343] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.655085  8966 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.656436  8966 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:10.657229  9005 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.658555  8959 raft_consensus.cc:359] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.660396  8959 raft_consensus.cc:385] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.660656  8960 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.660826  8959 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.661453  8960 ts_tablet_manager.cc:1403] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.006s
I20260709 13:15:10.662034  8959 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.657944  9005 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.664736  8959 ts_tablet_manager.cc:1434] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:15:10.674654  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.677541  8918 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:10.655486  8964 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:15:10.679992  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.681064  8964 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.681535  8964 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:10.681941  8882 leader_election.cc:343] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.687011  9005 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.683135  8966 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.682369  8964 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.690857  8959 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:10.691803  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.697229  8842 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:10.697443  8982 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:10.695312  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.702848  8843 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:10.704355  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.701865  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.708086  8768 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:10.708884  8983 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.709409  8983 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.709685  8882 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:10.710973  9005 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.711455  9005 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.711901  9005 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.718092  8966 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.721635  8983 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.722738  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.727275  8983 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.730533  8983 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:10.735529  8732 leader_election.cc:343] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.736022  9004 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.737303  8960 raft_consensus.cc:359] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.737800  8960 raft_consensus.cc:385] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.736524  9004 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.738107  8960 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.739842  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.740401  8983 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.740757  8842 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:10.739019  8960 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.741354  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.740669  9004 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.733419  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.739223  8964 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.752019  8964 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.750723  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.758122  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.765251  8958 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.765477  8983 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.765722  8958 ts_tablet_manager.cc:1403] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.008s
I20260709 13:15:10.767225  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.767488  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.768774  8767 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:10.769742  8918 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:10.769672  8958 raft_consensus.cc:359] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.770434  8958 raft_consensus.cc:385] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.770716  8958 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.771111  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:10.771545  8958 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.757148  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.772099  8964 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.776899  8768 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:10.779377  8958 ts_tablet_manager.cc:1434] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:15:10.778499  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:10.773809  8842 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:10.780974  9004 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.781997  8982 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.784047  8958 tablet_bootstrap.cc:492] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.781374  9004 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.785979  9004 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.791193  8960 ts_tablet_manager.cc:1434] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.010s
I20260709 13:15:10.792186  8960 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.791052  8982 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.793747  8982 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.799741  9005 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
W20260709 13:15:10.804347  8735 leader_election.cc:343] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.804926  8735 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.807117  8965 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.808475  8965 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.807847  8664 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.811787  8965 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.813881  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:10.815625  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:10.816434  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.814078  9005 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.817587  8843 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:10.817703  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.814703  8917 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:10.819314  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:10.820361  8966 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:10.820551  8882 leader_election.cc:343] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.820529  8965 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.822230  8965 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.822741  8965 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.825129  8964 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.830389  8964 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.839702  8964 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.841578  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:10.842331  8843 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.841464  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:10.845412  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.849231  8959 tablet_bootstrap.cc:654] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.826333  9030 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.855530  8958 tablet_bootstrap.cc:654] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:10.850395  8807 leader_election.cc:343] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:10.856484  8808 leader_election.cc:343] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.862502  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.870131  9032 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.866791  8965 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.852695  8983 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.847240  9004 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.873086  8965 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.874910  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:10.877031  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:10.878664  8917 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.878834  8842 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.856822  8982 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.883240  8960 tablet_bootstrap.cc:654] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.886955  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.887182  9004 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.887629  8769 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.888351  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:10.890688  8958 tablet_bootstrap.cc:492] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.891283  8958 ts_tablet_manager.cc:1403] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.107s	user 0.011s	sys 0.005s
I20260709 13:15:10.891575  8917 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:10.892889  8842 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:10.893178  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:10.893755  8844 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:10.894153  8983 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.894927  8982 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.893951  8769 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:10.894675  8983 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:10.896394  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:10.897315  8983 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.897984  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.898761  8768 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:10.898273  8843 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:10.899163  9004 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.899919  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.901779  9005 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.902276  9005 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:10.903144  9005 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:10.904196  8958 raft_consensus.cc:359] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.905143  8958 raft_consensus.cc:385] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.905536  8958 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.905699  9031 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.906225  9031 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.906687  8958 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.908529  9031 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.909716  8958 ts_tablet_manager.cc:1434] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:15:10.911523  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:10.912411  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:10.914928  8842 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:10.916464  8960 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
W20260709 13:15:10.916805  8882 leader_election.cc:343] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.917441  8960 ts_tablet_manager.cc:1403] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.125s	user 0.010s	sys 0.006s
I20260709 13:15:10.917701  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.919248  9031 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:10.919787  9031 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:10.920171  9031 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.921866  8960 raft_consensus.cc:359] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.923297  8960 raft_consensus.cc:385] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.923735  8960 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.924772  8960 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.925866  8958 tablet_bootstrap.cc:492] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.928980  8960 ts_tablet_manager.cc:1434] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:15:10.930449  8960 tablet_bootstrap.cc:492] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.934500  9004 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:10.935530  9004 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.942449  8960 tablet_bootstrap.cc:654] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.944952  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:10.946113  9033 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:10.942116  9031 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.946626  9033 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.948712  9031 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:10.949965  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:10.950395  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:10.951468  8882 leader_election.cc:343] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.952559  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:10.952831  8735 leader_election.cc:343] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.952847  8960 tablet_bootstrap.cc:492] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:10.953642  8960 ts_tablet_manager.cc:1403] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
W20260709 13:15:10.953980  8732 leader_election.cc:343] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:10.954417  8732 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.955154  8965 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.956301  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:10.956789  8842 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.957336  8960 raft_consensus.cc:359] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.958272  8960 raft_consensus.cc:385] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.958621  8960 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.959782  8960 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.948638  9033 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:10.962018  8958 tablet_bootstrap.cc:654] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.962857  8960 ts_tablet_manager.cc:1434] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 13:15:10.963394  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:10.962654  8842 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:10.966136  8982 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:10.967167  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:10.968289  9031 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.968780  9031 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:10.969113  8664 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.969638  9031 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.973395  8958 tablet_bootstrap.cc:492] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:10.973856  8958 ts_tablet_manager.cc:1403] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.002s
I20260709 13:15:10.974079  8960 tablet_bootstrap.cc:492] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:10.976508  8958 raft_consensus.cc:359] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.977196  8958 raft_consensus.cc:385] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.977454  8958 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.978201  8959 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:10.978797  8959 ts_tablet_manager.cc:1403] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.288s	user 0.030s	sys 0.051s
I20260709 13:15:10.985731  8960 tablet_bootstrap.cc:654] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.985035  8959 raft_consensus.cc:359] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.987356  8958 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:10.989773  8958 ts_tablet_manager.cc:1434] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:15:10.988965  8664 catalog_manager.cc:5697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:10.991130  8958 tablet_bootstrap.cc:492] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:10.991057  8664 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:10.998113  8958 tablet_bootstrap.cc:654] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.999917  8983 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.000444  8983 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.002635  8983 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.005537  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.006476  8917 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:10.988394  8959 raft_consensus.cc:385] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.008914  8959 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.010098  8982 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.010819  8982 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.013019  9004 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.013988  8732 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.015203  8983 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.015728  8983 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.016180  8983 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.023747  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.009244  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:11.025895  8808 leader_election.cc:343] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.026154  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:11.027505  8735 leader_election.cc:343] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:11.028970  8807 leader_election.cc:343] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.029757  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.031740  9032 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.036325  9004 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.041162  8959 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.042567  9005 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.052485  9005 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.055584  9005 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:11.058040  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:11.060246  8884 leader_election.cc:343] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.043499  8982 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.063606  8959 ts_tablet_manager.cc:1434] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 13:15:11.065307  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:11.067421  8882 leader_election.cc:343] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.068022  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:11.069072  9005 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.075955  8983 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.078429  8959 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.088209  8666 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.090998  8983 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.091627  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.094673  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:11.096935  8960 tablet_bootstrap.cc:492] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:11.097184  8917 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.097474  8960 ts_tablet_manager.cc:1403] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.124s	user 0.044s	sys 0.048s
I20260709 13:15:11.093396  8982 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:15:11.096612  8735 leader_election.cc:343] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.103466  8960 raft_consensus.cc:359] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.104239  8960 raft_consensus.cc:385] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.104575  8960 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.106175  8960 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.106678  8958 tablet_bootstrap.cc:492] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.113049  8958 ts_tablet_manager.cc:1403] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.122s	user 0.039s	sys 0.063s
I20260709 13:15:11.114212  8959 tablet_bootstrap.cc:654] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.116278  8958 raft_consensus.cc:359] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.117113  8958 raft_consensus.cc:385] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.117307  8960 ts_tablet_manager.cc:1434] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.003s
I20260709 13:15:11.107352  8917 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:11.117491  8958 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.118443  8960 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:11.118531  8958 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.120213  8732 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:11.121822  8983 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.122527  8983 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:11.122779  8958 ts_tablet_manager.cc:1434] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:15:11.123695  8983 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.124727  8958 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.126649  9005 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.127175  9005 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.130636  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.131523  8768 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:11.132380  8960 tablet_bootstrap.cc:654] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.132890  8958 tablet_bootstrap.cc:654] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.133365  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.135025  9004 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.135543  9004 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.136132  9004 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.142390  8959 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.143060  8959 ts_tablet_manager.cc:1403] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.008s
I20260709 13:15:11.143941  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.144894  8843 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:11.146214  8959 raft_consensus.cc:359] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.146965  8959 raft_consensus.cc:385] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.146710  9032 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.147279  8959 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.148015  8959 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.147517  9032 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.150553  8959 ts_tablet_manager.cc:1434] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.007s
I20260709 13:15:11.151525  8959 tablet_bootstrap.cc:492] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.152302  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.142848  9005 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:11.169890  8808 leader_election.cc:343] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.171810  8982 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.172075  9032 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.175586  8959 tablet_bootstrap.cc:654] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.169870  9004 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.178454  9004 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:11.177353  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.182101  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.182737  8960 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:11.182976  8843 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.183298  8960 ts_tablet_manager.cc:1403] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.065s	user 0.029s	sys 0.012s
I20260709 13:15:11.183322  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:11.184243  8769 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.186196  8960 raft_consensus.cc:359] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.186851  8960 raft_consensus.cc:385] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.187110  8960 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.187916  8960 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:11.189549  8807 leader_election.cc:343] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.190263  8960 ts_tablet_manager.cc:1434] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:15:11.190163  8807 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.191229  8960 tablet_bootstrap.cc:492] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:11.191272  8982 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.182147  8666 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.195855  8958 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.198602  8958 ts_tablet_manager.cc:1403] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.014s
I20260709 13:15:11.199985  8843 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:11.203284  8768 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.205246  8960 tablet_bootstrap.cc:654] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.203435  8769 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:11.207813  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.208722  9004 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.208840  8958 raft_consensus.cc:359] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.209301  9004 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:11.209594  8958 raft_consensus.cc:385] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.209872  8958 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.210144  9004 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.211947  8958 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.213887  8958 ts_tablet_manager.cc:1434] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:11.214771  8958 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.217680  9032 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.244482  8959 tablet_bootstrap.cc:492] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.246668  8959 ts_tablet_manager.cc:1403] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.095s	user 0.024s	sys 0.008s
I20260709 13:15:11.251516  8959 raft_consensus.cc:359] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.255434  8959 raft_consensus.cc:385] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.255914  8959 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.255146  9032 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:11.257143  8959 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.260272  8959 ts_tablet_manager.cc:1434] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:15:11.261974  8959 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.274297  8666 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.276177  8959 tablet_bootstrap.cc:654] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.283481  8958 tablet_bootstrap.cc:654] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.298309  8958 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.298799  8958 ts_tablet_manager.cc:1403] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.010s
I20260709 13:15:11.305346  8958 raft_consensus.cc:359] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.306031  8958 raft_consensus.cc:385] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.306286  8958 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.306941  8958 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.307300  9004 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.309022  8958 ts_tablet_manager.cc:1434] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:11.313624  8959 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.314025  8959 ts_tablet_manager.cc:1403] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 13:15:11.316370  8959 raft_consensus.cc:359] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:11.317128  8958 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.317072  8959 raft_consensus.cc:385] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.317492  8959 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.318260  8959 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } }
I20260709 13:15:11.323571  8960 tablet_bootstrap.cc:492] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:11.324316  9004 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.324925  8958 tablet_bootstrap.cc:654] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.324797  9004 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.326599  8959 ts_tablet_manager.cc:1434] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:11.327154  9004 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:11.327600  8959 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.328828  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.329530  8842 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:11.330947  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.332966  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:11.334764  8882 leader_election.cc:343] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.335816  9004 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.336313  9004 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.336731  9004 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.338150  8959 tablet_bootstrap.cc:654] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.343803  8983 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.344657  8960 ts_tablet_manager.cc:1403] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.154s	user 0.009s	sys 0.036s
I20260709 13:15:11.349617  8960 raft_consensus.cc:359] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.351073  8960 raft_consensus.cc:385] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.351487  8960 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.350299  9004 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.353803  8959 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.354445  8959 ts_tablet_manager.cc:1403] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.010s
I20260709 13:15:11.354570  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:11.355758  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.356523  8844 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.357717  8959 raft_consensus.cc:359] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.358533  8959 raft_consensus.cc:385] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.358911  8959 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.359783  8959 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:11.361485  8882 leader_election.cc:343] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.366899  8844 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:11.396328  8983 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.396682  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:11.397716  9005 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.398229  9005 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:11.399067  9005 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.367623  8960 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.369088  8959 ts_tablet_manager.cc:1434] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:15:11.384609  8768 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.391832  8966 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.395447  9004 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:11.418982  8966 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.421386  8959 tablet_bootstrap.cc:492] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.431856  8959 tablet_bootstrap.cc:654] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.447958  8958 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.448518  8958 ts_tablet_manager.cc:1403] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.132s	user 0.024s	sys 0.060s
I20260709 13:15:11.450032  8960 ts_tablet_manager.cc:1434] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.105s	user 0.007s	sys 0.003s
I20260709 13:15:11.451634  8960 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:11.467727  8958 raft_consensus.cc:359] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.468444  8958 raft_consensus.cc:385] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.468712  8958 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.469530  8958 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.472687  9064 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.487803  8958 ts_tablet_manager.cc:1434] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:15:11.489446  8958 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.493304  8983 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.492179  8666 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:11.496129  8960 tablet_bootstrap.cc:654] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.493927  8983 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.503892  9032 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.504436  9032 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.510085  9065 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.511507  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:11.513496  8735 leader_election.cc:343] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.513876  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.514420  8917 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:11.515543  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:11.511831  8983 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.516011  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.516767  8965 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.516940  8918 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:11.517341  8965 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.517750  8965 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.517855  8983 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.518360  8983 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.512055  9032 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.518549  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.528354  8769 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:11.529980  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.535624  8965 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.537858  8965 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.540896  8959 tablet_bootstrap.cc:492] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.541041  9013 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:11.541405  9013 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.541567  8768 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.541782  9013 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.542850  8959 ts_tablet_manager.cc:1403] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.122s	user 0.029s	sys 0.012s
I20260709 13:15:11.549198  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.550351  8842 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:11.552203  9013 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.553201  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:11.556813  8983 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.557960  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.561434  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:11.562297  8918 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.563119  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:11.563915  8917 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.555919  9013 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.571123  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.572424  8916 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
W20260709 13:15:11.574194  8735 leader_election.cc:343] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.578418  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:11.579169  8769 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:11.559072  9033 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.581496  9033 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.581859  9033 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.583751  8958 tablet_bootstrap.cc:654] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.593389  8842 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.605036  9033 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.609067  9031 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.603993  8965 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.611187  8965 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.612699  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.613173  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:11.613320  8844 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.613775  8916 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.610743  8959 raft_consensus.cc:359] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.614701  8960 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:11.614946  8959 raft_consensus.cc:385] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.615129  8960 ts_tablet_manager.cc:1403] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.164s	user 0.024s	sys 0.046s
I20260709 13:15:11.615221  8959 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.617228  8959 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.618038  9032 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.618480  9032 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.611260  8917 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:11.619920  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.621503  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.618907  8918 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:11.622792  9032 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.623567  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.624042  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.624701  8769 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:11.625278  8735 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.617198  9033 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.626710  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.628254  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:11.631706  8807 leader_election.cc:343] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.626703  9032 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:11.632767  9032 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:11.633750  9032 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.637104  9033 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.637662  9033 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:11.616930  8965 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.645742  8965 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.648976  8959 ts_tablet_manager.cc:1434] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.001s
I20260709 13:15:11.650454  8959 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.638562  9033 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.658720  8844 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:11.669198  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:11.670994  8808 leader_election.cc:343] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.673556  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.674310  9013 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.674489  8965 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.675011  8965 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:11.677423  8960 raft_consensus.cc:359] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.678222  8960 raft_consensus.cc:385] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.679020  8960 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.681499  8960 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.676190  8965 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.690856  8960 ts_tablet_manager.cc:1434] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.002s
I20260709 13:15:11.691885  8960 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:11.697537  9031 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.710623  8958 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.711148  8958 ts_tablet_manager.cc:1403] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.222s	user 0.012s	sys 0.007s
I20260709 13:15:11.715903  8666 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 2, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.708107  9031 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.720394  9031 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:11.725095  8983 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:11.721692  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.726475  8844 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:11.727739  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:11.728659  9031 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.729264  9031 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.729691  9031 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.727994  8958 raft_consensus.cc:359] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.730218  8958 raft_consensus.cc:385] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.730406  8959 tablet_bootstrap.cc:654] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.730578  8958 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.706784  8916 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:11.731870  8958 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.746573  8958 ts_tablet_manager.cc:1434] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.035s	user 0.010s	sys 0.000s
I20260709 13:15:11.747448  8958 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.752810  8983 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.755728  9031 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.756675  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.759591  9065 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:11.765035  8960 tablet_bootstrap.cc:654] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:11.769568  8882 leader_election.cc:343] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.772836  8959 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.773656  8959 ts_tablet_manager.cc:1403] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.123s	user 0.017s	sys 0.006s
I20260709 13:15:11.775820  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:11.785027  9013 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.786283  9013 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:11.778421  8882 leader_election.cc:343] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.790091  9013 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.795614  8666 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.796391  8959 raft_consensus.cc:359] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.797924  8959 raft_consensus.cc:385] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.798343  8959 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.797497  8666 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.797003  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.802554  8959 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.798874  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.804557  8768 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:11.804410  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.805349  8844 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:11.806363  8807 leader_election.cc:343] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.797307  9031 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:11.807925  8808 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.812578  9013 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.813526  9013 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.814028  9013 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.814316  8959 ts_tablet_manager.cc:1434] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:15:11.815558  8959 tablet_bootstrap.cc:492] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.817480  8844 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:11.821257  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:11.828795  9031 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.833016  9031 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:11.833575  9013 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.833976  9031 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.837425  9013 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.841007  8960 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:11.841131  8959 tablet_bootstrap.cc:654] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.841845  8960 ts_tablet_manager.cc:1403] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.015s
I20260709 13:15:11.842024  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:11.849056  8768 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.854092  8960 raft_consensus.cc:359] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.855018  8960 raft_consensus.cc:385] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.844338  8958 tablet_bootstrap.cc:654] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.845947  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:11.857120  8807 leader_election.cc:343] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.859579  9064 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.855298  8960 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.862128  8960 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.863708  8960 ts_tablet_manager.cc:1434] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:15:11.864039  8959 tablet_bootstrap.cc:492] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.864528  8959 ts_tablet_manager.cc:1403] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.008s
I20260709 13:15:11.864581  8960 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:11.867041  8959 raft_consensus.cc:359] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.867609  8959 raft_consensus.cc:385] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.867875  8959 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.868561  8959 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.872795  8768 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:11.875188  8808 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.876629  9032 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.877269  9032 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:11.878325  9032 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.881796  8959 ts_tablet_manager.cc:1434] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:11.887566  8959 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.889567  8960 tablet_bootstrap.cc:654] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.900669  8959 tablet_bootstrap.cc:654] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.905678  8958 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.906312  8958 ts_tablet_manager.cc:1403] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.009s
I20260709 13:15:11.907516  8666 catalog_manager.cc:5697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:11.908492  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:11.917757  8665 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.920819  8960 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:11.920814  8958 raft_consensus.cc:359] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.921568  8960 ts_tablet_manager.cc:1403] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.008s
I20260709 13:15:11.921742  8958 raft_consensus.cc:385] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.922128  8958 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.922888  8958 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.924630  8960 raft_consensus.cc:359] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.925268  8958 ts_tablet_manager.cc:1434] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:15:11.926426  8958 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.928225  8959 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:11.928915  8959 ts_tablet_manager.cc:1403] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260709 13:15:11.925366  8960 raft_consensus.cc:385] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.929500  8960 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.930691  8960 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.932716  8960 ts_tablet_manager.cc:1434] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:15:11.933149  8958 tablet_bootstrap.cc:654] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.934089  8960 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:11.934499  8959 raft_consensus.cc:359] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.939836  8959 raft_consensus.cc:385] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.940152  8959 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.940560  8958 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:11.941020  8958 ts_tablet_manager.cc:1403] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:15:11.940995  8959 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.944052  8958 raft_consensus.cc:359] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.944736  8958 raft_consensus.cc:385] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.945017  8958 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.945736  8958 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.943279  8959 ts_tablet_manager.cc:1434] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:15:11.948096  9077 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.948724  8959 tablet_bootstrap.cc:492] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:11.948637  9077 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.949522  8958 ts_tablet_manager.cc:1434] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:11.950450  8958 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:11.952498  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.953213  8842 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:11.954757  8735 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:11.955490  8959 tablet_bootstrap.cc:654] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.955699  8983 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.956079  8983 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.956445  8958 tablet_bootstrap.cc:654] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.956398  8983 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.957726  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.958395  8916 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:11.959153  8960 tablet_bootstrap.cc:654] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.960057  9077 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.966806  8983 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.967350  9077 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.968050  9077 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.970757  9077 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.972230  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.973289  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:11.974100  8842 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:11.975430  8735 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.976583  9077 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.982141  8983 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.983474  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:11.984042  8842 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.985105  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:11.985635  8916 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.987500  9032 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.987979  9077 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.987977  9032 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:11.990018  9032 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:11.991034  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:11.991382  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:11.992115  8918 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:11.993032  9031 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:11.993508  8807 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:11.994669  9032 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.001612  9032 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.013670  9031 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.016083  8958 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:12.016590  8958 ts_tablet_manager.cc:1403] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.000s
I20260709 13:15:12.019220  8958 raft_consensus.cc:359] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.019884  8958 raft_consensus.cc:385] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.020155  8958 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.020427  8842 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:12.020776  8959 tablet_bootstrap.cc:492] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.021270  8959 ts_tablet_manager.cc:1403] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.009s
I20260709 13:15:12.021561  8735 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.021633  8960 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:12.022418  8960 ts_tablet_manager.cc:1403] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.006s
I20260709 13:15:12.022740  9077 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.023895  9077 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:12.023880  8959 raft_consensus.cc:359] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.024895  8960 raft_consensus.cc:359] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.024927  9077 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.021939  8958 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.024670  8959 raft_consensus.cc:385] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.028504  8959 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.025655  8960 raft_consensus.cc:385] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.029265  8960 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.029229  8959 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.031354  8959 ts_tablet_manager.cc:1434] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:12.030448  8960 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.032460  8959 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.033221  8958 ts_tablet_manager.cc:1434] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:12.033911  8960 ts_tablet_manager.cc:1434] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:12.034171  8958 tablet_bootstrap.cc:492] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:12.034822  8960 tablet_bootstrap.cc:492] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:12.039269  8959 tablet_bootstrap.cc:654] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.043161  9032 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.043706  9032 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.045814  9032 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.047535  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.048595  8918 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:12.050168  8807 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.050364  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.050848  8959 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.051030  8767 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:12.051328  8959 ts_tablet_manager.cc:1403] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:15:12.051110  9032 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.052198  9032 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.052567  9032 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.054220  8959 raft_consensus.cc:359] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.054939  8959 raft_consensus.cc:385] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.055222  8959 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.055966  8960 tablet_bootstrap.cc:654] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.056274  8959 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.058763  8959 ts_tablet_manager.cc:1434] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:12.059705  8959 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.061275  9032 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.065598  8959 tablet_bootstrap.cc:654] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.067453  8960 tablet_bootstrap.cc:492] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:12.067730  8958 tablet_bootstrap.cc:654] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.067922  8960 ts_tablet_manager.cc:1403] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.003s
I20260709 13:15:12.070776  8960 raft_consensus.cc:359] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.071537  8960 raft_consensus.cc:385] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.071622  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:12.071918  8960 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.062700  8664 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.072521  8767 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.072881  8960 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.071106  8916 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:12.075209  8960 ts_tablet_manager.cc:1434] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:12.078310  8960 tablet_bootstrap.cc:492] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:12.081322  9077 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.078641  8959 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.083220  8916 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:12.083402  8959 ts_tablet_manager.cc:1403] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.009s
I20260709 13:15:12.086179  9013 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.083810  9032 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.084026  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:12.089334  8918 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.089685  9077 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.090430  9077 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.091125  8959 raft_consensus.cc:359] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.091828  8959 raft_consensus.cc:385] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.092351  8959 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.084228  8767 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:12.093276  8959 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.093883  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.094180  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.094542  8842 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:12.095816  9032 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.096262  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.096719  8959 ts_tablet_manager.cc:1434] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:15:12.097179  8983 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.097539  8983 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.097716  8959 tablet_bootstrap.cc:492] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.097879  8983 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.105571  9077 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.105793  8959 tablet_bootstrap.cc:654] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.096300  9032 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:12.107547  9032 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.115345  8983 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.125304  8958 tablet_bootstrap.cc:492] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:12.125981  8958 ts_tablet_manager.cc:1403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.000s
I20260709 13:15:12.126201  8918 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:12.126803  9082 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.131155  8960 tablet_bootstrap.cc:654] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.132371  8966 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.132899  8966 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.142982  8966 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:12.143736  8958 raft_consensus.cc:359] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.143854  8965 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.144475  8958 raft_consensus.cc:385] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.144793  8958 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.144704  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.145689  8958 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.146008  8965 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.145825  8842 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:12.148082  8958 ts_tablet_manager.cc:1434] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:15:12.151839  8958 tablet_bootstrap.cc:492] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:12.148541  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.149914  8965 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.156719  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:12.158254  8735 leader_election.cc:343] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.159142  8966 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.159685  8966 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.160065  8966 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.163038  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:12.169620  8732 leader_election.cc:343] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.171391  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:12.172827  8732 leader_election.cc:343] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.173357  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:12.174392  8965 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.174612  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.175348  8768 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:12.179659  8960 tablet_bootstrap.cc:492] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:12.180298  8960 ts_tablet_manager.cc:1403] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.015s
I20260709 13:15:12.193763  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.194566  8843 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.198966  8965 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.200457  8965 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.207242  8965 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.202432  8960 raft_consensus.cc:359] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.210363  8960 raft_consensus.cc:385] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.210703  8960 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.211826  8960 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.197242  8983 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.228107  9013 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.228924  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.229759  8842 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:12.230224  8768 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:12.232412  9032 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.235579  9013 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.241945  8667 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.220984  8965 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:15:12.237669  8966 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.246533  8966 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:12.247247  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:12.248203  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.250916  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:12.253515  8767 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:12.257251  8732 leader_election.cc:343] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.258097  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:12.259054  8983 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.263557  8767 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:12.263779  9013 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.264822  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.266173  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.266609  8960 ts_tablet_manager.cc:1434] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:15:12.268581  8960 tablet_bootstrap.cc:492] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:12.266717  8966 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:12.273466  8807 leader_election.cc:343] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.273612  8966 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:12.274938  8966 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.275707  8983 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.295432  8918 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.303529  8959 tablet_bootstrap.cc:492] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.303975  8959 ts_tablet_manager.cc:1403] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.206s	user 0.064s	sys 0.053s
I20260709 13:15:12.298975  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.279266  8843 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:12.306425  8958 tablet_bootstrap.cc:654] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.306468  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.316331  8983 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:12.316646  8808 leader_election.cc:343] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.317261  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:12.318545  9013 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.306628  8844 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.308426  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:12.323030  8983 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.323544  8983 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:12.324417  8983 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.361609  8959 raft_consensus.cc:359] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.362735  8959 raft_consensus.cc:385] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.363281  8959 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.376890  8959 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.379282  8960 tablet_bootstrap.cc:654] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.390069  8959 ts_tablet_manager.cc:1434] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:15:12.392757  9031 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.395984  8959 tablet_bootstrap.cc:492] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.401154  9005 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.401705  9005 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.402849  8958 tablet_bootstrap.cc:492] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:12.403354  8958 ts_tablet_manager.cc:1403] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.255s	user 0.038s	sys 0.020s
I20260709 13:15:12.407214  9013 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.410610  9005 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:12.412583  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.413934  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.414947  8767 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:12.416518  8882 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.416842  8844 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:12.421821  8664 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.428618  8959 tablet_bootstrap.cc:654] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.432749  9013 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.432366  8958 raft_consensus.cc:359] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.433326  9013 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.433415  8958 raft_consensus.cc:385] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.443307  8958 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.445375  8958 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.441241  9031 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.446326  9031 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.447312  8958 ts_tablet_manager.cc:1434] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:15:12.446877  8665 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.448432  8958 tablet_bootstrap.cc:492] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:12.448491  9031 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:12.437021  8966 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:12.437137  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.458468  8768 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:12.459460  9005 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:12.461297  9005 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:12.461779  9005 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.464526  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:12.466248  8882 leader_election.cc:343] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.435446  9013 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.440662  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.490592  8960 tablet_bootstrap.cc:492] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:12.491074  8960 ts_tablet_manager.cc:1403] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.223s	user 0.018s	sys 0.035s
I20260709 13:15:12.497170  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.498078  8808 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.499632  8958 tablet_bootstrap.cc:654] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.501076  9013 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:12.511592  8807 leader_election.cc:343] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.512017  8959 tablet_bootstrap.cc:492] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.512650  8959 ts_tablet_manager.cc:1403] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.005s
I20260709 13:15:12.514335  9032 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.515067  8958 tablet_bootstrap.cc:492] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:12.515678  8958 ts_tablet_manager.cc:1403] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.004s
I20260709 13:15:12.508574  9013 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.518474  8959 raft_consensus.cc:359] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.518985  9013 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:12.518997  8884 leader_election.cc:343] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.520298  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:12.521071  9004 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.519183  8959 raft_consensus.cc:385] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.522341  8959 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.522065  8960 raft_consensus.cc:359] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.522797  8960 raft_consensus.cc:385] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.523072  8960 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.523154  8959 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.523707  8960 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.524151  9005 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.525758  8960 ts_tablet_manager.cc:1434] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:15:12.526875  8960 tablet_bootstrap.cc:492] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:12.557476  9004 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.558521  8958 raft_consensus.cc:359] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.559257  8958 raft_consensus.cc:385] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.560048  8958 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.561650  8959 ts_tablet_manager.cc:1434] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.049s	user 0.017s	sys 0.013s
I20260709 13:15:12.558013  9004 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.560484  8983 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.564741  8983 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.569689  8959 tablet_bootstrap.cc:492] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.567118  8983 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.579030  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.579774  8917 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:12.581633  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.582865  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.582594  8958 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.601814  8768 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:12.608158  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:12.608935  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.609225  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.610532  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.611440  9031 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.611827  9031 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.612169  9031 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:12.612811  8884 leader_election.cc:343] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.613787  8959 tablet_bootstrap.cc:654] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.613598  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:12.581681  9004 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:12.603605  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.617957  9005 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:12.618124  8983 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.618515  8983 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.618851  8983 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.616679  8966 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:12.620975  8735 leader_election.cc:343] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.625612  8958 ts_tablet_manager.cc:1434] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.109s	user 0.024s	sys 0.021s
I20260709 13:15:12.626478  8918 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:12.627068  8958 tablet_bootstrap.cc:492] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:12.628654  8964 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.629071  9077 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.636016  9033 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.605290  9013 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.638687  9013 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.639595  9127 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.640309  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:12.642549  8767 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.643497  9127 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:12.651974  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:12.655136  8807 leader_election.cc:343] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.657757  9127 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.662721  9127 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.667603  8983 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.659087  8767 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:12.676997  8960 tablet_bootstrap.cc:654] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.679675  8808 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:12.680903  8964 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.681018  8959 tablet_bootstrap.cc:492] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.681437  8964 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:12.681334  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.681977  8959 ts_tablet_manager.cc:1403] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.112s	user 0.025s	sys 0.023s
I20260709 13:15:12.682351  8964 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:12.684842  8735 leader_election.cc:343] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.688408  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:12.692349  8958 tablet_bootstrap.cc:654] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.691460  9013 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.692957  8966 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.697533  8959 raft_consensus.cc:359] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.699990  8959 raft_consensus.cc:385] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.700290  8959 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.700979  8959 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.702517  8959 ts_tablet_manager.cc:1434] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:15:12.703449  8959 tablet_bootstrap.cc:492] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.716326  9013 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.719132  9005 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.724866  9031 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.687258  8983 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.731293  8918 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:12.752976  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:12.748569  8983 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.763055  8983 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.767097  8983 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.765501  9033 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.769521  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.771118  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:12.771993  8840 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:12.772702  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:12.773515  8769 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:12.771308  9031 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:12.774848  8884 leader_election.cc:343] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.775143  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.774889  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.778421  9033 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.778932  9033 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.779394  9033 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.810635  8964 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.811359  8964 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.814430  8983 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.815253  8983 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.819279  8983 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.819514  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:12.821135  8735 leader_election.cc:343] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.836337  8959 tablet_bootstrap.cc:654] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.842139  9033 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:12.847751  8732 consensus_peers.cc:597] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:12.850832  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:12.851259  8958 tablet_bootstrap.cc:492] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:12.851543  8766 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:12.850975  9076 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.851766  8958 ts_tablet_manager.cc:1403] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.225s	user 0.014s	sys 0.006s
I20260709 13:15:12.852849  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.856292  8964 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:12.857479  8732 leader_election.cc:343] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.857908  8964 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.855377  8664 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.858282  8964 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.858218  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.861148  8841 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.861361  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.861843  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:12.862061  8915 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:12.862448  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:12.864310  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:12.859858  8958 raft_consensus.cc:359] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.866067  8958 raft_consensus.cc:385] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.866391  8958 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.865694  8964 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.870514  9033 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.877200  8960 tablet_bootstrap.cc:492] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:12.877727  8960 ts_tablet_manager.cc:1403] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.351s	user 0.017s	sys 0.026s
I20260709 13:15:12.876015  8958 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.878135  9005 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.878676  8841 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:12.880542  8960 raft_consensus.cc:359] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.881304  8960 raft_consensus.cc:385] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.881593  8960 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.882001  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:12.882637  8960 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.886401  8960 ts_tablet_manager.cc:1434] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:12.891280  8960 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:12.889063  9033 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.893311  9033 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:12.893249  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:12.894302  9076 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.894762  9076 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.894347  9033 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.895093  9076 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.908183  8958 ts_tablet_manager.cc:1434] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.002s
I20260709 13:15:12.909442  8958 tablet_bootstrap.cc:492] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:12.917867  8959 tablet_bootstrap.cc:492] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:12.918228  8958 tablet_bootstrap.cc:654] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.922988  8959 ts_tablet_manager.cc:1403] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.220s	user 0.011s	sys 0.011s
I20260709 13:15:12.929741  8960 tablet_bootstrap.cc:654] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.930799  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:12.924072  8964 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.935815  8964 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.939150  8959 raft_consensus.cc:359] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.939836  8959 raft_consensus.cc:385] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.940081  8959 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.940405  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:12.940734  8959 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.941025  8916 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.947685  8916 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:12.948961  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:12.949783  9127 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.916682  9076 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.950270  9127 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:12.951099  9127 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:12.953905  9076 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:12.960014  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:12.961105  8844 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.963608  8959 ts_tablet_manager.cc:1434] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
W20260709 13:15:12.964972  8732 leader_election.cc:343] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.967965  8959 tablet_bootstrap.cc:492] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:12.973410  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:12.974056  8918 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.974953  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:12.975526  8766 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.982123  8960 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:12.982621  8960 ts_tablet_manager.cc:1403] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.092s	user 0.008s	sys 0.014s
I20260709 13:15:12.993758  8664 catalog_manager.cc:5697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.003755  8918 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.009509  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:13.014488  8766 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:13.016759  9076 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.018276  9076 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:13.021513  8960 raft_consensus.cc:359] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.023435  8960 raft_consensus.cc:385] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.023188  9076 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.023716  8960 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.024524  8960 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.029748  8960 ts_tablet_manager.cc:1434] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:15:13.030694  8960 tablet_bootstrap.cc:492] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.032991  8959 tablet_bootstrap.cc:654] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.036626  8844 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
W20260709 13:15:13.033535  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:13.049013  8958 tablet_bootstrap.cc:492] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.049548  8958 ts_tablet_manager.cc:1403] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.000s
I20260709 13:15:13.050393  8665 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.052214  8958 raft_consensus.cc:359] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.052901  8958 raft_consensus.cc:385] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.053193  8958 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.054754  8960 tablet_bootstrap.cc:654] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.054301  8958 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.063477  8959 tablet_bootstrap.cc:492] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.063895  8959 ts_tablet_manager.cc:1403] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.002s
I20260709 13:15:13.064446  8960 tablet_bootstrap.cc:492] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.064900  8960 ts_tablet_manager.cc:1403] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:15:13.065908  8959 raft_consensus.cc:359] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.066429  8959 raft_consensus.cc:385] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.066666  8959 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.067302  8959 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.067345  8960 raft_consensus.cc:359] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.068041  8960 raft_consensus.cc:385] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.068325  8960 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.069208  8959 ts_tablet_manager.cc:1434] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:13.069350  8958 ts_tablet_manager.cc:1434] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:15:13.069092  8960 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.070293  8958 tablet_bootstrap.cc:492] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.071029  8960 ts_tablet_manager.cc:1434] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:15:13.072233  8960 tablet_bootstrap.cc:492] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.074324  9076 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.074827  9076 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.077554  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.077546  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.078195  8960 tablet_bootstrap.cc:654] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.078223  8844 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
W20260709 13:15:13.079202  8732 leader_election.cc:343] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.079979  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.080818  8983 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.081177  8983 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.081476  8983 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.081670  8959 tablet_bootstrap.cc:492] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.087030  9076 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.087706  8959 tablet_bootstrap.cc:654] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.089181  8983 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.090896  8960 tablet_bootstrap.cc:492] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.091459  8960 ts_tablet_manager.cc:1403] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 13:15:13.093959  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:13.094213  8960 raft_consensus.cc:359] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.094775  8844 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.094969  8960 raft_consensus.cc:385] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.095311  8960 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.095932  8960 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.098759  8960 ts_tablet_manager.cc:1434] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:13.100266  8960 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.105321  9127 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.107162  8960 tablet_bootstrap.cc:654] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.115267  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:13.119285  8960 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.119769  8960 ts_tablet_manager.cc:1403] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
W20260709 13:15:13.123245  8807 consensus_peers.cc:597] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:13.116175  8918 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.125125  8960 raft_consensus.cc:359] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.125856  8960 raft_consensus.cc:385] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.125414  8664 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.126360  8960 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.127092  8960 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.129484  8983 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.130312  8958 tablet_bootstrap.cc:654] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.130386  8960 ts_tablet_manager.cc:1434] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:15:13.131525  8960 tablet_bootstrap.cc:492] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.144300  8844 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.146245  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:13.147447  8983 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.147887  8983 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:13.148942  8983 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.155218  8960 tablet_bootstrap.cc:654] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.161197  8918 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.173955  8959 tablet_bootstrap.cc:492] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.175326  8959 ts_tablet_manager.cc:1403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.094s	user 0.038s	sys 0.036s
I20260709 13:15:13.176736  8664 catalog_manager.cc:5697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.179196  8959 raft_consensus.cc:359] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.180264  8959 raft_consensus.cc:385] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.180696  8959 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.181651  8959 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.184324  8959 ts_tablet_manager.cc:1434] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:13.185801  8959 tablet_bootstrap.cc:492] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.202579  8959 tablet_bootstrap.cc:654] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.215716  8959 tablet_bootstrap.cc:492] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.216455  8959 ts_tablet_manager.cc:1403] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.010s
I20260709 13:15:13.219331  8959 raft_consensus.cc:359] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.220119  8959 raft_consensus.cc:385] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.220430  8959 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.220467  8958 tablet_bootstrap.cc:492] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.221262  8958 ts_tablet_manager.cc:1403] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.039s
I20260709 13:15:13.221371  8959 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.225976  8958 raft_consensus.cc:359] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.227814  8960 tablet_bootstrap.cc:492] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.229604  8959 ts_tablet_manager.cc:1434] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:15:13.230593  8959 tablet_bootstrap.cc:492] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.231226  8960 ts_tablet_manager.cc:1403] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.045s
I20260709 13:15:13.234658  8960 raft_consensus.cc:359] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.235455  8960 raft_consensus.cc:385] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.235771  8960 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.236133  8958 raft_consensus.cc:385] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.236496  8958 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.236538  8959 tablet_bootstrap.cc:654] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.236624  8960 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.237394  8958 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.239298  8960 ts_tablet_manager.cc:1434] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:13.240298  8960 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.246853  8960 tablet_bootstrap.cc:654] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.250516  9076 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.251066  9076 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.253160  9076 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.253769  8958 ts_tablet_manager.cc:1434] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:15:13.254801  8958 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.255306  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:13.257247  8735 leader_election.cc:343] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.259398  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.260354  8918 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:13.260982  8958 tablet_bootstrap.cc:654] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.263085  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:13.264269  9076 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.264655  9076 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.264937  8959 tablet_bootstrap.cc:492] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.265040  9076 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.265439  8959 ts_tablet_manager.cc:1403] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.016s
I20260709 13:15:13.268146  8959 raft_consensus.cc:359] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.268806  8959 raft_consensus.cc:385] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.269111  8959 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.270316  8959 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.274787  8959 ts_tablet_manager.cc:1434] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:13.276751  8959 tablet_bootstrap.cc:492] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.282723  8918 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.291838  8959 tablet_bootstrap.cc:654] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.306118  8959 tablet_bootstrap.cc:492] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.306936  8959 ts_tablet_manager.cc:1403] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 13:15:13.307723  8958 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.308257  8958 ts_tablet_manager.cc:1403] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.009s
I20260709 13:15:13.310532  8959 raft_consensus.cc:359] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.310910  8958 raft_consensus.cc:359] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.311581  8959 raft_consensus.cc:385] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.311899  8958 raft_consensus.cc:385] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.312029  8959 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.312492  8958 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.313400  8958 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.313274  8959 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.315873  8958 ts_tablet_manager.cc:1434] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:15:13.315928  8959 ts_tablet_manager.cc:1434] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:15:13.317466  8958 tablet_bootstrap.cc:492] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.318255  9076 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.318989  8959 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.323135  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:13.324551  9076 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.327250  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:13.327991  8916 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.328336  8958 tablet_bootstrap.cc:654] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.319392  9031 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.330912  8960 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.330694  9031 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.331449  8960 ts_tablet_manager.cc:1403] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.028s
I20260709 13:15:13.334582  8960 raft_consensus.cc:359] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:13.334991  8735 leader_election.cc:343] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.335278  8960 raft_consensus.cc:385] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.335659  8960 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.335892  8959 tablet_bootstrap.cc:654] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.336525  8960 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.339423  8960 ts_tablet_manager.cc:1434] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:13.339174  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.340230  8767 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:13.340615  8960 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.353295  8966 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.353602  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:13.354465  9065 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.354089  8966 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.354868  9065 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.355283  9065 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.358349  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.359113  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.359319  8966 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:13.360241  8844 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:13.364967  8960 tablet_bootstrap.cc:654] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.366768  8915 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.370245  9031 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:13.370890  9031 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.370956  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.371744  9031 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:13.373255  8884 leader_election.cc:343] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.376349  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.380980  8960 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.381492  8960 ts_tablet_manager.cc:1403] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.002s
I20260709 13:15:13.382091  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:13.384290  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.405833  8960 raft_consensus.cc:359] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.406898  8960 raft_consensus.cc:385] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.407241  8960 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.408221  8960 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.417282  8960 ts_tablet_manager.cc:1434] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.000s
I20260709 13:15:13.418509  8960 tablet_bootstrap.cc:492] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.425033  8882 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:13.445835  8966 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.425143  9031 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:13.423902  9065 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.441193  9140 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:13.449718  9127 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.450994  9004 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.443813  9076 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.452491  9076 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.456691  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:13.458784  8735 leader_election.cc:343] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.460707  9033 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.461366  9033 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.462098  9076 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.464015  9033 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.468608  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.472833  9033 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:13.474695  8844 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:13.476467  8960 tablet_bootstrap.cc:654] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.477489  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:13.478375  9076 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.478775  9076 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.479130  9076 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.482026  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:13.482749  8766 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.484261  9033 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.488370  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:13.492697  9033 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.494786  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.495905  8766 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:13.438318  8916 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.497823  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.482034  8959 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.499234  8959 ts_tablet_manager.cc:1403] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.180s	user 0.061s	sys 0.040s
I20260709 13:15:13.499536  8958 tablet_bootstrap.cc:492] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.500051  8958 ts_tablet_manager.cc:1403] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.183s	user 0.023s	sys 0.032s
W20260709 13:15:13.501567  8884 leader_election.cc:343] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.502019  8959 raft_consensus.cc:359] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.503033  8959 raft_consensus.cc:385] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.503325  8959 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.504742  8959 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.507215  8959 ts_tablet_manager.cc:1434] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:13.505249  8958 raft_consensus.cc:359] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.508136  8958 raft_consensus.cc:385] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.508826  8958 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.509997  8958 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.508211  8959 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.511314  9140 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.515766  9140 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.517445  8958 ts_tablet_manager.cc:1434] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.006s
I20260709 13:15:13.519091  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.522027  8766 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:13.523061  8958 tablet_bootstrap.cc:492] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.520186  9140 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.520711  8959 tablet_bootstrap.cc:654] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.530305  9065 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:13.510720  9076 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.531286  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.532222  8917 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:13.533581  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.534740  9140 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.535656  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:13.536283  8840 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.539842  8958 tablet_bootstrap.cc:654] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.541728  9140 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.549577  9076 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.550846  9065 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.551324  9065 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.554440  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:13.555704  8884 leader_election.cc:343] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.557461  8840 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.558570  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:13.559751  9076 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.560396  9076 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:13.561235  9076 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:13.563270  8732 leader_election.cc:343] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.563856  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.565071  9033 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.565171  9065 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:13.566684  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:13.568567  9033 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.569046  9033 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:13.569854  9033 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.582413  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:13.584909  9065 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.585450  9065 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:13.586233  9065 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.589099  8960 tablet_bootstrap.cc:492] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.592415  8960 ts_tablet_manager.cc:1403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.174s	user 0.026s	sys 0.019s
I20260709 13:15:13.594982  9076 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.595676  9076 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.596956  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.598757  9076 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.600595  8960 raft_consensus.cc:359] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.598986  8959 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.601869  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.602331  8960 raft_consensus.cc:385] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.604234  8960 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
W20260709 13:15:13.598912  8732 leader_election.cc:343] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.603430  8959 ts_tablet_manager.cc:1403] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.007s
I20260709 13:15:13.607744  8959 raft_consensus.cc:359] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.610426  8959 raft_consensus.cc:385] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.611290  8959 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.612784  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:13.608546  8960 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.613696  8915 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:13.615001  8735 leader_election.cc:343] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.613000  8959 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.618705  8958 tablet_bootstrap.cc:492] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.619810  8958 ts_tablet_manager.cc:1403] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.003s
I20260709 13:15:13.622666  8958 raft_consensus.cc:359] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.623024  8915 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.623402  8958 raft_consensus.cc:385] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.623795  8958 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.624368  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.624737  8958 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.627235  8958 ts_tablet_manager.cc:1434] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:13.628425  8958 tablet_bootstrap.cc:492] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.615408  8960 ts_tablet_manager.cc:1434] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:13.631024  8960 tablet_bootstrap.cc:492] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.632642  9177 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:13.635358  8732 leader_election.cc:343] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.635808  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.636333  8959 ts_tablet_manager.cc:1434] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:15:13.637358  8959 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.637622  9175 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:13.638772  8882 leader_election.cc:343] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.639223  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:13.642621  9065 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.643985  8959 tablet_bootstrap.cc:654] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.645927  9076 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.646710  9076 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.649324  8960 tablet_bootstrap.cc:654] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.649783  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.650405  8841 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:13.650244  8667 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.651832  8735 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:13.652747  9175 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:13.653213  9175 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:13.653682  9175 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.651973  8667 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.659272  8958 tablet_bootstrap.cc:654] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.680007  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.680732  8915 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.681030  8917 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:13.671147  9175 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.696789  8983 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.697214  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:13.697970  8841 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.703895  9140 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.704596  9140 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.706861  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:13.707581  8917 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.709779  9140 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.712370  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.672216  9076 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:13.714493  8808 leader_election.cc:343] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.716779  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:13.719426  8807 leader_election.cc:343] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.719851  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.720498  9140 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.722787  8960 tablet_bootstrap.cc:492] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.723218  8960 ts_tablet_manager.cc:1403] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.029s
I20260709 13:15:13.727533  8960 raft_consensus.cc:359] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.728253  8960 raft_consensus.cc:385] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.728572  8960 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.695827  9175 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.729277  8960 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.734920  8960 ts_tablet_manager.cc:1434] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:13.736054  8960 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.735837  9175 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:13.735838  9140 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.738531  9140 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.744285  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:13.744462  9140 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.669368  8665 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.745630  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.746730  8918 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:13.748127  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.749981  9140 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:13.750337  8841 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.751554  8735 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:13.752691  9175 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:13.753253  9175 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:13.754156  9175 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.755651  8958 tablet_bootstrap.cc:492] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.756129  8958 ts_tablet_manager.cc:1403] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.128s	user 0.024s	sys 0.022s
I20260709 13:15:13.757493  8959 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.757969  8959 ts_tablet_manager.cc:1403] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.003s
I20260709 13:15:13.760849  8959 raft_consensus.cc:359] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.764216  8959 raft_consensus.cc:385] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.764539  8959 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.765349  8959 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.762270  9140 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.775730  8959 ts_tablet_manager.cc:1434] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:15:13.780558  8959 tablet_bootstrap.cc:492] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.784030  8960 tablet_bootstrap.cc:654] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.762776  8917 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:13.794230  8958 raft_consensus.cc:359] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.800161  8958 raft_consensus.cc:385] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.810271  8959 tablet_bootstrap.cc:654] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.815171  8665 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.800483  8958 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.820143  8958 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.837091  8958 ts_tablet_manager.cc:1434] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.000s
I20260709 13:15:13.838330  8958 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.847611  8958 tablet_bootstrap.cc:654] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.847750  8960 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.848198  8960 ts_tablet_manager.cc:1403] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.007s
I20260709 13:15:13.851264  8960 raft_consensus.cc:359] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.852260  8960 raft_consensus.cc:385] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.852620  8960 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.853498  8960 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.855692  8960 ts_tablet_manager.cc:1434] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:13.857158  8960 tablet_bootstrap.cc:492] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.859422  8959 tablet_bootstrap.cc:492] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.860085  8959 ts_tablet_manager.cc:1403] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.012s
I20260709 13:15:13.866010  8959 raft_consensus.cc:359] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.867138  8959 raft_consensus.cc:385] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.867522  8959 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.868431  8959 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.870872  8959 ts_tablet_manager.cc:1434] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:13.872331  8959 tablet_bootstrap.cc:492] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.874961  8958 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.875522  8958 ts_tablet_manager.cc:1403] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.011s
I20260709 13:15:13.876264  8960 tablet_bootstrap.cc:654] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.878489  8959 tablet_bootstrap.cc:654] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.878842  8958 raft_consensus.cc:359] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.879603  8958 raft_consensus.cc:385] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.879928  8958 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.880671  8958 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.883329  8958 ts_tablet_manager.cc:1434] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:13.884620  8958 tablet_bootstrap.cc:492] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.890686  8958 tablet_bootstrap.cc:654] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.914350  8959 tablet_bootstrap.cc:492] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.914808  8959 ts_tablet_manager.cc:1403] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 13:15:13.917586  8959 raft_consensus.cc:359] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.918088  8960 tablet_bootstrap.cc:492] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:13.918402  8959 raft_consensus.cc:385] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.918637  8960 ts_tablet_manager.cc:1403] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.062s	user 0.024s	sys 0.020s
I20260709 13:15:13.918809  8959 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.919591  8958 tablet_bootstrap.cc:492] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:13.919523  8959 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.920046  8958 ts_tablet_manager.cc:1403] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.007s
I20260709 13:15:13.921792  8959 ts_tablet_manager.cc:1434] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:15:13.921499  8960 raft_consensus.cc:359] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.922200  8960 raft_consensus.cc:385] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.922488  8960 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.923076  8958 raft_consensus.cc:359] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.923813  8958 raft_consensus.cc:385] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:13.923514  8960 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.924077  8958 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:13.924765  8958 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.926440  8960 ts_tablet_manager.cc:1434] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:13.926885  8958 ts_tablet_manager.cc:1434] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:13.927865  8959 tablet_bootstrap.cc:492] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:13.927824  9175 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.928634  8958 tablet_bootstrap.cc:492] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:13.928434  9175 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.932071  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.927865  8960 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:13.932322  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:13.933620  8735 leader_election.cc:343] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.933621  9076 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.934408  9076 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:13.935403  8959 tablet_bootstrap.cc:654] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.936415  9076 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.930989  9175 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:13.938690  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:13.942982  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:13.946260  8960 tablet_bootstrap.cc:654] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.946475  8958 tablet_bootstrap.cc:654] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:13.947983  8959 tablet_bootstrap.cc:492] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:13.948505  8959 ts_tablet_manager.cc:1403] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.002s
W20260709 13:15:13.982255  8732 leader_election.cc:343] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.983593  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:13.985129  8735 leader_election.cc:343] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:13.988478  8732 leader_election.cc:343] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:13.994831  8732 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:13.991060  9127 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:13.996599  9175 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.991379  8964 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.002445  9127 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.006366  8960 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:14.007722  8960 ts_tablet_manager.cc:1403] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.000s
I20260709 13:15:13.993268  9076 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:13.997807  8964 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.013655  8964 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.017316  8958 tablet_bootstrap.cc:492] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:14.018481  8958 ts_tablet_manager.cc:1403] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.002s
I20260709 13:15:14.031399  9177 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:14.033171  8958 raft_consensus.cc:359] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.034353  8958 raft_consensus.cc:385] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.034916  8958 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.035924  8958 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.043588  8958 ts_tablet_manager.cc:1434] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 13:15:14.043286  8960 raft_consensus.cc:359] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.046384  8960 raft_consensus.cc:385] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.046736  8960 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.046468  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.047576  8766 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:14.047544  8960 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.050024  9127 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.051146  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.051613  9065 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.052475  9065 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.051651  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.053653  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.055359  9065 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:14.051999  8918 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:14.055799  8964 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.056334  8964 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.056727  8964 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.059290  9076 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:14.060102  9076 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.062911  9076 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.065049  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.066126  8915 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:14.067762  8958 tablet_bootstrap.cc:492] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:14.070066  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.071044  8844 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:14.068570  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.055794  8960 ts_tablet_manager.cc:1434] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.003s
I20260709 13:15:14.078351  8960 tablet_bootstrap.cc:492] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
W20260709 13:15:14.088292  8884 leader_election.cc:343] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.092549  8959 raft_consensus.cc:359] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.093506  8959 raft_consensus.cc:385] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.093874  8959 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.095012  8959 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.100013  8735 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.101375  9175 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:14.101831  9175 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:14.102260  9175 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.101315  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.113557  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.115098  8918 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:14.129575  8959 ts_tablet_manager.cc:1434] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.181s	user 0.005s	sys 0.004s
I20260709 13:15:14.130935  9065 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:14.135902  8964 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.123409  9175 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.121888  9127 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.145394  9127 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.147831  8960 tablet_bootstrap.cc:654] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.148295  9127 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.156482  8959 tablet_bootstrap.cc:492] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:14.160477  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.161586  9127 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.169322  9127 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.168236  8767 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:14.170336  8840 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.171643  8964 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.172488  9127 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.167258  8958 tablet_bootstrap.cc:654] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.174682  9199 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.175510  9175 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.179014  8807 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:14.175310  9199 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.181293  9140 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:14.185256  9140 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.185700  9140 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:14.190125  8882 leader_election.cc:343] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.190632  8882 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:14.191501  8966 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.192821  9199 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:14.194211  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.194981  8841 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:14.196753  8884 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:14.199286  8966 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.200171  8966 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.200594  8966 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.207370  9140 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.210654  8959 tablet_bootstrap.cc:654] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.210803  8966 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:14.211110  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:14.213747  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.219550  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:14.223618  9140 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.223912  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.225265  8918 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:14.226552  8960 tablet_bootstrap.cc:492] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:14.227126  8960 ts_tablet_manager.cc:1403] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.002s
I20260709 13:15:14.227295  8964 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.228148  8964 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.231003  8964 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.230054  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.233855  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.234417  8918 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.235327  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.236207  9127 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.236615  9127 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.236994  9127 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.239295  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:14.240155  8840 raft_consensus.cc:2368] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3.
I20260709 13:15:14.241021  8983 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:14.242920  8983 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:14.245138  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.246794  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.247802  8960 raft_consensus.cc:359] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.248684  8960 raft_consensus.cc:385] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.256399  8960 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.246843  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.251394  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.262506  8915 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.262746  8960 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.263559  8958 tablet_bootstrap.cc:492] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:14.264103  8958 ts_tablet_manager.cc:1403] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.002s
I20260709 13:15:14.251468  8983 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:14.254119  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.265372  8768 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:14.254231  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.266187  8767 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.248137  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.258150  9065 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.266994  8766 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:14.289175  9076 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.285483  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:14.267140  8960 ts_tablet_manager.cc:1434] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:15:14.294451  8842 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.294139  9076 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.282950  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.267055  9065 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.296325  8768 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.297307  9076 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.295995  8960 tablet_bootstrap.cc:492] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:14.259238  8966 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:14.277827  8958 raft_consensus.cc:359] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.266716  9127 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.298795  8958 raft_consensus.cc:385] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.299165  8958 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.281790  9199 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:14.299738  9065 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:14.305014  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55033.8us
I20260709 13:15:14.304958  8958 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.301182  9127 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:14.308235  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46951.1us
I20260709 13:15:14.273975  8915 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:14.309206  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.309352  8735 leader_election.cc:400] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3.
I20260709 13:15:14.309758  8735 leader_election.cc:403] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:14.311448  9206 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.311693  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.312395  8769 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.317708  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.320875  8918 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:14.311910  9206 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.327947  8766 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:14.328909  8983 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3.
I20260709 13:15:14.331633  8960 tablet_bootstrap.cc:654] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.331904  8983 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.335812  8808 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.332782  8983 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.340833  8959 tablet_bootstrap.cc:492] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:14.341471  8959 ts_tablet_manager.cc:1403] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.185s	user 0.013s	sys 0.015s
I20260709 13:15:14.326289  9206 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.407290  8983 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.375666  8958 ts_tablet_manager.cc:1434] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.003s
I20260709 13:15:14.350667  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.375906  9208 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:14.350855  8807 leader_election.cc:343] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.412971  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.352026  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.433614  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.430472  8917 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:14.434489  8766 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:14.423367  8769 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:14.435519  8958 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:14.436239  8966 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.436731  8966 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.423849  8767 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:14.438884  8964 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.441212  8966 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:14.441897  8959 raft_consensus.cc:359] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.441968  8964 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.442896  8959 raft_consensus.cc:385] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.443367  8959 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.444301  8959 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.424170  8768 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:14.422170  8844 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:14.426476  8842 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:14.421922  9208 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:14.430261  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 79460.1us
I20260709 13:15:14.458755  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.463195  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.464497  9207 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.465060  9207 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:14.470394  8959 ts_tablet_manager.cc:1434] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:15:14.462350  9140 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.477705  8959 tablet_bootstrap.cc:492] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:14.481047  9140 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:14.481981  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:14.482729  8769 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:14.482362  9140 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.472011  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:14.467324  9208 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.484282  8964 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.485034  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:14.496167  8807 leader_election.cc:343] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.496628  9127 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.467427  9207 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.492512  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.492360  8882 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:14.499291  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:14.500144  8966 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:14.500561  8807 leader_election.cc:343] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.500644  8966 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:14.503773  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:14.504522  9175 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:14.508471  9175 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:14.508889  9175 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.509246  9175 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:14.509588  8884 leader_election.cc:343] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.504897  9209 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.501844  8966 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.513365  9209 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.513947  9209 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.500181  9217 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.510929  8958 tablet_bootstrap.cc:654] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.515285  9217 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.523772  9217 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.538347  9076 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:14.564003  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:14.591295  8884 leader_election.cc:343] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:14.605247  9218 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:15:14.553282  9076 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.609475  9206 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.620117  9206 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.660542  8960 tablet_bootstrap.cc:492] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:14.661474  8959 tablet_bootstrap.cc:654] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.661232  8960 ts_tablet_manager.cc:1403] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.366s	user 0.019s	sys 0.027s
I20260709 13:15:14.670302  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.670928  9175 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.631124  9076 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.671731  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:14.672390  8914 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:14.673153  9175 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.676470  8958 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:14.676983  8958 ts_tablet_manager.cc:1403] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.246s	user 0.025s	sys 0.003s
I20260709 13:15:14.674693  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.678231  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:14.621249  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.686605  8769 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.692168  8960 raft_consensus.cc:359] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.692945  8960 raft_consensus.cc:385] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.693228  8960 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.691870  8958 raft_consensus.cc:359] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.693886  8960 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.694550  8958 raft_consensus.cc:385] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.696331  8960 ts_tablet_manager.cc:1434] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:15:14.697608  8958 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.698508  8960 tablet_bootstrap.cc:492] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:14.701884  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.686182  9217 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.713284  8918 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:14.715839  8882 leader_election.cc:343] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.717938  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:14.706055  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:14.718338  8735 leader_election.cc:343] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.719169  8769 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:14.720826  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:14.721792  8966 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.722296  8918 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
W20260709 13:15:14.713325  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52227.1us
W20260709 13:15:14.723474  8735 leader_election.cc:343] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.723986  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:14.698866  8958 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.724817  9140 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:14.728469  8732 leader_election.cc:343] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.728951  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:14.726629  8844 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.729743  9033 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:14.729979  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.730551  8766 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.730832  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:14.719678  9217 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:14.732663  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.731623  9033 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:14.736101  9033 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:14.736510  9033 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.712327  9209 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.739202  9209 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.746555  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:14.747449  8843 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.753443  8960 tablet_bootstrap.cc:654] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:14.754128  8807 leader_election.cc:343] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.740257  9225 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:15:14.733759  9140 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:14.757340  9140 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.757665  8667 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.738130  8918 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.765844  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:14.766587  8768 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.771327  9033 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.783536  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.784722  8916 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:14.784714  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:14.793668  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:14.796442  8735 leader_election.cc:343] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.801577  8844 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:14.783716  9033 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:14.805861  8958 ts_tablet_manager.cc:1434] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.129s	user 0.009s	sys 0.001s
I20260709 13:15:14.806521  8918 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:14.806906  8959 tablet_bootstrap.cc:492] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:14.807652  8959 ts_tablet_manager.cc:1403] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.330s	user 0.013s	sys 0.010s
I20260709 13:15:14.807854  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:14.808641  8807 leader_election.cc:343] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:14.810778  9076 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.811312  9076 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:14.811607  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:14.812170  9076 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.812837  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:14.813575  8983 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.813985  8983 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:14.814653  8983 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.787376  8768 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:14.819170  8958 tablet_bootstrap.cc:492] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:14.821851  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:14.825564  9206 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.826298  9206 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:14.829435  9206 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.864260  8843 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:14.868520  8766 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:14.876058  8882 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:14.878150  9214 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:14.878701  9214 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:14.879643  9214 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.890246  8958 tablet_bootstrap.cc:654] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.901328  8960 tablet_bootstrap.cc:492] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:14.902047  8960 ts_tablet_manager.cc:1403] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.204s	user 0.023s	sys 0.010s
I20260709 13:15:14.903169  8959 raft_consensus.cc:359] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.904565  8959 raft_consensus.cc:385] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.904896  8959 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.911616  8959 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.912225  8665 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 2, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 2 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:14.916214  8960 raft_consensus.cc:359] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.916980  8960 raft_consensus.cc:385] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.917310  8960 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.918201  8960 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.918665  8959 ts_tablet_manager.cc:1434] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.002s
I20260709 13:15:14.922989  8959 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:14.923729  8960 ts_tablet_manager.cc:1434] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:15:14.925163  8960 tablet_bootstrap.cc:492] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:14.927834  8958 tablet_bootstrap.cc:492] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:14.928375  8958 ts_tablet_manager.cc:1403] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.004s
I20260709 13:15:14.932003  8960 tablet_bootstrap.cc:654] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.932785  8959 tablet_bootstrap.cc:654] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.935025  8958 raft_consensus.cc:359] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.935905  8958 raft_consensus.cc:385] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.936316  8958 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.939524  8958 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.942763  8958 ts_tablet_manager.cc:1434] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 13:15:14.943951  8958 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:14.946553  8960 tablet_bootstrap.cc:492] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:14.947081  8960 ts_tablet_manager.cc:1403] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:15:14.949651  8960 raft_consensus.cc:359] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.950194  8960 raft_consensus.cc:385] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:14.950364  8960 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:14.950937  8960 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:14.952634  8960 ts_tablet_manager.cc:1434] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:14.953738  8960 tablet_bootstrap.cc:492] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:14.960587  8960 tablet_bootstrap.cc:654] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.966384  8958 tablet_bootstrap.cc:654] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:14.965894  8664 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:14.979800  9214 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:14.993734  9213 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:15.011292  9209 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:15.020612  8916 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.026861  9209 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.028802  8667 catalog_manager.cc:5697] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.035327  9214 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.035905  9214 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.040833  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:15.041307  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.043046  8959 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.043397  9214 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:15.042887  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:15.044538  9214 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:15.043983  8667 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.043655  8959 ts_tablet_manager.cc:1403] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.121s	user 0.050s	sys 0.051s
I20260709 13:15:15.047050  8960 tablet_bootstrap.cc:492] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.047492  8960 ts_tablet_manager.cc:1403] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.094s	user 0.036s	sys 0.026s
I20260709 13:15:15.045996  8667 catalog_manager.cc:5697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.047993  8959 raft_consensus.cc:359] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.048758  8959 raft_consensus.cc:385] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.048969  8667 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.050101  9209 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:15.050146  8960 raft_consensus.cc:359] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.051391  8960 raft_consensus.cc:385] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.051815  8960 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.052453  8960 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.049037  8959 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.054163  8959 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.054648  8960 ts_tablet_manager.cc:1434] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:15.055696  8960 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.056277  8959 ts_tablet_manager.cc:1434] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:15:15.057307  8959 tablet_bootstrap.cc:492] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.062831  8960 tablet_bootstrap.cc:654] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.063086  8959 tablet_bootstrap.cc:654] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.064494  8914 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:15.069176  9140 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.089248  8958 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.089761  8958 ts_tablet_manager.cc:1403] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.003s
I20260709 13:15:15.091293  8665 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.095583  8960 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.096050  8960 ts_tablet_manager.cc:1403] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.009s
I20260709 13:15:15.096737  8769 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:15.103477  8958 raft_consensus.cc:359] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.104215  8958 raft_consensus.cc:385] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.104497  8958 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.105584  9140 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:15.108842  8960 raft_consensus.cc:359] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.110757  8960 raft_consensus.cc:385] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.111629  8960 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.113108  8960 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.116122  9209 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:15.118547  8960 ts_tablet_manager.cc:1434] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:15:15.125186  8960 tablet_bootstrap.cc:492] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.130219  8664 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.128304  9214 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.153178  9214 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.137540  8958 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.173205  9208 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.185343  9208 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.188957  8960 tablet_bootstrap.cc:654] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.193233  9208 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.210814  8959 tablet_bootstrap.cc:492] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.211325  8959 ts_tablet_manager.cc:1403] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.154s	user 0.032s	sys 0.045s
I20260709 13:15:15.209946  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:15.218418  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:15.213214  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:15.220294  8765 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:15.226739  8958 ts_tablet_manager.cc:1434] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.137s	user 0.023s	sys 0.021s
I20260709 13:15:15.229928  8913 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:15.233675  8959 raft_consensus.cc:359] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.234459  8959 raft_consensus.cc:385] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.234738  8959 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.221516  9214 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:15.235598  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:15.224946  9127 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:15:15.247083  8958 tablet_bootstrap.cc:492] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:15.272831  8959 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.274166  9033 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.274648  9033 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.275435  8959 ts_tablet_manager.cc:1434] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:15:15.276491  8959 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.278699  8958 tablet_bootstrap.cc:654] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.281455  8960 tablet_bootstrap.cc:492] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.281952  8960 ts_tablet_manager.cc:1403] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.157s	user 0.011s	sys 0.011s
I20260709 13:15:15.282680  9033 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.239493  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.284543  8960 raft_consensus.cc:359] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.285352  8960 raft_consensus.cc:385] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.285612  8960 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.286232  8960 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.286499  9033 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.287034  9033 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.287675  8960 ts_tablet_manager.cc:1434] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:15:15.288479  8959 tablet_bootstrap.cc:654] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.288611  8960 tablet_bootstrap.cc:492] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.294387  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:15.245671  9208 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.304452  9033 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.299862  9065 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.299216  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:15.312693  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:15.313373  8918 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:15.314211  8844 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:15.314226  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:15.319829  8732 leader_election.cc:343] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.320051  9214 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.320595  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:15.323031  9225 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:15.323040  8735 leader_election.cc:343] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.325122  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:15.325292  9076 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.325805  9076 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.326301  9076 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.326628  9177 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.320375  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.333432  8843 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:15.335013  9127 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.372797  9065 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.378666  9209 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.383369  9208 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.392273  8958 tablet_bootstrap.cc:492] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.392829  8958 ts_tablet_manager.cc:1403] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.021s
I20260709 13:15:15.368898  9225 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:15:15.405380  9033 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.406231  9214 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:15.406888  9033 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.407361  9033 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:15.414821  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:15.417194  9209 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.418627  8959 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.419130  8959 ts_tablet_manager.cc:1403] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.008s
I20260709 13:15:15.440481  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:15.441031  8918 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:15.436878  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.442507  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:15.443341  8983 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.443720  8983 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.444027  8983 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.441907  8958 raft_consensus.cc:359] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.449466  8958 raft_consensus.cc:385] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.449872  8958 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.440258  9033 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.457062  8960 tablet_bootstrap.cc:654] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.465845  8958 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.466817  8839 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:15.470575  8958 ts_tablet_manager.cc:1434] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.005s
I20260709 13:15:15.482483  8918 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:15.484805  8983 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:15.489971  9261 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:15:15.493309  8983 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.495707  9076 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.496513  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:15.497067  8918 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.486198  9033 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:15.501279  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:15.501933  8844 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.506351  8959 raft_consensus.cc:359] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.521513  8959 raft_consensus.cc:385] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.521886  8959 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.513458  9076 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.515496  8918 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:15.518474  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:15.524039  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:15.537387  8916 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.537756  8843 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.539009  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:15.542502  8844 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:15.545181  8958 tablet_bootstrap.cc:492] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:15.547626  8966 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.553882  8966 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.556015  8966 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:15.543475  9076 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.559875  8843 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:15.574450  8959 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.565639  8916 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:15.579228  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:15.582432  8882 leader_election.cc:343] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.572665  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.574538  9076 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:15.586051  9076 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:15.589504  8884 leader_election.cc:343] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.590039  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:15.593276  8966 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.601102  8959 ts_tablet_manager.cc:1434] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.182s	user 0.010s	sys 0.002s
I20260709 13:15:15.601677  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:15.604175  9033 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.605595  9033 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:15.606491  9033 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.615590  8959 tablet_bootstrap.cc:492] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.645155  8960 tablet_bootstrap.cc:492] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.645789  8960 ts_tablet_manager.cc:1403] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.357s	user 0.015s	sys 0.018s
I20260709 13:15:15.650852  8958 tablet_bootstrap.cc:654] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.659384  8960 raft_consensus.cc:359] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.664716  8959 tablet_bootstrap.cc:654] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.664392  8665 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.660292  8960 raft_consensus.cc:385] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.666482  8960 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.668937  8960 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.675256  8959 tablet_bootstrap.cc:492] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.675742  8959 ts_tablet_manager.cc:1403] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.006s
I20260709 13:15:15.677801  8960 ts_tablet_manager.cc:1434] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:15:15.678264  8959 raft_consensus.cc:359] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.678987  8960 tablet_bootstrap.cc:492] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.678957  8959 raft_consensus.cc:385] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.681847  8959 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.682789  8959 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.686821  8958 tablet_bootstrap.cc:492] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.687299  8958 ts_tablet_manager.cc:1403] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.198s	user 0.009s	sys 0.003s
I20260709 13:15:15.690076  8958 raft_consensus.cc:359] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.690793  8958 raft_consensus.cc:385] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.691046  8958 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.691705  8958 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.692464  8960 tablet_bootstrap.cc:654] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.695994  8958 ts_tablet_manager.cc:1434] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:15:15.699714  8959 ts_tablet_manager.cc:1434] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:15:15.700766  8959 tablet_bootstrap.cc:492] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.702698  8958 tablet_bootstrap.cc:492] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:15.716480  8960 tablet_bootstrap.cc:492] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.717080  8960 ts_tablet_manager.cc:1403] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.000s
I20260709 13:15:15.719661  8960 raft_consensus.cc:359] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.720391  8960 raft_consensus.cc:385] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.720659  8960 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.721309  8960 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.725503  8959 tablet_bootstrap.cc:654] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.728988  8960 ts_tablet_manager.cc:1434] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:15.730211  8960 tablet_bootstrap.cc:492] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.729887  8665 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.731603  8958 tablet_bootstrap.cc:654] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.736569  9272 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.737135  9272 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.739394  9272 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.741775  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.742204  8960 tablet_bootstrap.cc:654] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.744019  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:15.744745  8916 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:15.746102  8732 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:15.747577  9272 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.747954  9272 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.748278  9272 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.752008  8958 tablet_bootstrap.cc:492] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.752537  8958 ts_tablet_manager.cc:1403] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.001s
W20260709 13:15:15.752920  8735 leader_election.cc:343] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.748752  8959 tablet_bootstrap.cc:492] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.755070  8959 ts_tablet_manager.cc:1403] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.000s
I20260709 13:15:15.755370  8958 raft_consensus.cc:359] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.756069  8958 raft_consensus.cc:385] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.756330  8958 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.757002  8958 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.759085  8958 ts_tablet_manager.cc:1434] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:15.759433  8959 raft_consensus.cc:359] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.760090  8958 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:15.760142  8959 raft_consensus.cc:385] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.760538  8959 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.762434  8959 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.769522  8958 tablet_bootstrap.cc:654] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.769577  8959 ts_tablet_manager.cc:1434] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:15:15.770856  8959 tablet_bootstrap.cc:492] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.780736  8959 tablet_bootstrap.cc:654] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.787276  8960 tablet_bootstrap.cc:492] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.787838  8960 ts_tablet_manager.cc:1403] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.002s
I20260709 13:15:15.789156  8959 tablet_bootstrap.cc:492] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.789667  8959 ts_tablet_manager.cc:1403] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:15:15.790881  8960 raft_consensus.cc:359] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.791730  8960 raft_consensus.cc:385] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.792049  8960 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.792757  8960 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.784917  9272 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.795251  8960 ts_tablet_manager.cc:1434] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:15.796646  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:15.797094  9272 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:15.797320  8958 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.797926  8958 ts_tablet_manager.cc:1403] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.006s
I20260709 13:15:15.798249  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:15.798830  8916 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.800537  8960 tablet_bootstrap.cc:492] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.800999  8958 raft_consensus.cc:359] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.802449  8959 raft_consensus.cc:359] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.803205  8959 raft_consensus.cc:385] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.803486  8959 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.801760  8958 raft_consensus.cc:385] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.804248  8958 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.805022  8958 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.807458  8958 ts_tablet_manager.cc:1434] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:15.807898  8960 tablet_bootstrap.cc:654] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.808692  8958 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
W20260709 13:15:15.811802  8735 leader_election.cc:343] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.817554  8960 tablet_bootstrap.cc:492] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.817186  8959 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.818051  8960 ts_tablet_manager.cc:1403] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.012s
I20260709 13:15:15.821785  8960 raft_consensus.cc:359] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.822616  8960 raft_consensus.cc:385] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.822924  8960 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.823648  8959 ts_tablet_manager.cc:1434] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:15:15.823622  8960 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.824967  8959 tablet_bootstrap.cc:492] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.827481  8960 ts_tablet_manager.cc:1434] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:15:15.828666  8960 tablet_bootstrap.cc:492] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.833829  8959 tablet_bootstrap.cc:654] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.835129  8960 tablet_bootstrap.cc:654] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.837375  8958 tablet_bootstrap.cc:654] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.816694  8916 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:15.845284  8959 tablet_bootstrap.cc:492] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.845825  8959 ts_tablet_manager.cc:1403] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.004s
I20260709 13:15:15.847519  8960 tablet_bootstrap.cc:492] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.847999  8960 ts_tablet_manager.cc:1403] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.000s
I20260709 13:15:15.848784  8959 raft_consensus.cc:359] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.849545  8959 raft_consensus.cc:385] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.849845  8959 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.850768  9217 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.851348  9217 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.851802  8732 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:15.852476  9272 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.852962  9272 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:15.853570  9217 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:15.853785  9272 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.855562  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:15.856211  8766 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:15.856889  8960 raft_consensus.cc:359] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.857507  8958 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.857611  8960 raft_consensus.cc:385] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.857589  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:15.858052  8958 ts_tablet_manager.cc:1403] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.050s	user 0.005s	sys 0.010s
I20260709 13:15:15.858144  8960 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.858959  8960 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.859649  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.859948  9065 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:15.860309  9065 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:15.860832  9065 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.861240  8960 ts_tablet_manager.cc:1434] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:15:15.861063  8958 raft_consensus.cc:359] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.861799  8958 raft_consensus.cc:385] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.862149  8958 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.862288  8960 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.862900  8958 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.860292  8839 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:15.865232  8959 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.867780  8959 ts_tablet_manager.cc:1434] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:15:15.868825  8959 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.868513  9065 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.869424  8960 tablet_bootstrap.cc:654] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.871688  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:15.872277  8766 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.873436  8958 ts_tablet_manager.cc:1434] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:15:15.875082  8958 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:15.881445  8959 tablet_bootstrap.cc:654] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.880514  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:15.886345  8960 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.886368  8839 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:15.889825  8958 tablet_bootstrap.cc:654] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.886932  8960 ts_tablet_manager.cc:1403] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 13:15:15.897493  9217 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:15.897209  8960 raft_consensus.cc:359] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.898277  8960 raft_consensus.cc:385] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.898053  9217 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.905848  8839 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:15.906574  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:15.907550  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:15.908088  8882 leader_election.cc:343] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.898717  8960 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.908663  8966 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:15.909307  8966 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:15.909132  8960 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.910193  8966 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.915189  8960 ts_tablet_manager.cc:1434] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 13:15:15.915640  8959 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.916121  8959 ts_tablet_manager.cc:1403] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.048s	user 0.001s	sys 0.020s
I20260709 13:15:15.916326  8960 tablet_bootstrap.cc:492] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.921716  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:15.922931  8960 tablet_bootstrap.cc:654] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.923040  8959 raft_consensus.cc:359] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:15.923408  8884 leader_election.cc:343] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:15.923875  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:15.924832  9065 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:15.925331  8959 raft_consensus.cc:385] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.934358  8959 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.935528  8960 tablet_bootstrap.cc:492] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.935416  8959 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.935976  8960 ts_tablet_manager.cc:1403] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:15:15.937929  8959 ts_tablet_manager.cc:1434] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:15:15.938723  8960 raft_consensus.cc:359] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.934984  8667 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:15.939548  8959 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:15.928202  9294 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:15.933301  8766 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:15.933750  9217 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:15.939520  8960 raft_consensus.cc:385] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.944336  8960 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.945112  8960 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.945894  8959 tablet_bootstrap.cc:654] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.946780  8960 ts_tablet_manager.cc:1434] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:15:15.947853  8960 tablet_bootstrap.cc:492] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.929563  8666 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:15.955595  8960 tablet_bootstrap.cc:654] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.973908  8960 tablet_bootstrap.cc:492] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:15.974381  8960 ts_tablet_manager.cc:1403] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.005s
I20260709 13:15:15.976962  8958 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:15.977496  8958 ts_tablet_manager.cc:1403] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.025s
I20260709 13:15:15.977027  8960 raft_consensus.cc:359] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.977869  8960 raft_consensus.cc:385] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.978189  8960 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.978829  8960 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.979983  8958 raft_consensus.cc:359] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.980540  8958 raft_consensus.cc:385] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.980762  8958 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.980968  8960 ts_tablet_manager.cc:1434] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:15:15.981494  8958 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.982057  8960 tablet_bootstrap.cc:492] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:15.983290  8959 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:15.983729  8958 ts_tablet_manager.cc:1434] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:15.983805  8959 ts_tablet_manager.cc:1403] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.045s	user 0.015s	sys 0.005s
I20260709 13:15:15.986668  8959 raft_consensus.cc:359] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.987398  8959 raft_consensus.cc:385] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:15.987720  8959 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:15.987804  8960 tablet_bootstrap.cc:654] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:15.989398  8958 tablet_bootstrap.cc:492] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:15.988466  8959 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:15.993726  8959 ts_tablet_manager.cc:1434] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:15.995258  8959 tablet_bootstrap.cc:492] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:16.009241  9272 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.009773  8959 tablet_bootstrap.cc:654] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.009832  9272 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.012239  9272 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.012844  9272 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.013054  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.013767  8839 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:16.014850  8735 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:16.017141  9177 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.017696  9177 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.018045  9177 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.018112  9294 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.018573  9294 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.019730  8960 tablet_bootstrap.cc:492] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:16.020233  8960 ts_tablet_manager.cc:1403] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.038s	user 0.005s	sys 0.021s
I20260709 13:15:16.020954  9294 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.023160  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.024168  8769 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:16.028611  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.029253  9272 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.030277  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:16.030098  9272 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.032166  9294 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.032585  9294 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.032974  9294 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.027060  8960 raft_consensus.cc:359] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:16.035522  8884 leader_election.cc:343] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.043063  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:16.043812  8913 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:16.045320  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:16.046476  9273 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.046919  9273 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.047226  9273 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.050083  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.035830  8960 raft_consensus.cc:385] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.051640  8960 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.052619  8960 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:16.059108  8735 leader_election.cc:343] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.060379  8966 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.060909  8966 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.061110  9294 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.062819  8966 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.063169  9294 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.065559  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.052326  9076 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:16.067453  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:16.068590  8884 leader_election.cc:343] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:16.069307  8884 leader_election.cc:343] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.069325  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:16.072099  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.073021  8769 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:16.078866  8960 ts_tablet_manager.cc:1434] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.005s
I20260709 13:15:16.036947  9272 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.081075  8960 tablet_bootstrap.cc:492] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:16.079481  9076 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:15:16.085528  8732 leader_election.cc:343] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.105684  9209 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.115607  9209 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.121877  9209 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.123381  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:16.123926  9217 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.124071  8916 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:16.124471  9217 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.125811  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:16.126653  9217 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.127707  9127 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.128103  9127 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.128453  9127 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.128589  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:16.129961  8884 leader_election.cc:343] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.134905  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:16.138358  9294 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.103268  9273 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.147871  9294 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.152331  9065 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.142546  9177 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.156257  9294 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.160179  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.160853  8765 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:16.180344  9209 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.180971  9209 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.181365  9177 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.183023  9209 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.183573  8959 tablet_bootstrap.cc:492] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:16.184018  8959 ts_tablet_manager.cc:1403] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.189s	user 0.026s	sys 0.035s
I20260709 13:15:16.186894  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:16.161988  9065 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.196143  8958 tablet_bootstrap.cc:654] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.190901  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.204268  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:16.207285  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.227787  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:16.228515  8769 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.197103  9273 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.277760  9177 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.278434  9177 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.311828  9206 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.329191  9206 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.394368  9214 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.395145  9214 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.423388  8959 raft_consensus.cc:359] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.424232  8959 raft_consensus.cc:385] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.424284  9065 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.424549  8959 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.426350  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:16.427112  8843 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.427594  9127 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.430536  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:16.431203  8766 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.435926  8843 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:16.436288  9177 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:16.437280  8732 leader_election.cc:343] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.433589  8959 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.464207  8959 ts_tablet_manager.cc:1434] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.280s	user 0.026s	sys 0.020s
I20260709 13:15:16.438722  9127 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.441103  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:16.446203  9214 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.447371  9206 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.466223  8913 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.468129  8958 tablet_bootstrap.cc:492] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:16.468633  8958 ts_tablet_manager.cc:1403] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.479s	user 0.013s	sys 0.000s
I20260709 13:15:16.450369  9307 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.450290  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.450328  9294 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.472704  9307 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.453190  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.474905  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.475530  8839 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:16.475714  8764 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:16.456940  8960 tablet_bootstrap.cc:654] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.458535  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:16.476775  8918 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:15:16.460055  8735 leader_election.cc:343] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.474835  8959 tablet_bootstrap.cc:492] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:16.477021  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:16.480183  8917 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:16.480736  9307 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.448397  8766 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
W20260709 13:15:16.452104  9305 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.176s	user 0.004s	sys 0.000s
W20260709 13:15:16.489362  8882 leader_election.cc:343] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.491086  9294 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.492578  8958 raft_consensus.cc:359] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.493705  8958 raft_consensus.cc:385] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.478312  8913 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:16.494176  8958 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.495409  8958 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.499452  8958 ts_tablet_manager.cc:1434] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:15:16.500396  8959 tablet_bootstrap.cc:654] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.492244  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:16.502455  8958 tablet_bootstrap.cc:492] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:16.514225  9308 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:16.501250  8884 leader_election.cc:343] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.516011  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:16.514847  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.517196  8808 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:16.521768  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:16.523208  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:16.531252  8732 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:16.528473  9214 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.533061  9214 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.533558  9214 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.542446  9076 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.543076  9076 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.543594  9076 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.547006  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:16.550912  8983 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.537676  9273 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:15:16.550544  9208 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.554531  9208 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.554909  9208 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.557118  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:16.558844  8884 leader_election.cc:343] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.560485  8769 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:16.562139  9127 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.562839  9127 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:16.563397  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.564409  9127 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.568636  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.563462  9209 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:16.601622  8958 tablet_bootstrap.cc:654] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.606389  8960 tablet_bootstrap.cc:492] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:16.606925  8960 ts_tablet_manager.cc:1403] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.526s	user 0.021s	sys 0.020s
I20260709 13:15:16.576609  9209 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.619024  8983 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:16.620903  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:16.622426  8882 leader_election.cc:343] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.614180  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:16.623060  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:16.622390  9076 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.621182  8983 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.613598  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.622977  9308 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:16.629782  8764 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:16.629169  8766 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.629492  9306 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.613656  9208 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.635591  9209 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.636323  8959 tablet_bootstrap.cc:492] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:16.637574  8959 ts_tablet_manager.cc:1403] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.163s	user 0.027s	sys 0.014s
I20260709 13:15:16.624948  9217 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.638232  9217 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:16.646486  8960 raft_consensus.cc:359] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.647722  8960 raft_consensus.cc:385] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.648029  8960 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.648720  8960 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.640244  9217 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.661697  8807 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:16.662945  8959 raft_consensus.cc:359] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.663295  9208 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.663312  9127 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.663986  8959 raft_consensus.cc:385] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.664337  8959 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.665184  9214 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.665030  8959 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.669394  8960 ts_tablet_manager.cc:1434] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 13:15:16.678536  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:16.679723  8841 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:16.682926  9076 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:16.685321  8960 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:16.685725  8959 ts_tablet_manager.cc:1434] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 13:15:16.700249  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:16.703105  8958 tablet_bootstrap.cc:492] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:16.703817  8958 ts_tablet_manager.cc:1403] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.202s	user 0.010s	sys 0.017s
I20260709 13:15:16.705134  8769 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:16.711473  9214 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:16.713543  8959 tablet_bootstrap.cc:492] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:16.715644  8766 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
W20260709 13:15:16.719535  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 91381us
W20260709 13:15:16.721700  8870 tablet.cc:2406] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:16.709501  9127 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.765118  8666 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:16.766312  9214 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:16.771934  8884 leader_election.cc:343] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.774741  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:16.775923  9127 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:16.776306  9127 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:16.776510  8959 tablet_bootstrap.cc:654] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.776619  9127 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.782099  9076 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:16.782547  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:16.783269  8844 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:15:16.794654  8882 leader_election.cc:343] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:16.795146  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:16.795364  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:16.796016  9065 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.796200  8914 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:16.797216  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:16.798098  8835 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:16.838765  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:16.838614  8958 raft_consensus.cc:359] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.839413  8958 raft_consensus.cc:385] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:16.839877  8958 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:16.783783  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:16.842198  8958 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.846292  9324 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.846859  9324 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:16.847754  9324 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.864874  8960 tablet_bootstrap.cc:654] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.869135  8958 ts_tablet_manager.cc:1434] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.165s	user 0.007s	sys 0.002s
I20260709 13:15:16.870554  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:16.877161  8958 tablet_bootstrap.cc:492] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:16.873976  8765 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:16.889004  8735 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:16.889739  8983 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:16.890165  8983 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:16.890895  8983 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:16.969642  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 79095.6us
I20260709 13:15:16.977181  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:16.986179  8917 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:16.990384  8958 tablet_bootstrap.cc:654] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:16.992452  8735 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:16.985512  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:16.999416  9271 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:16.999430  9127 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:16.996160  8915 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:17.005180  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:17.005710  8916 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
W20260709 13:15:17.007028  9302 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.127s	user 0.005s	sys 0.000s
I20260709 13:15:17.007864  9272 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:17.010311  9314 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.010829  9314 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.012713  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:17.013573  8916 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:17.037086  8882 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.042121  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:17.040277  9127 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.040794  9214 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.044615  9315 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.076050  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:17.076763  8915 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:17.078064  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.078977  8762 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:17.082244  8960 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:17.082927  8960 ts_tablet_manager.cc:1403] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.407s	user 0.009s	sys 0.013s
I20260709 13:15:17.083671  8959 tablet_bootstrap.cc:492] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:17.084149  8959 ts_tablet_manager.cc:1403] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.371s	user 0.015s	sys 0.041s
I20260709 13:15:17.085371  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:17.097223  9325 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.097863  9325 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.098332  9325 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.067982  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:17.095818  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:17.103310  9272 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.105537  8765 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.127084  8914 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.127935  9314 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.145321  8959 raft_consensus.cc:359] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.148294  8959 raft_consensus.cc:385] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.148753  8959 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.145198  8917 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:17.158022  8960 raft_consensus.cc:359] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.161783  8960 raft_consensus.cc:385] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.162020  8960 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.166203  8959 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.169822  8960 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.129160  9272 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.173518  8959 ts_tablet_manager.cc:1434] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.089s	user 0.010s	sys 0.001s
I20260709 13:15:17.175673  8958 tablet_bootstrap.cc:492] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:17.179809  8958 ts_tablet_manager.cc:1403] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.305s	user 0.033s	sys 0.013s
I20260709 13:15:17.176103  8914 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
W20260709 13:15:17.181036  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 86760.6us
I20260709 13:15:17.186009  8960 ts_tablet_manager.cc:1434] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.004s
I20260709 13:15:17.187026  8960 tablet_bootstrap.cc:492] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:17.201920  8983 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.189463  9349 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.210539  8959 tablet_bootstrap.cc:492] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:17.202623  8983 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.215286  9272 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.233737  8983 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.215970  8765 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:17.220439  9325 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.223037  8958 raft_consensus.cc:359] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.226112  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:17.239267  8958 raft_consensus.cc:385] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.239655  8958 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.235133  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:17.240299  8958 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.241976  8958 ts_tablet_manager.cc:1434] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.062s	user 0.004s	sys 0.000s
I20260709 13:15:17.246264  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:17.247136  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:17.247812  8914 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:17.249006  9321 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.257691  9321 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:17.267444  8960 tablet_bootstrap.cc:654] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.249290  8842 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:17.275961  9214 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.240996  9349 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.276521  9214 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.278882  8918 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:17.281517  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:17.281661  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:17.281158  9214 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.283696  9272 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.284302  9271 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.266448  9321 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.297474  9303 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.298094  9303 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.298471  9303 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.287026  9271 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.299561  9271 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.305235  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:17.308197  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:17.309180  8765 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.285229  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.314015  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:17.314860  8843 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:15:17.316028  8884 consensus_peers.cc:597] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.323870  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.319000  9314 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:15:17.330957  8735 leader_election.cc:343] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.328751  9349 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.333841  9325 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.335724  8958 tablet_bootstrap.cc:492] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:17.338078  9127 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:17.358124  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:17.361506  8837 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 0.
I20260709 13:15:17.375654  8765 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:17.344178  8665 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.376467  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:17.383247  8912 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.375706  8959 tablet_bootstrap.cc:654] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.390774  8912 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
W20260709 13:15:17.379348  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48444.6us
W20260709 13:15:17.392632  8735 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.380107  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.380908  8960 tablet_bootstrap.cc:492] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:17.393867  8960 ts_tablet_manager.cc:1403] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.207s	user 0.026s	sys 0.016s
I20260709 13:15:17.393798  9324 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.394340  9348 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:17.397285  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:17.398291  8884 consensus_peers.cc:597] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:17.400774  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:17.403213  9349 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.413830  8960 raft_consensus.cc:359] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.414945  8960 raft_consensus.cc:385] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.415702  8960 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.408176  9127 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.416343  9349 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.436892  9349 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.435883  9127 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:17.380844  9271 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.457901  9127 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.459676  9214 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.461181  8958 tablet_bootstrap.cc:654] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.463845  8959 tablet_bootstrap.cc:492] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:17.464421  8959 ts_tablet_manager.cc:1403] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.257s	user 0.020s	sys 0.023s
I20260709 13:15:17.467008  8960 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.472608  8762 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:17.495709  8960 ts_tablet_manager.cc:1434] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.101s	user 0.011s	sys 0.001s
I20260709 13:15:17.495091  8959 raft_consensus.cc:359] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.496279  8959 raft_consensus.cc:385] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.496587  8959 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.479565  9303 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.524552  9316 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:17.546355  8960 tablet_bootstrap.cc:492] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:17.547488  8959 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.558059  8959 ts_tablet_manager.cc:1434] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.010s
I20260709 13:15:17.559154  8959 tablet_bootstrap.cc:492] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:17.569545  9271 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:17.570390  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:17.574052  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:17.577533  9324 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.582530  9349 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.583778  8912 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 1: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:17.588755  8960 tablet_bootstrap.cc:654] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.593194  9349 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.594205  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:17.594506  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:17.595088  8764 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:17.595146  8841 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.598765  9303 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.599764  9303 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.598774  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:17.600239  9303 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.602560  8959 tablet_bootstrap.cc:654] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.603824  9303 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.604555  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:17.606911  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:17.607481  8918 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:17.607048  8735 leader_election.cc:343] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.610610  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:17.611591  9225 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.612661  9303 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.613922  8918 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:17.614964  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:17.616726  8958 tablet_bootstrap.cc:492] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:17.616683  8841 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:17.617504  8958 ts_tablet_manager.cc:1403] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.282s	user 0.009s	sys 0.014s
I20260709 13:15:17.618280  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:17.619894  9214 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.620208  8958 raft_consensus.cc:359] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.629436  8958 raft_consensus.cc:385] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.629815  8958 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.629540  9214 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:17.631906  8735 leader_election.cc:343] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.630869  9214 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.624853  8960 tablet_bootstrap.cc:492] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:17.636157  8960 ts_tablet_manager.cc:1403] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.097s	user 0.011s	sys 0.003s
I20260709 13:15:17.637769  8666 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.639936  8960 raft_consensus.cc:359] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.628670  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.645061  8960 raft_consensus.cc:385] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.645403  8960 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.646306  9225 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.646059  8960 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.646832  9225 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:17.647673  9225 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.648682  8960 ts_tablet_manager.cc:1434] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:17.649744  8960 tablet_bootstrap.cc:492] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:17.630935  8958 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.656482  8960 tablet_bootstrap.cc:654] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.658584  8958 ts_tablet_manager.cc:1434] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:15:17.663317  8958 tablet_bootstrap.cc:492] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:17.674023  8960 tablet_bootstrap.cc:492] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:17.674680  8960 ts_tablet_manager.cc:1403] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 13:15:17.677883  8960 raft_consensus.cc:359] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.682315  8960 raft_consensus.cc:385] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.682999  8960 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.683761  8960 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.685359  8960 ts_tablet_manager.cc:1434] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:15:17.686491  8960 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:17.693907  8960 tablet_bootstrap.cc:654] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.695007  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:17.697831  8918 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:17.688553  8666 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.700485  8958 tablet_bootstrap.cc:654] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.700934  8666 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:15:17.713665  8958 tablet_bootstrap.cc:492] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:17.714207  8958 ts_tablet_manager.cc:1403] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.051s	user 0.004s	sys 0.009s
I20260709 13:15:17.720924  8958 raft_consensus.cc:359] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.721843  8959 tablet_bootstrap.cc:492] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:17.722292  8959 ts_tablet_manager.cc:1403] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.163s	user 0.015s	sys 0.010s
I20260709 13:15:17.723328  8960 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:17.723780  8960 ts_tablet_manager.cc:1403] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.008s
I20260709 13:15:17.725097  8959 raft_consensus.cc:359] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.726594  8960 raft_consensus.cc:359] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.727620  8959 raft_consensus.cc:385] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.727373  8960 raft_consensus.cc:385] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.728013  8959 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.721608  8958 raft_consensus.cc:385] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.728453  8958 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.728122  8665 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.728790  8959 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.729241  8958 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.730713  8959 ts_tablet_manager.cc:1434] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:17.730222  8665 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:15:17.731243  8958 ts_tablet_manager.cc:1434] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:17.731732  8959 tablet_bootstrap.cc:492] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:17.732193  8958 tablet_bootstrap.cc:492] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:17.728066  8960 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.733633  8960 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.733690  8665 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:15:17.735320  8960 ts_tablet_manager.cc:1434] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:15:17.736284  8960 tablet_bootstrap.cc:492] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Bootstrap starting.
I20260709 13:15:17.738194  8959 tablet_bootstrap.cc:654] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.739778  9214 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.740350  9214 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.741519  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.742300  9225 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:17.742688  9225 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:17.743010  9225 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.743184  9214 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.744323  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:17.745942  8884 leader_election.cc:343] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.753192  8958 tablet_bootstrap.cc:654] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.757371  8960 tablet_bootstrap.cc:654] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.763586  9225 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.766566  9225 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.767920  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:17.796053  8958 tablet_bootstrap.cc:492] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:17.796571  8958 ts_tablet_manager.cc:1403] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.010s
W20260709 13:15:17.797765  8735 leader_election.cc:343] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.835851  8665 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 1, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:17.841635  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.842432  8960 tablet_bootstrap.cc:492] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: No bootstrap required, opened a new log
I20260709 13:15:17.842900  8960 ts_tablet_manager.cc:1403] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Time spent bootstrapping tablet: real 0.107s	user 0.027s	sys 0.026s
I20260709 13:15:17.844612  8966 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.845101  8966 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.847038  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:17.847715  8909 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:17.849521  8882 leader_election.cc:343] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.849922  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.850468  8841 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:17.853446  9348 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.858397  8960 raft_consensus.cc:359] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.859107  8960 raft_consensus.cc:385] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.859355  8960 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.859965  8960 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.860445  8966 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.863124  8959 tablet_bootstrap.cc:492] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:17.863679  8959 ts_tablet_manager.cc:1403] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.132s	user 0.025s	sys 0.029s
I20260709 13:15:17.865860  8960 ts_tablet_manager.cc:1434] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:15:17.870515  9217 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.871006  9217 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.874810  8959 raft_consensus.cc:359] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.875705  8959 raft_consensus.cc:385] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.875979  8959 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:17.876752  9217 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.877586  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.880291  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:17.881083  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.881444  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:17.883150  8882 leader_election.cc:343] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.883368  8909 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
W20260709 13:15:17.883798  8882 leader_election.cc:343] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.886914  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.887897  9225 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:17.887663  8959 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.888393  9225 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:17.889302  9325 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:17.889456  9225 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.890224  8959 ts_tablet_manager.cc:1434] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 13:15:17.891252  8959 tablet_bootstrap.cc:492] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:17.893587  8958 raft_consensus.cc:359] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.895386  8958 raft_consensus.cc:385] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:17.896045  8958 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
W20260709 13:15:17.896760  8884 leader_election.cc:343] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.897519  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.897071  8958 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.898855  9217 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:17.899523  8884 leader_election.cc:343] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:17.900698  8884 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:17.901465  9217 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:17.902762  8958 ts_tablet_manager.cc:1434] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.106s	user 0.006s	sys 0.003s
I20260709 13:15:17.906790  8958 tablet_bootstrap.cc:492] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:17.917059  8958 tablet_bootstrap.cc:654] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.927932  9314 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:15:17.938601  9314 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.939110  9314 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.950464  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:17.958073  9314 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:17.989801  8959 tablet_bootstrap.cc:654] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:17.994801  9294 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:17.995676  9294 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:17.997648  9294 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:17.998389  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.003038  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.005079  8666 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.006985  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:18.007121  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:18.008741  9361 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:18.009583  8882 leader_election.cc:343] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.009500  9361 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.017802  9314 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.023276  8958 tablet_bootstrap.cc:492] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.023790  8958 ts_tablet_manager.cc:1403] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.009s
I20260709 13:15:18.027573  8958 raft_consensus.cc:359] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:18.028126  8884 leader_election.cc:343] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.028389  8958 raft_consensus.cc:385] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.028643  8884 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:18.028836  8958 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.029389  9217 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:18.029599  8958 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.032270  8958 ts_tablet_manager.cc:1434] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:18.034368  8958 tablet_bootstrap.cc:492] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.046541  8958 tablet_bootstrap.cc:654] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.055881  9303 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.056489  9303 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.059369  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:18.060834  8735 leader_election.cc:343] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.062716  9303 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.063657  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.064265  8918 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:18.065372  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:18.068760  9225 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.069204  9225 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.069561  9225 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.075824  8841 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.078322  9225 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.080476  9225 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.082430  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:18.083559  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:18.084124  8735 leader_election.cc:343] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.084203  8910 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.117566  8959 tablet_bootstrap.cc:492] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:18.118359  8959 ts_tablet_manager.cc:1403] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.227s	user 0.009s	sys 0.024s
I20260709 13:15:18.120828  8958 tablet_bootstrap.cc:492] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.120824  8959 raft_consensus.cc:359] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.123359  8958 ts_tablet_manager.cc:1403] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.089s	user 0.036s	sys 0.044s
I20260709 13:15:18.123359  8959 raft_consensus.cc:385] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.125852  8959 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
W20260709 13:15:18.128002  8735 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:18.130513  8958 raft_consensus.cc:359] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.131358  8958 raft_consensus.cc:385] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.131721  8958 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.132436  8958 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.135250  8958 ts_tablet_manager.cc:1434] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:18.136368  8958 tablet_bootstrap.cc:492] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.136443  8910 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:18.138079  8959 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.139489  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:18.141165  9271 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.141695  9271 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:18.142540  9271 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.139725  8959 ts_tablet_manager.cc:1434] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.000s
I20260709 13:15:18.149166  8958 tablet_bootstrap.cc:654] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.150415  8959 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:18.157279  9217 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.162578  8959 tablet_bootstrap.cc:654] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.180716  8958 tablet_bootstrap.cc:492] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.181519  8958 ts_tablet_manager.cc:1403] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.011s
I20260709 13:15:18.188896  8958 raft_consensus.cc:359] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.189683  8958 raft_consensus.cc:385] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.190007  8958 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.190658  8958 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.193311  8958 ts_tablet_manager.cc:1434] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:15:18.194335  8958 tablet_bootstrap.cc:492] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.194205  9349 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.203127  8958 tablet_bootstrap.cc:654] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.204350  9361 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.204902  9361 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.207891  9271 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.211473  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.215052  9361 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.214509  8665 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.217702  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.222574  9303 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.223104  9303 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.228389  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:18.230086  9314 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:18.240514  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:18.241447  8841 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:18.246075  9303 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.248126  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.248939  8918 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:18.250128  8959 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:18.250648  8959 ts_tablet_manager.cc:1403] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.100s	user 0.007s	sys 0.007s
I20260709 13:15:18.250437  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:18.259208  9303 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.260658  9303 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.261155  9303 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.261956  8959 raft_consensus.cc:359] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.262705  8959 raft_consensus.cc:385] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.262967  8959 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.266400  8959 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.270872  9271 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.272670  9303 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.281209  9303 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.281919  8958 tablet_bootstrap.cc:492] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.282543  8958 ts_tablet_manager.cc:1403] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.031s
I20260709 13:15:18.283602  8959 ts_tablet_manager.cc:1434] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.003s
I20260709 13:15:18.284799  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:18.284971  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:18.285480  8909 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.285468  8843 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.288836  8958 raft_consensus.cc:359] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.290900  8958 raft_consensus.cc:385] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.291234  8958 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.291957  8958 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.294279  8958 ts_tablet_manager.cc:1434] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:18.290594  8959 tablet_bootstrap.cc:492] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:18.302798  8959 tablet_bootstrap.cc:654] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.304263  8958 tablet_bootstrap.cc:492] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.310940  8958 tablet_bootstrap.cc:654] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.302465  8843 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:18.303328  8909 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:18.312693  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:18.313948  9303 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.315012  9303 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:18.315853  9303 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.334959  9127 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.335765  9127 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.338229  9127 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.339254  9361 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.352366  9361 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.355176  9361 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.340466  8843 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.355811  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.356514  8764 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:18.357730  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:18.358927  9208 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.359305  9208 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.359650  9208 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.345562  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.362262  8918 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:18.367712  9208 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.371155  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.371379  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.371963  8909 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:18.373906  9273 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.376583  8667 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:18.378176  8808 leader_election.cc:343] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.387115  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:18.388229  9325 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.388628  9325 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.388983  9325 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.405174  8958 tablet_bootstrap.cc:492] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.405664  8958 ts_tablet_manager.cc:1403] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.102s	user 0.043s	sys 0.036s
I20260709 13:15:18.406234  8959 tablet_bootstrap.cc:492] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:18.406870  8959 ts_tablet_manager.cc:1403] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.010s
I20260709 13:15:18.418521  9316 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.433734  9316 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.435638  9316 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.436673  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.437150  9208 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.437422  8910 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 0.
I20260709 13:15:18.437477  8958 raft_consensus.cc:359] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.437819  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:18.438277  8958 raft_consensus.cc:385] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.438484  8763 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.438599  8958 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.439302  8958 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.441540  8958 ts_tablet_manager.cc:1434] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:15:18.441972  8732 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:18.442490  8958 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.443564  9303 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.443982  9303 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.444316  9303 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.449852  8958 tablet_bootstrap.cc:654] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.450881  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:18.451545  8909 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.459933  9325 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.461550  8959 raft_consensus.cc:359] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.462841  8959 raft_consensus.cc:385] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.463564  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:18.466936  9303 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.462356  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:18.468441  8763 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:18.469543  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:18.471297  8909 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:18.463188  8959 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.471752  9208 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.472668  8959 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.473449  9208 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:18.473935  8768 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.474324  9208 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:18.478947  8735 leader_election.cc:343] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.481218  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:18.481846  8910 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.483510  9325 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.471751  9303 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.487048  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:18.489329  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:18.493702  8912 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.492827  8958 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.494503  8958 ts_tablet_manager.cc:1403] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.018s
I20260709 13:15:18.480737  8768 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
W20260709 13:15:18.498456  8735 leader_election.cc:343] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:18.497167  8958 raft_consensus.cc:359] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.500500  8958 raft_consensus.cc:385] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.500597  8912 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:18.500804  8958 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.500973  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:18.501462  8958 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.501811  9325 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.502369  9325 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:18.503738  8958 ts_tablet_manager.cc:1434] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:15:18.503844  9325 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.504801  8958 tablet_bootstrap.cc:492] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.516430  8958 tablet_bootstrap.cc:654] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.516569  8959 ts_tablet_manager.cc:1434] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.109s	user 0.010s	sys 0.000s
I20260709 13:15:18.517805  8959 tablet_bootstrap.cc:492] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Bootstrap starting.
I20260709 13:15:18.497725  8910 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:18.520666  8732 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:18.521281  8664 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.523972  8958 tablet_bootstrap.cc:492] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.524580  8958 ts_tablet_manager.cc:1403] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 13:15:18.527758  8958 raft_consensus.cc:359] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.526290  9273 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.528457  8958 raft_consensus.cc:385] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.528761  8958 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.529708  8958 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.530345  9325 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.530818  9325 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.531433  8958 ts_tablet_manager.cc:1434] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:18.532411  8958 tablet_bootstrap.cc:492] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Bootstrap starting.
I20260709 13:15:18.532826  9325 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.532881  8959 tablet_bootstrap.cc:654] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.534409  9273 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:18.538884  8958 tablet_bootstrap.cc:654] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:18.539515  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.535280  9273 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.547621  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.550236  8665 catalog_manager.cc:5697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.555356  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:18.558537  9208 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:18.610654  8665 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.617197  8958 tablet_bootstrap.cc:492] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: No bootstrap required, opened a new log
I20260709 13:15:18.617715  8958 ts_tablet_manager.cc:1403] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.046s
I20260709 13:15:18.620083  8959 tablet_bootstrap.cc:492] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: No bootstrap required, opened a new log
I20260709 13:15:18.620563  8959 ts_tablet_manager.cc:1403] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.010s
I20260709 13:15:18.622946  8958 raft_consensus.cc:359] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.623673  8958 raft_consensus.cc:385] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.623950  8958 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.625187  8958 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.627560  8958 ts_tablet_manager.cc:1434] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:15:18.628499  8959 raft_consensus.cc:359] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.629273  8959 raft_consensus.cc:385] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:18.629505  8959 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Initialized, Role: FOLLOWER
I20260709 13:15:18.630113  8959 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.631693  8959 ts_tablet_manager.cc:1434] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:18.645490  8843 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:18.647920  8715 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:18.654238  9273 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.666702  9351 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.673911  9208 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.674443  9208 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.681247  9208 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.682648  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.683270  8763 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:18.685612  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.686275  8910 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 0.
I20260709 13:15:18.687558  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:18.688258  9208 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:18.688714  9208 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.689158  9208 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.699366  9208 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.701766  9208 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.702854  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:18.703577  8910 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.704064  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:18.704665  8763 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.710618  8763 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:18.711817  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:18.714432  9325 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:18.715003  9325 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:18.714586  8910 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:18.715837  9325 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.722448  8842 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.728579  8665 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 0 to 1, leader changed from <none> to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:18.752523  9351 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:18.756220  8842 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.766445  9225 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.819830  9324 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.820353  9324 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.822440  9324 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:18.822996  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.823248  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:18.823647  8763 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:18.823846  8842 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:18.824659  8882 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:18.825335  9324 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:18.825695  9324 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:18.826059  9324 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.831491  9324 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.833000  9325 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:18.833650  9325 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.835320  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:18.835992  8841 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.836794  9325 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:18.837394  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:18.838878  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:18.839600  8910 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 1: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:18.834689  9324 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:18.834018  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:18.840526  8763 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:18.842938  8841 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:18.842895  8807 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:18.843807  9325 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:18.844128  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:18.845054  9324 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:18.845522  9324 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:18.846866  8763 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:18.847251  9324 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:18.853302  9325 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:18.857103  8664 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 0 to 2, leader changed from <none> to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:18.923352  9325 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.924098  9225 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.928771  9127 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.950194  9208 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.950413  9351 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.958230  9208 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:18.964704  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:18.996419  9421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.007781  9423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:19.017830  9426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:19.018751  7657 server_base.cc:1061] running on GCE node
I20260709 13:15:19.021034  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:19.021423  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:19.021716  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783602919021694 us; error 0 us; skew 500 ppm
I20260709 13:15:19.022658  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:19.031826  7657 webserver.cc:533] Webserver started at http://127.7.122.68:35445/ using document root <none> and password file <none>
I20260709 13:15:19.032418  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:19.032639  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:19.033087  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:19.034490  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-3-root/instance:
uuid: "3b34c95a175945b88b17f07fbc650abf"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-078m"
I20260709 13:15:19.040506  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:15:19.078583  9430 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.079598  7657 fs_manager.cc:730] Time spent opening block manager: real 0.036s	user 0.004s	sys 0.000s
I20260709 13:15:19.079873  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-3-root
uuid: "3b34c95a175945b88b17f07fbc650abf"
format_stamp: "Formatted at 2026-07-09 13:15:19 on dist-test-slave-078m"
I20260709 13:15:19.080165  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:19.093518  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:19.095126  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:19.096681  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:19.099669  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:19.099920  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.100185  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:19.100383  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:19.205006  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.68:45973
I20260709 13:15:19.205124  9492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.68:45973 every 8 connection(s)
I20260709 13:15:19.214421  7657 auto_leader_rebalancer-test.cc:384] add a tserver: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:19.233819  9493 heartbeater.cc:344] Connected to a master server at 127.7.122.126:41961
I20260709 13:15:19.234237  9493 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:19.234948  9493 heartbeater.cc:507] Master 127.7.122.126:41961 requested a full tablet report, sending...
I20260709 13:15:19.237049  8667 ts_manager.cc:194] Registered new tserver with Master: 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:19.239179  8667 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51808
I20260709 13:15:19.276455  9208 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:19.288578  9127 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.334326  8837 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:19.335908  9294 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.356477  8763 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:19.358922  9324 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:19.732491  8763 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:19.743201  8912 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:19.744129  8837 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:19.744529  9225 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.748013  9225 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.762037  9271 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.766745  8842 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:15:19.768851  8734 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a85c28eb5f2e4741b40ca8723a62f870. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:19.773844  8912 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.790102  8667 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.834709  8842 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:19.843490  8910 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.844180  8764 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:19.844986  9325 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.845920  9418 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:19.860745  8809 consensus_peers.cc:597] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1d69638bb504813949178c6aee64727. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:19.864442  9208 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.866108  8764 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.880731  8764 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:19.887816  8664 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.889051  8912 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:19.888032  8910 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.890821  8842 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:19.891491  8734 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 405e426995614183bb2a212fc38e04b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:19.892540  9271 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.899696  9271 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.906301  9351 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.910674  8837 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.924373  8764 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:19.931872  8664 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:19.932787  8909 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.949957  8912 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:19.952283  9271 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:19.955559  8734 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 282538f07daf4dcdb59352e756a62ba8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:19.965116  8837 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:19.968451  9271 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:19.979426  9225 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.981205  8912 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:19.986505  8842 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:20.001797  8665 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:20.237951  9522 ts_tablet_manager.cc:933] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:20.243742  9493 heartbeater.cc:499] Master 127.7.122.126:41961 was elected leader, sending a full tablet report...
I20260709 13:15:20.251353  9522 tablet_copy_client.cc:323] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:20.273905  9525 ts_tablet_manager.cc:933] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:20.277571  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet d1d69638bb504813949178c6aee64727 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:20.277968  9525 tablet_copy_client.cc:323] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:20.278331  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet d1d69638bb504813949178c6aee64727 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-d1d69638bb504813949178c6aee64727
I20260709 13:15:20.292325  8854 tablet_copy_source_session.cc:215] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:20.297441  9522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1d69638bb504813949178c6aee64727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.307922  8779 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet a85c28eb5f2e4741b40ca8723a62f870 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:20.308568  8779 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet a85c28eb5f2e4741b40ca8723a62f870 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-a85c28eb5f2e4741b40ca8723a62f870
I20260709 13:15:20.316810  9522 tablet_copy_client.cc:806] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:20.317698  9522 tablet_copy_client.cc:670] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:20.321764  8779 tablet_copy_source_session.cc:215] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:20.322885  9522 tablet_copy_client.cc:538] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:20.326232  9525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a85c28eb5f2e4741b40ca8723a62f870. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.343261  9525 tablet_copy_client.cc:806] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:20.343858  9525 tablet_copy_client.cc:670] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:20.347374  9522 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:20.351907  9525 tablet_copy_client.cc:538] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:20.380600  9522 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:20.381891  9522 tablet_bootstrap.cc:492] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:20.382504  9525 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:20.382675  9522 ts_tablet_manager.cc:1403] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.015s
I20260709 13:15:20.387251  9522 raft_consensus.cc:359] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.388231  9522 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:20.395789  9522 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.412271  9529 ts_tablet_manager.cc:933] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:20.415210  9522 ts_tablet_manager.cc:1434] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.011s
I20260709 13:15:20.419031  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-d1d69638bb504813949178c6aee64727 received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:20.419602  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-d1d69638bb504813949178c6aee64727 on tablet d1d69638bb504813949178c6aee64727 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:20.424999  9529 tablet_copy_client.cc:323] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:20.426221  9525 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:20.426757  8779 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet 405e426995614183bb2a212fc38e04b0 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:20.427150  9525 tablet_bootstrap.cc:492] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:20.427340  8779 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet 405e426995614183bb2a212fc38e04b0 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-405e426995614183bb2a212fc38e04b0
I20260709 13:15:20.428099  9525 ts_tablet_manager.cc:1403] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.003s
I20260709 13:15:20.431277  9525 raft_consensus.cc:359] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.432137  9525 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:20.432775  9525 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.435990  8779 tablet_copy_source_session.cc:215] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:20.445020  9525 ts_tablet_manager.cc:1434] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.009s
I20260709 13:15:20.447407  8778 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-a85c28eb5f2e4741b40ca8723a62f870 received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:20.448107  8778 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-a85c28eb5f2e4741b40ca8723a62f870 on tablet a85c28eb5f2e4741b40ca8723a62f870 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:20.448685  9529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 405e426995614183bb2a212fc38e04b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.464998  9529 tablet_copy_client.cc:806] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:20.465590  9529 tablet_copy_client.cc:670] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:20.469633  9529 tablet_copy_client.cc:538] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:20.478377  9529 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:20.497416  9529 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:20.498238  9529 tablet_bootstrap.cc:492] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:20.499125  9529 ts_tablet_manager.cc:1403] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:15:20.501838  9529 raft_consensus.cc:359] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.502622  9529 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:20.503273  9529 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.506032  9529 ts_tablet_manager.cc:1434] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:15:20.507721  8779 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-405e426995614183bb2a212fc38e04b0 received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:20.508234  8779 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-405e426995614183bb2a212fc38e04b0 on tablet 405e426995614183bb2a212fc38e04b0 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:20.534230  9529 ts_tablet_manager.cc:933] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:20.541646  9529 tablet_copy_client.cc:323] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:20.543212  8779 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet 282538f07daf4dcdb59352e756a62ba8 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:20.543848  8779 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet 282538f07daf4dcdb59352e756a62ba8 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-282538f07daf4dcdb59352e756a62ba8
I20260709 13:15:20.548602  8779 tablet_copy_source_session.cc:215] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:20.551626  9529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282538f07daf4dcdb59352e756a62ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:20.564893  9529 tablet_copy_client.cc:806] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:20.565483  9529 tablet_copy_client.cc:670] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:20.569603  9529 tablet_copy_client.cc:538] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:20.577421  9529 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:20.594161  9529 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:20.595152  9529 tablet_bootstrap.cc:492] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:20.595854  9529 ts_tablet_manager.cc:1403] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.001s
I20260709 13:15:20.598376  9529 raft_consensus.cc:359] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.599051  9529 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:20.599593  9529 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:20.601724  9529 ts_tablet_manager.cc:1434] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:20.603853  8779 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-282538f07daf4dcdb59352e756a62ba8 received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:20.604311  8779 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-282538f07daf4dcdb59352e756a62ba8 on tablet 282538f07daf4dcdb59352e756a62ba8 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:20.656687  9468 raft_consensus.cc:1217] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:15:20.823333  9468 raft_consensus.cc:1217] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:20.993000  9468 raft_consensus.cc:1217] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:21.043550  9468 raft_consensus.cc:1217] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:21.168164  9325 raft_consensus.cc:1064] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:21.170572  9325 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.177034  9468 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:21.177357  8909 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:21.179064  9418 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.180944  9539 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.185336  8763 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:21.186667  9540 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.205113  9539 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.217485  8763 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.227573  8909 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.216516  9468 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.236011  8667 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.254238  9271 raft_consensus.cc:1064] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:21.256507  9271 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.273041  8909 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.274768  8837 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.275293  9468 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.276355  9351 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.278574  9271 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.279291  9351 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.340827  9271 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.346887  9468 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.347505  8842 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.357643  8837 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.370225  9467 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:21.373157  8909 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:21.375262  9325 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.377100  9325 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.378589  8665 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.379868  8909 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.391103  9418 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.395459  8910 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.407248  9468 raft_consensus.cc:2955] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.434396  9549 raft_consensus.cc:1064] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:21.437081  9549 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.440971  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d1d69638bb504813949178c6aee64727 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:21.448521  8763 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.455178  8664 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.467371  9467 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:21.469383  8842 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:21.469421  9351 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:21.473985  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet d1d69638bb504813949178c6aee64727 with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60040
I20260709 13:15:21.485551  9271 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:21.503201  9548 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.506944  8842 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.519872  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a85c28eb5f2e4741b40ca8723a62f870 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:21.540674  9467 raft_consensus.cc:2955] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.545478  9555 tablet_replica.cc:333] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:15:21.547466  8664 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.561565  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet a85c28eb5f2e4741b40ca8723a62f870 with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42810
I20260709 13:15:21.562764  9271 raft_consensus.cc:1064] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:21.563196  9555 raft_consensus.cc:2243] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.563848  9555 raft_consensus.cc:2272] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.569228  9271 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.573829  9556 tablet_replica.cc:333] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:15:21.575147  9556 raft_consensus.cc:2243] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.576154  9556 raft_consensus.cc:2272] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.576556  9555 ts_tablet_manager.cc:1916] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:21.581004  9556 ts_tablet_manager.cc:1916] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:21.583943  8910 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.585457  9468 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.585901  9548 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.587257  9225 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.594508  8837 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.598055  9548 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.606676  9466 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.606891  8842 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.609123  9225 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.609736  8909 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:21.610024  9351 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.611131  9549 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:21.619372  9555 ts_tablet_manager.cc:1929] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:15:21.619931  9555 log.cc:1199] T d1d69638bb504813949178c6aee64727 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/d1d69638bb504813949178c6aee64727
I20260709 13:15:21.623514  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet d1d69638bb504813949178c6aee64727 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:21.626703  9556 ts_tablet_manager.cc:1929] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:21.627278  9556 log.cc:1199] T a85c28eb5f2e4741b40ca8723a62f870 P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/a85c28eb5f2e4741b40ca8723a62f870
I20260709 13:15:21.629603  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet a85c28eb5f2e4741b40ca8723a62f870 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
W20260709 13:15:21.638895  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66791.6us
I20260709 13:15:21.659237  9351 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.660663  9549 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.661525  9468 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.679152  8842 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.679920  8837 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.684393  9467 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.686829  8664 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:21.707084  8910 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.713408  8667 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.714829  8764 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.715965  8909 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.744765  9467 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:21.751828  9225 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.768006  9225 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.768994  8837 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:21.770925  9351 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.776088  8842 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.773567  9468 raft_consensus.cc:2955] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.789115  8764 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:21.798944  9467 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:21.800709  9271 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.806103  8664 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.811101  9351 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.816259  9466 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.824652  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet 282538f07daf4dcdb59352e756a62ba8 with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42810
I20260709 13:15:21.826037  9556 tablet_replica.cc:333] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:15:21.827229  9556 raft_consensus.cc:2243] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.828051  9556 raft_consensus.cc:2272] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.833125  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 282538f07daf4dcdb59352e756a62ba8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:21.840283  9556 ts_tablet_manager.cc:1916] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:21.844537  8667 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.847180  8910 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:21.860565  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet 405e426995614183bb2a212fc38e04b0 with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40098
I20260709 13:15:21.878321  9225 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:21.881500  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 405e426995614183bb2a212fc38e04b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:21.884852  9566 tablet_replica.cc:333] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:15:21.891897  8909 raft_consensus.cc:2955] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:21.896273  9556 ts_tablet_manager.cc:1929] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:21.896787  9556 log.cc:1199] T 282538f07daf4dcdb59352e756a62ba8 P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/282538f07daf4dcdb59352e756a62ba8
I20260709 13:15:21.898241  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet 282538f07daf4dcdb59352e756a62ba8 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:21.915660  9566 raft_consensus.cc:2243] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.916512  9566 raft_consensus.cc:2272] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.919028  9566 ts_tablet_manager.cc:1916] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:21.934226  9566 ts_tablet_manager.cc:1929] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:21.934964  9566 log.cc:1199] T 405e426995614183bb2a212fc38e04b0 P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/405e426995614183bb2a212fc38e04b0
I20260709 13:15:21.936779  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet 405e426995614183bb2a212fc38e04b0 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:22.934691  8910 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:22.941344  8842 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:22.941751  8763 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:22.942888  9535 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:22.944118  9571 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:22.966089  9571 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:22.968926  8763 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:15:22.994448  8883 consensus_peers.cc:597] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c5dcaab01b5438f9054f5e8fcbd0a5c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:22.995227  8842 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:22.997641  8764 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.008814  8910 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:23.010612  9565 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:23.011643  8842 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:23.011899  8734 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 49a7db9f466c48ccb2c5c350cb6351b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:23.013999  9225 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.013728  8664 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.029587  9225 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.045468  8910 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.057663  8909 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.065807  8842 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:15:23.071414  8883 consensus_peers.cc:597] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af7776ba20a14a499de5919550fdada6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:23.073035  8763 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.074083  8841 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.074813  9576 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.077140  9535 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.086858  8667 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.093838  9571 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.096537  8763 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.120194  8836 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.139240  8841 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:15:23.142964  8809 consensus_peers.cc:597] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c65b41257e7e4b66b28805964b4e7d16. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:23.144680  8666 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.152947  8763 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:23.154323  8912 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:23.155786  9418 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:23.157827  9325 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.177166  9567 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.178629  8912 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.179463  8764 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.198036  8667 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:23.408685  9595 ts_tablet_manager.cc:933] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:23.411049  9595 tablet_copy_client.cc:323] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:23.413226  8779 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet 49a7db9f466c48ccb2c5c350cb6351b3 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:23.413890  8779 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet 49a7db9f466c48ccb2c5c350cb6351b3 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-49a7db9f466c48ccb2c5c350cb6351b3
I20260709 13:15:23.421984  8779 tablet_copy_source_session.cc:215] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:23.425305  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a7db9f466c48ccb2c5c350cb6351b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.439966  9595 tablet_copy_client.cc:806] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:23.440585  9595 tablet_copy_client.cc:670] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:23.445705  9595 tablet_copy_client.cc:538] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:23.456285  9595 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:23.477553  9595 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:23.478641  9595 tablet_bootstrap.cc:492] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:23.479347  9595 ts_tablet_manager.cc:1403] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.011s
I20260709 13:15:23.482625  9595 raft_consensus.cc:359] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.483469  9595 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:23.484104  9595 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.489490  9595 ts_tablet_manager.cc:1434] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:15:23.491585  8779 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-49a7db9f466c48ccb2c5c350cb6351b3 received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:23.492064  8779 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-49a7db9f466c48ccb2c5c350cb6351b3 on tablet 49a7db9f466c48ccb2c5c350cb6351b3 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:23.546108  9595 ts_tablet_manager.cc:933] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:23.548125  9595 tablet_copy_client.cc:323] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.67:39883
I20260709 13:15:23.561728  8928 tablet_copy_service.cc:140] P bdb96be202c2447586477b2077b7d5bf: Received BeginTabletCopySession request for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:23.562276  8928 tablet_copy_service.cc:161] P bdb96be202c2447586477b2077b7d5bf: Beginning new tablet copy session on tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:35822: session id = 3b34c95a175945b88b17f07fbc650abf-2c5dcaab01b5438f9054f5e8fcbd0a5c
I20260709 13:15:23.567839  8928 tablet_copy_source_session.cc:215] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:23.571164  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.585618  9595 tablet_copy_client.cc:806] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:23.586225  9595 tablet_copy_client.cc:670] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:23.590166  9595 tablet_copy_client.cc:538] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:23.600457  9595 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:23.627596  9595 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:23.628407  9595 tablet_bootstrap.cc:492] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:23.629034  9595 ts_tablet_manager.cc:1403] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.011s
I20260709 13:15:23.631762  9595 raft_consensus.cc:359] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.632429  9595 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:23.633554  9603 ts_tablet_manager.cc:933] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:23.633193  9595 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.658128  9595 ts_tablet_manager.cc:1434] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.005s
I20260709 13:15:23.670956  8928 tablet_copy_service.cc:342] P bdb96be202c2447586477b2077b7d5bf: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-2c5dcaab01b5438f9054f5e8fcbd0a5c received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:23.671455  8928 tablet_copy_service.cc:434] P bdb96be202c2447586477b2077b7d5bf: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-2c5dcaab01b5438f9054f5e8fcbd0a5c on tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:23.692966  9595 ts_tablet_manager.cc:933] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:23.697721  9603 tablet_copy_client.cc:323] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.67:39883
I20260709 13:15:23.702132  8928 tablet_copy_service.cc:140] P bdb96be202c2447586477b2077b7d5bf: Received BeginTabletCopySession request for tablet af7776ba20a14a499de5919550fdada6 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:23.702708  8928 tablet_copy_service.cc:161] P bdb96be202c2447586477b2077b7d5bf: Beginning new tablet copy session on tablet af7776ba20a14a499de5919550fdada6 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:35822: session id = 3b34c95a175945b88b17f07fbc650abf-af7776ba20a14a499de5919550fdada6
I20260709 13:15:23.722211  9595 tablet_copy_client.cc:323] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:23.728132  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet c65b41257e7e4b66b28805964b4e7d16 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:23.729045  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet c65b41257e7e4b66b28805964b4e7d16 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-c65b41257e7e4b66b28805964b4e7d16
I20260709 13:15:23.726627  8928 tablet_copy_source_session.cc:215] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:23.740074  8854 tablet_copy_source_session.cc:215] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:23.745894  9595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c65b41257e7e4b66b28805964b4e7d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.760434  9603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af7776ba20a14a499de5919550fdada6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:23.784621  9603 tablet_copy_client.cc:806] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:23.793262  9603 tablet_copy_client.cc:670] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:23.795610  9595 tablet_copy_client.cc:806] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:23.796115  9595 tablet_copy_client.cc:670] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:23.799727  9603 tablet_copy_client.cc:538] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:23.799932  9595 tablet_copy_client.cc:538] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:23.814601  9603 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:23.816751  9595 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:23.851861  9595 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:23.852762  9595 tablet_bootstrap.cc:492] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:23.853623  9603 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:23.854038  9595 ts_tablet_manager.cc:1403] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.008s
I20260709 13:15:23.854554  9603 tablet_bootstrap.cc:492] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:23.855266  9603 ts_tablet_manager.cc:1403] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.001s
I20260709 13:15:23.856436  9595 raft_consensus.cc:359] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.857098  9595 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:23.857578  9595 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.858208  9603 raft_consensus.cc:359] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.859055  9603 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:23.859390  9595 ts_tablet_manager.cc:1434] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:15:23.859704  9603 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:23.862980  9603 ts_tablet_manager.cc:1434] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:15:23.863924  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-c65b41257e7e4b66b28805964b4e7d16 received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:23.864396  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-c65b41257e7e4b66b28805964b4e7d16 on tablet c65b41257e7e4b66b28805964b4e7d16 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:23.864790  8928 tablet_copy_service.cc:342] P bdb96be202c2447586477b2077b7d5bf: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-af7776ba20a14a499de5919550fdada6 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:23.865245  8928 tablet_copy_service.cc:434] P bdb96be202c2447586477b2077b7d5bf: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-af7776ba20a14a499de5919550fdada6 on tablet af7776ba20a14a499de5919550fdada6 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:23.946936  9468 raft_consensus.cc:1217] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:24.003562  9468 raft_consensus.cc:1217] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:24.180833  9468 raft_consensus.cc:1217] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:15:24.250324  9466 raft_consensus.cc:1217] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:24.490792  9225 raft_consensus.cc:1064] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:24.493219  9225 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:24.507807  9468 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.508443  8910 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.509784  9616 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.510890  8836 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.511173  9605 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.514506  9584 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.528568  9616 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.530766  8909 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.550348  9468 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.555059  8841 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.561225  8667 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.581607  9591 raft_consensus.cc:1064] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:24.592962  9591 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:24.644126  8763 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.644537  8836 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.645694  9591 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:24.646379  9468 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.647909  9571 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.657274  9614 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.664438  8763 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:24.675133  9571 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.691951  8764 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.687295  9468 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.694015  8836 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.715515  9466 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:24.717654  9225 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.728590  8910 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:24.732928  9584 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.734486  9613 raft_consensus.cc:1064] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:24.737344  9613 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:24.703797  8664 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:24.748404  9616 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.754127  9620 raft_consensus.cc:1064] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:24.756827  9620 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:24.758359  9467 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:24.782590  9614 consensus_queue.cc:1175] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20260709 13:15:24.784288  8918 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:24.783533  8910 raft_consensus.cc:2955] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.786901  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 49a7db9f466c48ccb2c5c350cb6351b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:24.792796  8665 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.797401  9468 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:24.800293  9613 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:24.804271  9466 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:24.807123  9613 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.812479  8764 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:24.824765  8843 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:24.826104  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet 49a7db9f466c48ccb2c5c350cb6351b3 with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40098
I20260709 13:15:24.831346  9636 tablet_replica.cc:333] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:15:24.834444  9636 raft_consensus.cc:2243] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:24.831239  8841 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:24.835180  9591 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.838616  9608 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:24.840196  9636 raft_consensus.cc:2272] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:24.844930  9636 ts_tablet_manager.cc:1916] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:24.869165  9591 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:24.874572  9614 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:24.885679  8651 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:24.928149  9466 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:24.931524  9617 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:15:24.871807  9467 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:24.994354  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47582.7us
W20260709 13:15:25.005872  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51264.8us
I20260709 13:15:25.000290  9608 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.005349  8843 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:25.046761  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 79026.3us
I20260709 13:15:25.045630  8665 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.052942  9636 ts_tablet_manager.cc:1929] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:25.053619  9636 log.cc:1199] T 49a7db9f466c48ccb2c5c350cb6351b3 P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/49a7db9f466c48ccb2c5c350cb6351b3
I20260709 13:15:25.062216  8763 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:25.066171  8918 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:25.068496  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet 49a7db9f466c48ccb2c5c350cb6351b3 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:25.070456  9325 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:25.085729  8842 raft_consensus.cc:2955] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.072335  9617 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:15:25.112143  9467 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.123765  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60040
I20260709 13:15:25.151584  8764 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.157855  9618 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.159819  9468 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.172070  8910 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.176707  9645 tablet_replica.cc:333] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:15:25.177840  9645 raft_consensus.cc:2243] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:25.166844  8665 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.178685  9645 raft_consensus.cc:2272] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:25.183120  9645 ts_tablet_manager.cc:1916] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:25.181272  8764 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.221318  8666 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.228968  8910 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:25.236999  9466 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:25.236963  9645 ts_tablet_manager.cc:1929] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:25.239004  9645 log.cc:1199] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/2c5dcaab01b5438f9054f5e8fcbd0a5c
I20260709 13:15:25.241621  9615 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:25.242130  8842 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:25.243384  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet 2c5dcaab01b5438f9054f5e8fcbd0a5c (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:25.245850  9571 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:25.253635  9571 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.257768  8843 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:25.261130  8836 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.263729  9466 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:25.267154  9325 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:25.271533  8764 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:25.273109  8651 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af7776ba20a14a499de5919550fdada6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:25.276146  9468 raft_consensus.cc:2955] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.278821  9618 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:25.286648  8667 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:25.288443  9617 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.295403  8764 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.308291  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet af7776ba20a14a499de5919550fdada6 with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60040
I20260709 13:15:25.304538  9468 raft_consensus.cc:2955] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.309329  9645 tablet_replica.cc:333] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:15:25.310382  9645 raft_consensus.cc:2243] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:25.311136  9645 raft_consensus.cc:2272] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:25.315621  9645 ts_tablet_manager.cc:1916] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:25.321362  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c65b41257e7e4b66b28805964b4e7d16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:25.325280  8667 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:25.339128  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet c65b41257e7e4b66b28805964b4e7d16 with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42810
I20260709 13:15:25.343113  9646 tablet_replica.cc:333] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:15:25.349299  9646 raft_consensus.cc:2243] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:25.350122  9646 raft_consensus.cc:2272] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:25.361522  9645 ts_tablet_manager.cc:1929] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:15:25.363140  9646 ts_tablet_manager.cc:1916] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:25.363179  9645 log.cc:1199] T af7776ba20a14a499de5919550fdada6 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/af7776ba20a14a499de5919550fdada6
I20260709 13:15:25.365710  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet af7776ba20a14a499de5919550fdada6 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:25.376988  9646 ts_tablet_manager.cc:1929] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:25.377527  9646 log.cc:1199] T c65b41257e7e4b66b28805964b4e7d16 P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/c65b41257e7e4b66b28805964b4e7d16
I20260709 13:15:25.379073  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet c65b41257e7e4b66b28805964b4e7d16 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:26.421069  8764 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
W20260709 13:15:26.428421  8734 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5380dc645e984447aefd4408bca2f2af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.428397  8910 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:26.430428  9639 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.435659  8836 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:26.437270  9649 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:26.442144  9641 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.449429  8842 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.451058  8910 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.459702  8664 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:26.461975  8764 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:26.482009  8918 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:26.483112  8734 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 019a0cde8c994b9a83ff212e5c02437c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.484457  9641 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:26.483919  8842 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:26.490940  9641 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:26.502317  9641 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.504531  8842 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.504565  8918 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.533423  8836 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:26.541247  8667 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.547801  8918 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:15:26.548830  8809 consensus_peers.cc:597] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f045ce88a76f4620ad6c717c8245982a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.548774  8764 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:26.551716  9325 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:26.553907  9617 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:26.564950  9325 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.569416  8918 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.574333  8764 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.590227  8666 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 3, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.597927  8836 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
W20260709 13:15:26.607246  8809 consensus_peers.cc:597] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bccdb4728c764cc0a333f593ab71c511. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:26.608551  8764 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:26.611369  9647 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.622661  9617 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.624681  8909 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:26.627902  9618 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.633975  8910 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.637332  8764 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.659755  8667 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:26.876370  9667 ts_tablet_manager.cc:933] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:26.879151  9667 tablet_copy_client.cc:323] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:26.881476  8779 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet 019a0cde8c994b9a83ff212e5c02437c from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:26.882121  8779 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet 019a0cde8c994b9a83ff212e5c02437c from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-019a0cde8c994b9a83ff212e5c02437c
I20260709 13:15:26.889065  8779 tablet_copy_source_session.cc:215] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:26.892910  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 019a0cde8c994b9a83ff212e5c02437c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.911806  9667 tablet_copy_client.cc:806] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:26.912477  9667 tablet_copy_client.cc:670] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:26.917243  9667 tablet_copy_client.cc:538] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:26.926824  9667 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:26.939518  9669 ts_tablet_manager.cc:933] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:26.941622  9669 tablet_copy_client.cc:323] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:26.943279  8779 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet 5380dc645e984447aefd4408bca2f2af from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:26.943787  8779 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet 5380dc645e984447aefd4408bca2f2af from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-5380dc645e984447aefd4408bca2f2af
I20260709 13:15:26.950875  8779 tablet_copy_source_session.cc:215] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:26.954936  9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5380dc645e984447aefd4408bca2f2af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:26.959046  9667 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:26.960150  9667 tablet_bootstrap.cc:492] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:26.960999  9667 ts_tablet_manager.cc:1403] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.034s	user 0.022s	sys 0.005s
I20260709 13:15:26.964398  9667 raft_consensus.cc:359] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:26.965288  9667 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:26.966025  9667 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:26.972751  9667 ts_tablet_manager.cc:1434] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:26.973453  9669 tablet_copy_client.cc:806] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:26.974133  9669 tablet_copy_client.cc:670] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:26.978224  8779 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-019a0cde8c994b9a83ff212e5c02437c received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:26.978754  8779 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-019a0cde8c994b9a83ff212e5c02437c on tablet 019a0cde8c994b9a83ff212e5c02437c with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:26.985221  9669 tablet_copy_client.cc:538] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:26.994247  9667 ts_tablet_manager.cc:933] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:26.996963  9669 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:27.005088  9667 tablet_copy_client.cc:323] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:27.007653  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet bccdb4728c764cc0a333f593ab71c511 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:27.008289  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet bccdb4728c764cc0a333f593ab71c511 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-bccdb4728c764cc0a333f593ab71c511
I20260709 13:15:27.022262  8854 tablet_copy_source_session.cc:215] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:27.025942  9667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bccdb4728c764cc0a333f593ab71c511. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.031781  9669 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:27.032811  9669 tablet_bootstrap.cc:492] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:27.033567  9669 ts_tablet_manager.cc:1403] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.010s
I20260709 13:15:27.036898  9669 raft_consensus.cc:359] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:27.037784  9669 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:27.038511  9669 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:27.041359  9669 ts_tablet_manager.cc:1434] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:27.049082  8778 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-5380dc645e984447aefd4408bca2f2af received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:27.049815  8778 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-5380dc645e984447aefd4408bca2f2af on tablet 5380dc645e984447aefd4408bca2f2af with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:27.060182  9669 ts_tablet_manager.cc:933] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:27.086524  9669 tablet_copy_client.cc:323] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:27.089681  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet f045ce88a76f4620ad6c717c8245982a from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:27.090266  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet f045ce88a76f4620ad6c717c8245982a from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-f045ce88a76f4620ad6c717c8245982a
I20260709 13:15:27.096275  8854 tablet_copy_source_session.cc:215] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:27.108235  9669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f045ce88a76f4620ad6c717c8245982a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:27.108625  9667 tablet_copy_client.cc:806] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:27.109350  9667 tablet_copy_client.cc:670] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:27.113731  9667 tablet_copy_client.cc:538] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:27.125548  9669 tablet_copy_client.cc:806] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:27.126456  9669 tablet_copy_client.cc:670] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:27.126669  9667 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:27.130498  9669 tablet_copy_client.cc:538] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:27.137468  9669 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:27.169202  9667 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:27.174409  9667 tablet_bootstrap.cc:492] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:27.175212  9667 ts_tablet_manager.cc:1403] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.049s	user 0.027s	sys 0.004s
I20260709 13:15:27.178323  9667 raft_consensus.cc:359] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:27.179263  9667 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:27.179991  9667 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:27.183013  9667 ts_tablet_manager.cc:1434] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:27.193933  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-bccdb4728c764cc0a333f593ab71c511 received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:27.194649  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-bccdb4728c764cc0a333f593ab71c511 on tablet bccdb4728c764cc0a333f593ab71c511 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:27.257412  9669 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:27.258404  9669 tablet_bootstrap.cc:492] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:27.259016  9669 ts_tablet_manager.cc:1403] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.122s	user 0.052s	sys 0.046s
I20260709 13:15:27.261773  9669 raft_consensus.cc:359] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:27.262454  9669 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:27.263036  9669 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:27.265391  9669 ts_tablet_manager.cc:1434] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 13:15:27.267975  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-f045ce88a76f4620ad6c717c8245982a received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:27.268414  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-f045ce88a76f4620ad6c717c8245982a on tablet f045ce88a76f4620ad6c717c8245982a with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:27.324090  9468 raft_consensus.cc:1217] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:27.328656  9468 raft_consensus.cc:1217] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:27.372884  9468 raft_consensus.cc:1217] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:27.506572  9468 raft_consensus.cc:1217] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 13:15:27.764045  9225 raft_consensus.cc:1064] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:27.766355  9225 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:27.772137  8910 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.772472  9468 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.773718  9641 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.775068  8836 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.775813  9225 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.779088  9676 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:27.792691  9617 raft_consensus.cc:1064] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:27.795279  9617 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:27.800303  9676 raft_consensus.cc:1064] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:27.803900  9676 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:27.807515  9466 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.815640  8909 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.819185  9665 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.821201  9665 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.829743  8764 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.831290  9617 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.831689  9641 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.834909  8910 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.886571  8842 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.890056  9639 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:27.891357  9466 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.895915  9665 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.907691  8909 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.918876  9688 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:27.938716  9467 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:27.940557  9676 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:27.941339  9467 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.946025  8836 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.955334  8666 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:27.993628  8909 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.002306  9688 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.022665  8912 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.035693  8764 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.046705  9617 raft_consensus.cc:1064] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:28.049825  8836 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.043057  9466 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.061049  9617 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:28.069799  9468 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:28.071929  9681 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.078374  8764 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:28.079718  8909 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:28.081499  9665 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.082628  9682 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.116006  8764 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:28.125250  9467 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:28.127681  9225 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:28.130824  8667 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.132082  8909 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:28.132591  8667 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.135613  9225 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.136453  9688 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.145635  9467 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.143420  9665 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.147974  8909 raft_consensus.cc:2955] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.151847  9466 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.172832  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 019a0cde8c994b9a83ff212e5c02437c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:28.178650  8842 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:28.201576  8665 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 3 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.206261  9467 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:28.188613  8664 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.207896  9665 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:28.215149  9705 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.220396  8769 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:28.221899  9681 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:28.219172  8764 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.232007  8766 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.235752  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bccdb4728c764cc0a333f593ab71c511 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:28.235363  9467 raft_consensus.cc:2955] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.241853  8910 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.255439  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet 019a0cde8c994b9a83ff212e5c02437c with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40098
I20260709 13:15:28.272644  8665 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.285310  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet bccdb4728c764cc0a333f593ab71c511 with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42810
I20260709 13:15:28.295406  8766 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:28.303483  9467 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:28.304970  8912 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:28.305367  9225 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:28.306582  9641 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:28.309439  8836 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:28.316256  9708 tablet_replica.cc:333] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:15:28.320291  9639 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.322382  9467 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.325791  9708 raft_consensus.cc:2243] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.326732  9708 raft_consensus.cc:2272] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.330580  9468 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:28.332432  9705 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:28.335786  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5380dc645e984447aefd4408bca2f2af with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:28.337989  8912 raft_consensus.cc:2955] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.341337  9708 ts_tablet_manager.cc:1916] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:28.346185  9665 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.353390  9468 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.356288  9709 tablet_replica.cc:333] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:15:28.359318  9708 ts_tablet_manager.cc:1929] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:28.359802  9708 log.cc:1199] T 019a0cde8c994b9a83ff212e5c02437c P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/019a0cde8c994b9a83ff212e5c02437c
I20260709 13:15:28.361673  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet 019a0cde8c994b9a83ff212e5c02437c (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:28.362946  8910 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:28.369410  9682 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:28.373262  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f045ce88a76f4620ad6c717c8245982a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:28.376507  8910 raft_consensus.cc:2955] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.376793  8665 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:28.388564  8666 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 4 to 5, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.396950  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet 5380dc645e984447aefd4408bca2f2af with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40098
I20260709 13:15:28.397957  9708 tablet_replica.cc:333] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:15:28.399127  9708 raft_consensus.cc:2243] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.399976  9708 raft_consensus.cc:2272] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.400961  9709 raft_consensus.cc:2243] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.401757  9709 raft_consensus.cc:2272] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.405617  9709 ts_tablet_manager.cc:1916] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:28.420261  9708 ts_tablet_manager.cc:1916] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:28.429553  9709 ts_tablet_manager.cc:1929] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:28.430073  9709 log.cc:1199] T bccdb4728c764cc0a333f593ab71c511 P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/bccdb4728c764cc0a333f593ab71c511
I20260709 13:15:28.432837  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet bccdb4728c764cc0a333f593ab71c511 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:28.437781  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet f045ce88a76f4620ad6c717c8245982a with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60040
I20260709 13:15:28.439850  9710 tablet_replica.cc:333] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:15:28.442287  9710 raft_consensus.cc:2243] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:28.443507  9710 raft_consensus.cc:2272] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:28.445523  9708 ts_tablet_manager.cc:1929] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:28.446045  9708 log.cc:1199] T 5380dc645e984447aefd4408bca2f2af P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/5380dc645e984447aefd4408bca2f2af
I20260709 13:15:28.448412  9710 ts_tablet_manager.cc:1916] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:28.449132  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet 5380dc645e984447aefd4408bca2f2af (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:28.463353  9710 ts_tablet_manager.cc:1929] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 13:15:28.463740  9710 log.cc:1199] T f045ce88a76f4620ad6c717c8245982a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/f045ce88a76f4620ad6c717c8245982a
I20260709 13:15:28.465631  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet f045ce88a76f4620ad6c717c8245982a (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:29.517268  8843 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:29.524737  8912 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:29.525341  8809 consensus_peers.cc:597] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 860647fd65b141d8842fde1bd4f9a549. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.526047  8769 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.527205  9712 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.528256  9682 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.537155  9712 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.539410  8912 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.545490  8769 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.552088  8766 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:29.560699  8665 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.570751  8843 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:29.570961  8734 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2fb7e71822c4226a7ee8579013bfe9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.570919  8912 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.572574  9714 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.574898  9714 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.586809  9225 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.590183  8842 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.621284  8766 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:29.628098  8666 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.630717  8912 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.640017  8910 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.644258  9225 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:29.655478  8843 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:29.656643  8734 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cc3c0a941c84f1cb4645abc7a09b1e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.658106  9714 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.691911  8843 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.698545  9639 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.734874  8841 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:29.753948  8667 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:29.773245  8910 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:29.773501  8809 consensus_peers.cc:597] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da988855757643ccbb2593bad676d78d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:29.774516  9665 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.775411  8910 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.778234  8766 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:29.781769  9665 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:29.785864  9712 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.793833  8910 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.812589  8766 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:29.821640  8667 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:30.023376  9736 ts_tablet_manager.cc:933] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:30.027590  9736 tablet_copy_client.cc:323] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:30.029430  8778 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet f2fb7e71822c4226a7ee8579013bfe9f from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:30.030294  8778 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet f2fb7e71822c4226a7ee8579013bfe9f from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-f2fb7e71822c4226a7ee8579013bfe9f
I20260709 13:15:30.039520  8778 tablet_copy_source_session.cc:215] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.044166  9736 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2fb7e71822c4226a7ee8579013bfe9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.063715  9736 tablet_copy_client.cc:806] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.064322  9736 tablet_copy_client.cc:670] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.065955  9738 ts_tablet_manager.cc:933] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:30.068334  9736 tablet_copy_client.cc:538] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.068553  9738 tablet_copy_client.cc:323] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:30.071808  8778 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:30.072659  8778 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-6cc3c0a941c84f1cb4645abc7a09b1e8
I20260709 13:15:30.081312  9736 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:30.083925  8778 tablet_copy_source_session.cc:215] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.087508  9738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.138412  9738 tablet_copy_client.cc:806] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.139564  9738 tablet_copy_client.cc:670] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.158960  9744 ts_tablet_manager.cc:933] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:30.159477  9738 tablet_copy_client.cc:538] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:15:30.167120  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 46786.8us
I20260709 13:15:30.177533  9738 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:30.180393  9744 tablet_copy_client.cc:323] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:30.186609  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet 860647fd65b141d8842fde1bd4f9a549 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:30.187232  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet 860647fd65b141d8842fde1bd4f9a549 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-860647fd65b141d8842fde1bd4f9a549
I20260709 13:15:30.197022  8854 tablet_copy_source_session.cc:215] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.197249  9736 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.200330  9736 tablet_bootstrap.cc:492] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:30.201136  9736 ts_tablet_manager.cc:1403] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.010s
I20260709 13:15:30.204970  9744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 860647fd65b141d8842fde1bd4f9a549. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.206861  9736 raft_consensus.cc:359] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.207775  9736 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:30.208453  9736 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.223372  9736 ts_tablet_manager.cc:1434] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.022s	user 0.013s	sys 0.002s
I20260709 13:15:30.234844  8778 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-f2fb7e71822c4226a7ee8579013bfe9f received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:30.235405  8778 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-f2fb7e71822c4226a7ee8579013bfe9f on tablet f2fb7e71822c4226a7ee8579013bfe9f with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:30.243067  9738 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.244055  9738 tablet_bootstrap.cc:492] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:30.244931  9738 ts_tablet_manager.cc:1403] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.005s
I20260709 13:15:30.249977  9738 raft_consensus.cc:359] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.251520  9738 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:30.252179  9738 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.258904  9738 ts_tablet_manager.cc:1434] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:15:30.269507  8778 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-6cc3c0a941c84f1cb4645abc7a09b1e8 received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:30.270094  8778 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-6cc3c0a941c84f1cb4645abc7a09b1e8 on tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:30.283771  9744 tablet_copy_client.cc:806] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.284461  9744 tablet_copy_client.cc:670] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.288741  9744 tablet_copy_client.cc:538] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.293612  9738 ts_tablet_manager.cc:933] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:30.306072  9738 tablet_copy_client.cc:323] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:30.307740  9744 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:30.308107  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet da988855757643ccbb2593bad676d78d from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:30.308701  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet da988855757643ccbb2593bad676d78d from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-da988855757643ccbb2593bad676d78d
I20260709 13:15:30.317775  8854 tablet_copy_source_session.cc:215] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:30.321898  9738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da988855757643ccbb2593bad676d78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:30.337424  9744 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.338758  9744 tablet_bootstrap.cc:492] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:30.339869  9744 ts_tablet_manager.cc:1403] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.032s	user 0.022s	sys 0.004s
I20260709 13:15:30.344632  9744 raft_consensus.cc:359] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.347496  9744 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:30.348451  9744 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.352639  9744 ts_tablet_manager.cc:1434] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:15:30.357957  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-860647fd65b141d8842fde1bd4f9a549 received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:30.358593  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-860647fd65b141d8842fde1bd4f9a549 on tablet 860647fd65b141d8842fde1bd4f9a549 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:30.366725  9738 tablet_copy_client.cc:806] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:30.367492  9738 tablet_copy_client.cc:670] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:30.374758  9738 tablet_copy_client.cc:538] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:30.386595  9738 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:30.420140  9738 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:30.421054  9738 tablet_bootstrap.cc:492] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:30.421787  9738 ts_tablet_manager.cc:1403] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.004s
I20260709 13:15:30.424345  9738 raft_consensus.cc:359] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.425060  9738 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:30.425645  9738 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:30.427929  9738 ts_tablet_manager.cc:1434] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:30.430653  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-da988855757643ccbb2593bad676d78d received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:30.431314  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-da988855757643ccbb2593bad676d78d on tablet da988855757643ccbb2593bad676d78d with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:30.513070  9468 raft_consensus.cc:1217] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.563884  9467 raft_consensus.cc:1217] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.716794  9467 raft_consensus.cc:1217] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.889077  9467 raft_consensus.cc:1217] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:30.915041  9714 raft_consensus.cc:1064] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:30.917282  9714 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:30.924391  8842 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:30.924628  9467 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:30.925889  8909 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:30.927500  9731 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.930172  9731 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:30.934726  9731 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:30.944960  9730 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:30.947038  9467 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:30.951040  8912 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:30.983634  8665 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:31.020450  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55264.8us
I20260709 13:15:31.024317  8842 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.051788  9730 raft_consensus.cc:1064] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:31.055768  9730 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:31.075754  8842 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.077327  9731 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.079353  9467 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.081277  9225 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.081638  8912 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.085913  9731 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.138068  9467 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.141925  9682 raft_consensus.cc:1064] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:31.144418  9225 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.148780  8764 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:31.154510  9682 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:31.156643  8913 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.158414  9468 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.160529  9760 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.162663  9760 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.168016  9466 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.169859  9712 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.174829  8913 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.183477  8667 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.194237  9730 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.206918  8842 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.208242  9465 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.212888  8769 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.235059  8915 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.247289  9757 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.248687  8667 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.251878  9682 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:31.265851  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet f2fb7e71822c4226a7ee8579013bfe9f with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40098
I20260709 13:15:31.274937  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2fb7e71822c4226a7ee8579013bfe9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.286190  9773 tablet_replica.cc:333] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:15:31.303248  9773 raft_consensus.cc:2243] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.304047  9773 raft_consensus.cc:2272] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.288623  9757 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.310139  9773 ts_tablet_manager.cc:1916] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.292536  8912 raft_consensus.cc:2955] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.316561  8764 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.325867  8910 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.327317  8769 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:31.328291  9773 ts_tablet_manager.cc:1929] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.328756  9773 log.cc:1199] T f2fb7e71822c4226a7ee8579013bfe9f P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/f2fb7e71822c4226a7ee8579013bfe9f
I20260709 13:15:31.331459  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet f2fb7e71822c4226a7ee8579013bfe9f (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:31.335852  9468 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.337553  9760 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.347292  9467 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.348389  8842 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.353320  9730 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.355635  9714 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.366773  8667 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.369381  9468 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.401125  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.403666  8842 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:31.396523  8665 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.416018  8843 raft_consensus.cc:2955] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.431114  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42810
I20260709 13:15:31.438421  9467 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.441857  9712 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.449996  9682 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:31.465823  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 83883.3us
I20260709 13:15:31.464185  9468 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.474861  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 860647fd65b141d8842fde1bd4f9a549 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:31.478968  8911 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:31.513926  9712 raft_consensus.cc:1064] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:31.530052  9757 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.530946  9712 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:31.534147  9775 tablet_replica.cc:333] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:15:31.538475  9775 raft_consensus.cc:2243] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.539284  9775 raft_consensus.cc:2272] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.530182  8663 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.548018  9775 ts_tablet_manager.cc:1916] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.548254  8913 raft_consensus.cc:2955] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.560401  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet 860647fd65b141d8842fde1bd4f9a549 with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60040
I20260709 13:15:31.560887  8764 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.562889  9750 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.566004  9775 ts_tablet_manager.cc:1929] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.566535  9775 log.cc:1199] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/6cc3c0a941c84f1cb4645abc7a09b1e8
I20260709 13:15:31.568291  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet 6cc3c0a941c84f1cb4645abc7a09b1e8 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:31.569347  9468 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.573895  8912 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:31.574412  9712 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.586807  9777 tablet_replica.cc:333] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:15:31.586895  9757 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:31.589829  9712 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.593847  9468 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.606467  8764 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.617208  8913 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:31.623309  8667 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.622829  9777 raft_consensus.cc:2243] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.630345  9777 raft_consensus.cc:2272] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.637830  9777 ts_tablet_manager.cc:1916] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:31.666041  9777 ts_tablet_manager.cc:1929] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:31.667523  9777 log.cc:1199] T 860647fd65b141d8842fde1bd4f9a549 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/860647fd65b141d8842fde1bd4f9a549
I20260709 13:15:31.669575  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet 860647fd65b141d8842fde1bd4f9a549 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:32.048236  8843 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:32.053056  9468 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.054859  9712 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.056089  8912 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:32.058261  9750 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:32.065871  9682 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:32.068593  9468 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:32.073170  8912 raft_consensus.cc:2955] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:32.090734  8664 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:32.095492  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da988855757643ccbb2593bad676d78d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:32.126999  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet da988855757643ccbb2593bad676d78d with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60040
I20260709 13:15:32.127986  9777 tablet_replica.cc:333] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:15:32.129341  9777 raft_consensus.cc:2243] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:32.130026  9777 raft_consensus.cc:2272] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:32.140097  9777 ts_tablet_manager.cc:1916] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:32.160276  9777 ts_tablet_manager.cc:1929] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:32.160573  9777 log.cc:1199] T da988855757643ccbb2593bad676d78d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/da988855757643ccbb2593bad676d78d
I20260709 13:15:32.162118  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet da988855757643ccbb2593bad676d78d (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:15:33.209395  8764 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.215737  8843 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:33.216132  8734 consensus_peers.cc:597] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bac07da6a99849fb8f972372c187ee7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.216374  8913 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:33.217859  9781 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.218904  9770 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.226943  9730 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.228489  8843 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.237087  8912 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.247752  8910 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.255707  8664 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.280314  8842 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:33.280961  8883 consensus_peers.cc:597] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3a106d574bc4cfeaa6e7b1240430c4b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.282430  9742 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:33.284696  8769 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:33.286346  9782 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.295141  9742 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.304420  8843 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.315879  8766 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.334379  8667 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.348834  8843 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:33.350355  8910 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:33.353415  8734 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c79353780ac54a25bd9999800873bbeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.353747  9788 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:33.356256  9788 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:33.366365  8769 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.383963  9730 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.385108  8843 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.390602  8910 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.397903  8842 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.404081  8665 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.416675  8769 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:15:33.417642  8809 consensus_peers.cc:597] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51c7e309721f4da1bcd1626da407d364. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:33.418475  9801 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:33.422555  8910 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:33.429927  9801 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:33.475279  9801 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.482131  8769 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.485488  8910 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:15:33.495069  8664 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index -1 to 2, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:33.631476  9804 ts_tablet_manager.cc:933] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:33.640704  9804 tablet_copy_client.cc:323] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:33.643225  8778 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet bac07da6a99849fb8f972372c187ee7b from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:33.643858  8778 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet bac07da6a99849fb8f972372c187ee7b from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-bac07da6a99849fb8f972372c187ee7b
I20260709 13:15:33.650969  8778 tablet_copy_source_session.cc:215] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:33.660322  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bac07da6a99849fb8f972372c187ee7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.674110  9804 tablet_copy_client.cc:806] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:33.674772  9804 tablet_copy_client.cc:670] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:33.678524  9804 tablet_copy_client.cc:538] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:33.686517  9804 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:33.706525  9804 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:33.707281  9804 tablet_bootstrap.cc:492] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:33.707844  9804 ts_tablet_manager.cc:1403] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:15:33.710079  9804 raft_consensus.cc:359] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.710680  9804 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:33.711220  9804 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.714751  9804 ts_tablet_manager.cc:1434] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:33.722409  8778 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-bac07da6a99849fb8f972372c187ee7b received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:33.722856  8778 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-bac07da6a99849fb8f972372c187ee7b on tablet bac07da6a99849fb8f972372c187ee7b with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:33.796424  9804 ts_tablet_manager.cc:933] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:33.798233  9804 tablet_copy_client.cc:323] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.67:39883
I20260709 13:15:33.799918  8928 tablet_copy_service.cc:140] P bdb96be202c2447586477b2077b7d5bf: Received BeginTabletCopySession request for tablet e3a106d574bc4cfeaa6e7b1240430c4b from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:35822)
I20260709 13:15:33.800405  8928 tablet_copy_service.cc:161] P bdb96be202c2447586477b2077b7d5bf: Beginning new tablet copy session on tablet e3a106d574bc4cfeaa6e7b1240430c4b from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:35822: session id = 3b34c95a175945b88b17f07fbc650abf-e3a106d574bc4cfeaa6e7b1240430c4b
I20260709 13:15:33.806515  8928 tablet_copy_source_session.cc:215] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:33.810700  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106d574bc4cfeaa6e7b1240430c4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.825371  9804 tablet_copy_client.cc:806] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:33.825980  9804 tablet_copy_client.cc:670] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:33.827553  9809 ts_tablet_manager.cc:933] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017)
I20260709 13:15:33.830590  9804 tablet_copy_client.cc:538] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:33.841442  9804 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:33.841513  9809 tablet_copy_client.cc:323] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.65:33017
I20260709 13:15:33.843305  8778 tablet_copy_service.cc:140] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Received BeginTabletCopySession request for tablet c79353780ac54a25bd9999800873bbeb from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:58862)
I20260709 13:15:33.843791  8778 tablet_copy_service.cc:161] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Beginning new tablet copy session on tablet c79353780ac54a25bd9999800873bbeb from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:58862: session id = 3b34c95a175945b88b17f07fbc650abf-c79353780ac54a25bd9999800873bbeb
I20260709 13:15:33.851891  8778 tablet_copy_source_session.cc:215] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:33.855969  9809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79353780ac54a25bd9999800873bbeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.867046  9804 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:33.868139  9804 tablet_bootstrap.cc:492] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:33.868854  9804 ts_tablet_manager.cc:1403] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.009s
I20260709 13:15:33.871858  9804 raft_consensus.cc:359] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.872725  9804 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:33.873389  9804 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.879877  9804 ts_tablet_manager.cc:1434] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:15:33.881680  8928 tablet_copy_service.cc:342] P bdb96be202c2447586477b2077b7d5bf: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-e3a106d574bc4cfeaa6e7b1240430c4b received from {username='slave'} at 127.0.0.1:35822
I20260709 13:15:33.882198  8928 tablet_copy_service.cc:434] P bdb96be202c2447586477b2077b7d5bf: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-e3a106d574bc4cfeaa6e7b1240430c4b on tablet e3a106d574bc4cfeaa6e7b1240430c4b with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:33.882344  9809 tablet_copy_client.cc:806] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:33.885098  9804 ts_tablet_manager.cc:933] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:33.883087  9809 tablet_copy_client.cc:670] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:33.891779  9809 tablet_copy_client.cc:538] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:33.893407  9804 tablet_copy_client.cc:323] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:15:33.895608  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet 51c7e309721f4da1bcd1626da407d364 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:15:33.896183  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet 51c7e309721f4da1bcd1626da407d364 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-51c7e309721f4da1bcd1626da407d364
I20260709 13:15:33.902667  9809 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:33.904103  8854 tablet_copy_source_session.cc:215] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:33.907491  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c7e309721f4da1bcd1626da407d364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.924005  9809 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:33.925132  9809 tablet_bootstrap.cc:492] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:33.925827  9804 tablet_copy_client.cc:806] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:33.926465  9804 tablet_copy_client.cc:670] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:33.926476  9809 ts_tablet_manager.cc:1403] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 13:15:33.931445  9804 tablet_copy_client.cc:538] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:33.937680  9809 raft_consensus.cc:359] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.940299  9809 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:33.941318  9809 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.945642  9804 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:15:33.946895  9809 ts_tablet_manager.cc:1434] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:15:33.948779  8778 tablet_copy_service.cc:342] P 74de73c0f36d4c3aa7a483c7fdb39e4a: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-c79353780ac54a25bd9999800873bbeb received from {username='slave'} at 127.0.0.1:58862
I20260709 13:15:33.949249  8778 tablet_copy_service.cc:434] P 74de73c0f36d4c3aa7a483c7fdb39e4a: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-c79353780ac54a25bd9999800873bbeb on tablet c79353780ac54a25bd9999800873bbeb with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:33.964509  9804 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:33.965482  9804 tablet_bootstrap.cc:492] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:15:33.967285  9804 ts_tablet_manager.cc:1403] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:15:33.970358  9804 raft_consensus.cc:359] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.970953  9804 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:15:33.971549  9804 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:33.974179  9804 ts_tablet_manager.cc:1434] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:33.975965  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-51c7e309721f4da1bcd1626da407d364 received from {username='slave'} at 127.0.0.1:36492
I20260709 13:15:33.976406  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-51c7e309721f4da1bcd1626da407d364 on tablet 51c7e309721f4da1bcd1626da407d364 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:34.090219  9468 raft_consensus.cc:1217] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.378060  9826 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.380659  9826 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.384524  9827 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.384709  9826 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:35.385404  9827 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.387722  9827 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.398073  9783 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.399022  9825 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.399232  9783 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:35.396731  8698 debug-util.cc:398] Leaking SignalData structure 0x7b080003a4a0 after lost signal to thread 7660
I20260709 13:15:35.403414  9826 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.404596  9826 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.405272  9783 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.399765  9825 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.396334  9828 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.413434  9827 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.414937  9826 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:35.415905  9827 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.419008  9825 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.421489  9827 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:35.424933  9781 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.425513  9807 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.425787  9781 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.432601  9781 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:35.426282  9807 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.418876  9828 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:35.453174  9828 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.442873  9825 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.462428  9828 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.466394  9823 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.455178  9827 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.472345  9827 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.484931  9826 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.485477  9833 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.485723  9826 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.467057  9823 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.495123  9831 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.466408  9828 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.486166  9833 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.496196  9831 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.512478  9832 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.513279  9832 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.516124  9824 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.519212  9807 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.520051  9807 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.505182  9825 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.520823  9807 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.522519  9825 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.524268  9828 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.550705  9823 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.527513  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.524199  9807 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.604039  9825 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.606761  9807 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.601279  9834 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.601991  9826 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.602996  9833 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.610442  9834 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.612648  9823 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.613340  9823 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.620280  9836 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.607121  9825 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.607842  8765 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:35.620690  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.538065  9824 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:35.633788  8883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.000s	sys 0.016s
W20260709 13:15:35.635337  8883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.000s	sys 0.017s
I20260709 13:15:35.635527  9824 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.629416  9834 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.640200  9834 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.641079  9834 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.643864  9834 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.644631  9834 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.645324  9834 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.630108  9822 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.631835  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.614619  9807 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.624377  9835 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.647339  9825 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.648092  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 696) took 1300 ms. Trace:
I20260709 13:15:35.629925  9823 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.612041  9826 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.621578  9783 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.619791  9833 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.619987  9832 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:35.651003  8698 debug-util.cc:398] Leaking SignalData structure 0x7b0800090240 after lost signal to thread 8701
I20260709 13:15:35.643241  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.653190  9822 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.676880  8766 rpcz_store.cc:276] 0709 13:15:34.348018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.646626 (+1298608us) service_pool.cc:224] Handling call
0709 13:15:35.647146 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.647470 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.647507 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.647583 (+    76us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:35.647645 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.647719 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.647880 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:35.621186  9836 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.776881  9824 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.777980  9832 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.783973  9841 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.784488  9832 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.785501  9742 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.786221  9742 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.786931  9825 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.787580  9832 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.787513  9825 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:35.783967  9817 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.789105  9833 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.788403  9742 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:35.783737  9824 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.774499  9781 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.807948  9833 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.808828  9807 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.809430  9807 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.809587  9837 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.809969  9807 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.775004  9826 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.822917  9838 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.793853  9823 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.810452  9837 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.827137  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.828305  9822 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.790154  9783 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:35.835201  8766 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:35.825170  9836 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.822902  9839 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.831080  9833 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.849066  9783 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.830873  9842 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.781940  9835 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.845415  9823 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.849228  9833 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.784590  9841 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.849996  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:35.856441  9742 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.856746  8911 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:35.851974  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 774) took 1542 ms. Trace:
I20260709 13:15:35.858024  9837 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.854266  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.844094  9794 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.857275  9742 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.857666  9847 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.858202  8769 rpcz_store.cc:276] 0709 13:15:34.307689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:35.845319 (+1537630us) service_pool.cc:224] Handling call
0709 13:15:35.849932 (+  4613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:35.850149 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:35.850180 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:35.850216 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:35.850242 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:35.850305 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:35.850408 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:35.839846  9781 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.852460  9825 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.870471  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:35.874894  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.877166  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.853693  9842 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.883010  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.858457  9844 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.826583  9817 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.878767  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:35.893111  9846 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.890076  8909 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:35.904181  9823 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.905090  9823 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.873239  9837 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.839602  9838 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.878722  9794 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.914067  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.870734  9847 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.908761  9848 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.921200  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.905932  9823 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.909793  9807 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.909565  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:35.930009  9826 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.918026  9822 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.929879  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:35.933538  9467 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:35.917258  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:35.938094  8915 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:35.939491  9845 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:35.884609  9839 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.894165  9846 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.929065  9834 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.946902  9807 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.968685  9464 raft_consensus.cc:1217] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:35.924497  9850 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:35.972235  9833 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:35.940542  9837 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.986675  9807 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:35.912912  9844 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.009696  9783 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:35.984256  9840 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.021261  9844 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:35.971285  9822 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:35.949110  9848 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.066331  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:35.973440  9845 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:36.062651  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 207975us
I20260709 13:15:36.073518  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.074543  8914 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:36.075733  9835 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.076440  9835 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:36.084102  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73204.9us
I20260709 13:15:36.021749  9807 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.018810  9849 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.029410  9794 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.064453  9781 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.062215  9817 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.064105  9824 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.021929  9783 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.044809  9838 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:36.085040  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.088909  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.076992  9844 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.083662  9842 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.094300  9823 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.141637  9844 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.142167  9848 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.142309  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.119877  9742 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.096938  9847 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.148061  9822 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.148561  9846 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.144901  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.070299  9840 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.116763  9817 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.150061  9852 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.151914  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.120314  9464 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:36.139779  9837 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.145195  9853 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.094767  9835 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.017174  9850 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.169287  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.172449  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.171414  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.179430  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.169318  9783 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.185820  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.186779  8840 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.187529  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.188788  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:36.189144  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.182874  8843 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:36.189977  8841 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:36.190589  9827 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.184885  9845 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:36.191219  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.179472  8835 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:36.207906  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.208683  8835 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.209602  9845 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.205363  9783 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.210356  9845 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.211073  9783 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.214287  9822 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.214723  9840 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.215039  9822 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:36.215626  9839 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.202517  9853 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:36.171325  9852 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.097337  9849 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.219782  9853 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.212883  9845 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.191938  8838 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:36.218192  9822 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.213277  9464 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:36.170349  9817 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.238269  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.238472  9852 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.238843  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.240564  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.194365  9854 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.241266  8841 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.240362  8843 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.238862  9846 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.247327  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.248281  9823 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.254281  9823 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.239977  9824 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.255513  9824 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.256215  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.253441  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.247983  8837 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.257324  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:36.239810  8835 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.257513  8843 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:36.245658  9783 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.262890  9801 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.279335  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.279614  9835 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.246071  9854 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.280368  9461 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.280530  9854 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.286842  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.278067  9801 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.289340  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.289686  9801 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.289393  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.291755  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.289628  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.293362  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.293707  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.294356  8764 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:36.288612  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:36.312232  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 215207us
I20260709 13:15:36.317534  9465 raft_consensus.cc:1217] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:36.309623  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:36.309965  9824 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.309039  9823 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.321257  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.325757  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:36.327208  9844 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.338946  9730 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.339471  9781 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.339763  9730 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.340407  9781 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.342473  9730 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.342823  9781 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.345410  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.345754  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.346346  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.346390  8761 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.347069  8764 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.347141  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.347607  9840 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.347807  8762 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.348085  9840 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.348536  9840 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.349229  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.349970  8766 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.351298  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.358788  8769 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.357363  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.361249  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.362063  8766 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.376497  9855 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:36.377328  9855 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.377437  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.377986  9855 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.378186  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.382193  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.385712  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.386382  9841 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.367715  9833 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.391510  9846 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.391450  9833 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.392011  9788 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.393891  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.395009  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.392102  9846 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.358541  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.400262  9817 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.380334  9837 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.351518  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:36.413589  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.396644  9431 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:36.419378  9431 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:36.406951  8835 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.421082  9848 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.421532  9848 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.421908  9807 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:36.416802  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 81455.1us
I20260709 13:15:36.414825  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.422683  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.423089  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:36.414395  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.414901  9837 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.423942  9837 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.424121  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:36.417145  9841 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.424945  9847 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.425271  9841 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.425726  9841 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.425580  9847 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.427565  9826 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.427937  9847 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.430204  9844 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.430675  9833 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:36.417577  8734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.115s	user 0.012s	sys 0.006s
I20260709 13:15:36.421916  9848 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:36.433928  8734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.131s	user 0.012s	sys 0.007s
I20260709 13:15:36.398290  9781 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.432101  9834 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.431015  9849 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.432538  9807 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.423715  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.430999  9847 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.436542  9834 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.428197  9826 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.438476  9834 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.392742  9788 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.406461  9831 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.432322  9850 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.443684  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.442257  9431 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.444780  9852 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.447847  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 776) took 1060 ms. Trace:
I20260709 13:15:36.448247  9852 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.448688  9852 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.448570  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.451545  9850 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.439358  9807 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:36.451947  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.448266  8768 rpcz_store.cc:276] 0709 13:15:35.387099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:36.446903 (+1059804us) service_pool.cc:224] Handling call
0709 13:15:36.447248 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:36.447436 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:36.447465 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:36.447521 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:36.447554 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:36.447608 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:36.447696 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:36.452602  8843 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.457001  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.455302  9807 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.430727  9844 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.462209  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.462715  9826 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.421857  9801 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.438489  9847 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.451946  9850 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.419672  9840 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.438903  9781 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.455991  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.459925  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.499089  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.468940  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.497356  9842 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.500382  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.507198  9842 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.500636  9850 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.508112  8767 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:36.440579  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:36.506373  9851 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:36.513497  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 57574.5us
I20260709 13:15:36.524981  9826 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.526082  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.526269  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.525516  9826 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.555276  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.556995  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.555368  9831 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.558889  9831 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:36.560823  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.561605  9464 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
W20260709 13:15:36.571444  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 214541us
I20260709 13:15:36.579556  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.579840  9462 raft_consensus.cc:1217] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:36.580071  9468 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:36.570531  9826 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.593991  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.594221  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:36.573995  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08002bae00 after lost signal to thread 8793
I20260709 13:15:36.461835  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.612464  9840 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.613461  9859 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.575676  9849 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.616554  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.614116  9783 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:15:36.618573  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.629426  9464 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:36.630465  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.630579  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.630707  9852 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.631718  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.632187  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.628782  9801 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:36.614109  9849 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.632817  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.628834  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.635367  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.635016  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:36.595501  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155027us
I20260709 13:15:36.631325  8915 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:36.644593  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.644730  9849 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.644984  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.645313  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.614130  9859 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.647188  9837 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.656208  9857 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.632850  9852 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:36.656708  9857 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.642724  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.657140  9857 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.654197  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:36.657164  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:36.658743  8698 debug-util.cc:398] Leaking SignalData structure 0x7b0800227620 after lost signal to thread 8868
I20260709 13:15:36.585119  9851 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:36.667227  9460 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:36.668026  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.668483  9788 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.669003  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.671373  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.662570  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.673795  9837 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.674511  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.677294  8910 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:36.680189  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:36.688337  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.691325  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:36.694460  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.670028  9842 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.671281  9781 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:36.730574  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.823403  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:36.824195  9468 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:36.824833  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.825381  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.826191  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.823410  9862 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.828142  9862 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.828543  9862 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.830021  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.680279  8838 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:36.843897  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.844676  8837 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:36.849949  9781 raft_consensus.cc:1064] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:36.854727  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:36.859709  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.871105  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.731232  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.829206  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.882673  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.836169  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.860877  8916 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
W20260709 13:15:36.896389  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 256659us
I20260709 13:15:36.885190  9822 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:36.891571  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.896291  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:36.773175  9847 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:36.722231  9831 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.897382  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:36.897943  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 68017.8us
I20260709 13:15:36.899065  9822 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:36.901011  9794 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:36.902592  9851 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:36.902881  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9040 after lost signal to thread 8942
I20260709 13:15:36.924939  9794 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.926553  9794 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:36.903098  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.904017  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.910416  9781 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.911696  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:36.912393  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 216976us
I20260709 13:15:36.914968  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.916141  9848 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.912448  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.917547  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.918654  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:36.883023  9844 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.923980  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:36.929461  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08003178e0 after lost signal to thread 9492
I20260709 13:15:36.952335  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.957170  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:36.969808  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.965406  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:36.969924  8843 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:36.960316  9861 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:36.976629  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 58199.5us
I20260709 13:15:36.974717  9466 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:36.977748  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:36.981779  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:36.975507  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:36.967489  9841 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.541s	user 0.025s	sys 0.037s
I20260709 13:15:36.979065  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:36.979387  9852 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:36.983605  9852 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.984040  9852 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.983723  9841 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.984474  9852 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.970758  9859 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.988566  9841 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:36.987377  9822 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:36.974879  9831 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:36.989969  9831 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:36.990360  9831 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.993800  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:36.994606  8841 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:36.976356  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.004796  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.006341  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:37.007054  8915 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:37.008488  8841 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:37.009996  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:37.011134  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.011751  8836 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.012687  9863 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:37.013281  9863 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:37.013414  9842 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:37.014624  9842 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:37.015017  9842 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:37.015636  9822 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.014307  9863 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:37.016033  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.018760  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:37.020115  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.020402  9825 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.021566  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:36.993818  9844 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.020825  9825 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.022650  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:37.015926  9842 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.024410  9860 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.024611  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.025274  9825 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:37.030714  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55332.7us
I20260709 13:15:36.997251  9847 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.031502  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:37.030659  9854 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.014s
W20260709 13:15:37.030435  9855 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.015s
I20260709 13:15:37.037626  9868 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.038267  9868 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.038342  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:37.034648  9807 consensus_meta.cc:287] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.575s	user 0.014s	sys 0.005s
I20260709 13:15:37.042428  9857 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:37.033411  9834 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.002s
I20260709 13:15:37.022840  9844 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:36.995260  9861 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.031987  9860 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.047116  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:37.032904  9847 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:37.047806  9846 consensus_meta.cc:287] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.002s
I20260709 13:15:37.039703  9849 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.051885  9834 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.062923  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.034540  9854 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.063979  9834 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.065404  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.065758  9854 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.066954  9467 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.067484  8918 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.053220  9860 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.050109  9844 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.046116  9868 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.063992  9846 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.054802  9847 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.073401  9462 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.080492  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.079255  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.073657  9854 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.058440  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:37.054605  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.057051  9842 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.050827  9807 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.091521  9807 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.040199  9855 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.089460  9461 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.092621  9859 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.093070  9859 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.093269  9465 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.065760  9861 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.093502  9859 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.101274  9855 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.068046  9864 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.097293  9854 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.125545  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.128062  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.130571  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.103585  9848 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.138947  9869 raft_consensus.cc:1064] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:37.140898  9846 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:37.113023  8840 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.143428  8836 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:37.131507  9854 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.144497  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:37.149487  9467 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:15:37.150570  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 112302us
I20260709 13:15:37.151523  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:37.108994  9864 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.152748  9730 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:37.153368  9730 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.153762  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.155586  9730 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.156157  9730 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:37.159576  9870 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.160204  9870 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.155280  9865 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:37.162930  9783 raft_consensus.cc:1064] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:37.163802  9864 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.156502  9866 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.163733  9730 consensus_queue.cc:1243] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:37.211238  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.214030  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:37.242730  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.245007  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.247506  9783 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.249142  9788 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:37.249583  9788 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:37.250401  9788 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.251480  9788 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.213399  9861 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:37.175474  9852 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.221786  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.341372  9730 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:37.350603  8835 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:37.351356  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 304319us
I20260709 13:15:37.237390  9857 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:37.217577  9858 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:15:37.356720  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.354167  9730 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:37.363081  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.233193  9866 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.360590  9865 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:37.358826  9875 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.365700  9865 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:37.365864  9875 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.366343  9875 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:37.358807  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 207391us
I20260709 13:15:37.367683  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:37.343346  9849 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.350653  9852 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.372785  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.366791  9865 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.379142  9828 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:37.379606  9865 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.380481  9828 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:37.375253  9844 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.367017  9866 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.380908  9828 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:37.361065  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:37.354560  9871 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.385501  9828 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:37.396605  9850 consensus_meta.cc:287] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.888s	user 0.019s	sys 0.045s
I20260709 13:15:37.397100  9828 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.397063  9850 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.390316  9844 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.390751  9866 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.399675  9866 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.399600  9871 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.402333  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.388245  9781 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:15:37.392345  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.404390  9781 raft_consensus.cc:3055] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:37.392347  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.404814  9781 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:37.381095  8838 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:37.353451  9861 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.392616  9869 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.396027  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:37.396327  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.399034  9730 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.390969  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.410077  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.402041  9866 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:37.391999  9826 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.798s	user 0.018s	sys 0.021s
I20260709 13:15:37.405853  9781 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.404076  9871 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.426031  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.426862  8763 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:37.444540  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.445653  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.446313  9832 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:37.446885  9832 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.449069  9832 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.450042  9850 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.451606  8835 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:37.418118  9463 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.441821  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:37.460484  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.472592  9467 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:37.473629  9865 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.474320  9463 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:37.474196  9865 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.414929  9833 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:37.476387  9865 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.478351  9858 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:15:37.503382  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.419361  9826 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.504984  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:37.505789  9849 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:37.507653  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:37.509241  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:37.503408  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:37.516419  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:37.523170  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.523366  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.478902  9833 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:37.529999  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:37.502816  9861 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.524587  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:37.554057  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:37.558357  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:37.592142  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.551738  9866 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.511760  9850 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:37.528605  9794 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.009s
I20260709 13:15:37.522112  9781 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:37.611496  9825 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.576s	user 0.004s	sys 0.012s
I20260709 13:15:37.621631  9825 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.545612  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:37.531160  9870 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:37.546829  9822 consensus_meta.cc:287] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.530s	user 0.017s	sys 0.002s
W20260709 13:15:37.551388  9831 consensus_meta.cc:287] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.011s
W20260709 13:15:37.550978  9862 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.012s
I20260709 13:15:37.624333  9825 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.545961  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:37.547621  9860 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.637032  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:37.638163  9465 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:37.638235  9460 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:37.640628  9866 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.641104  8664 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 2 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.633275  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:37.654949  9842 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:15:37.625072  9826 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:37.653060  8769 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:37.610642  9854 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:37.661948  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.664549  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:37.667676  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.642539  9877 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.666476  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:37.670954  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:37.658203  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:37.550858  9875 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:37.675868  8808 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.594s (SENT) [suppressed 3 similar messages]
I20260709 13:15:37.553012  9864 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.653672  9831 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.653911  9862 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.680320  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:37.679795  8915 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.694370  9866 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:37.685226  9833 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.688280  9828 raft_consensus.cc:1064] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:37.628906  9794 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:37.689919  9847 consensus_meta.cc:287] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.006s
W20260709 13:15:37.690332  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 201667us
I20260709 13:15:37.660472  9861 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:15:37.680027  8917 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:37.726238  9854 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.727361  9847 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.730314  9847 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.738045  9860 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.702836  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:37.704346  9833 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.709347  8915 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:37.691833  9832 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.713219  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:37.678004  9877 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:37.760733  9864 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.757266  9850 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:37.757748  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44614.7us
I20260709 13:15:37.766603  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:37.747823  8842 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:37.759121  9832 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:37.780200  9864 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:37.782567  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 400938us
I20260709 13:15:37.784272  9864 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:37.776842  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 74126.7us
I20260709 13:15:37.779726  9866 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.781791  9832 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:37.795039  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 315261us
I20260709 13:15:37.790247  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:37.795574  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.805712  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:37.794122  9788 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.541s	user 0.002s	sys 0.012s
I20260709 13:15:37.833817  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:37.793591  9864 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:37.838150  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 334779us
W20260709 13:15:37.842773  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 163566us
I20260709 13:15:37.844187  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:37.831094  9860 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.856364  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:37.795258  9866 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.849551  9858 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.851532  9788 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:37.803625  9875 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:37.835582  9868 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.753s	user 0.015s	sys 0.032s
I20260709 13:15:37.833099  9825 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:37.860765  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 348625us
I20260709 13:15:37.854516  9730 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:37.867264  9730 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:37.860440  9869 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:37.868999  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 199930us
W20260709 13:15:37.838629  9859 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.720s	user 0.018s	sys 0.028s
I20260709 13:15:37.870151  8918 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:37.856419  9860 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.865738  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:37.860824  9862 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:37.865988  9864 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:37.917397  8842 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:37.863137  9858 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.888541  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:37.877305  9825 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.866570  9831 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:37.914211  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.916267  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:37.921142  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:37.887189  9868 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.919536  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:37.917758  9730 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:37.924569  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59451.7us
I20260709 13:15:37.913404  9860 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.931380  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:37.897769  9847 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.916911  9879 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.865492  9431 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:37.944100  9730 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.895916  9846 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:15:37.977123  9885 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.978468  9846 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.978892  9846 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.979311  9846 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.979753  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.979858  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:37.980983  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.981248  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.981642  9850 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:37.982059  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.982149  9850 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:37.982445  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.915967  9866 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.962672  9847 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:37.983583  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.922712  9858 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.921991  9825 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.983126  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.985757  9847 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:37.949275  9844 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.986442  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.986804  9844 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.987493  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.923293  9869 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:37.955152  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:37.989028  9877 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:37.981153  9865 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:37.925485  9839 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:37.989673  9839 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.989930  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.990108  9839 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:37.934659  9871 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:37.990826  9871 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.977790  9885 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:37.955336  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:37.973819  9882 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:15:37.993335  9885 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:37.974651  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.975319  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.998909  9868 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:37.975975  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 114085us
I20260709 13:15:37.985288  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.942468  9783 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:38.000538  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.009317  8837 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:37.915508  9859 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.974561  9463 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:37.988679  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:37.989058  9869 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:37.964658  9879 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:38.017686  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:38.018385  8909 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:38.020246  8913 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:38.017521  8915 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:38.019703  9879 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.023058  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:38.023792  8917 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:37.984694  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.007877  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:38.033181  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:38.041453  8911 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:38.036394  9858 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:37.953047  9870 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:15:38.034993  9859 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.018035  9869 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:37.983166  9850 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:38.058612  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.059371  8762 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.060427  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.061057  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.037681  9877 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:38.061743  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.013545  9783 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.038321  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:38.063515  9783 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:38.064247  9466 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:38.040084  9794 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:38.043177  9870 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:38.042819  9825 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.046303  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.049403  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.050782  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.054231  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.051067  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.017132  9871 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.066892  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.067967  8768 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:38.068699  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.075135  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.074594  9832 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.061784  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.059377  9788 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:38.081457  9886 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.082078  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.083331  8769 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.069764  9870 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:38.080370  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:38.084491  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 142299us
I20260709 13:15:38.076483  9858 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.100806  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:38.077739  9794 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:38.064910  9860 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:38.101115  8767 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:38.102702  9871 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.119413  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:38.131335  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.132249  8769 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:38.128525  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.133986  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.134140  8765 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:38.135533  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.117551  9859 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.136896  8769 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.096267  9788 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.136335  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.138027  9730 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:38.143850  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.146202  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:38.146799  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.148017  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.151129  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.158049  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.159680  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.139923  9859 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.100806  9886 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.162189  9730 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:38.161466  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 393219us
I20260709 13:15:38.170430  9844 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.171037  9844 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.172432  8762 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:38.143798  9849 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.151877  9877 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.157078  9847 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.150427  9781 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:38.155478  9831 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.179395  9730 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.174026  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.177923  9859 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:38.202863  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.203454  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.203836  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:38.204210  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 272602us
I20260709 13:15:38.178507  8769 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:38.173909  9788 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.206092  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.190114  9873 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.207780  8769 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:38.180464  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.207146  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.207175  9730 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.199128  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.175050  9892 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:38.143141  9870 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:38.224303  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.222898  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.204027  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.230881  9873 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.231534  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.231896  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:38.305538  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73739.2us
I20260709 13:15:38.303550  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:38.306321  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.307411  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.308390  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.235093  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.191577  9893 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.235715  9828 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:38.287734  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.212497  9825 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.236001  9833 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:38.309504  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 74555.7us
I20260709 13:15:38.311492  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.241287  9832 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.207414  9781 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.316640  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.318697  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.320235  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.312348  9847 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.310734  9788 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.312129  9864 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.309482  9877 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.303714  9892 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:38.310424  9856 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.303344  9846 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:38.332676  9896 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:38.322744  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.310922  9831 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.329983  9730 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.337085  8836 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:38.343009  9886 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.322790  9873 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.333814  8765 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:15:38.351840  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.321879  9860 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.331727  9825 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.334800  9856 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.359819  9844 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.383571  9873 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:38.433952  9892 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:38.317931  9893 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.406149  9856 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.345109  9879 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.429986  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.360023  9839 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.442531  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:38.429309  9844 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:38.443413  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.435179  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.449657  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.456990  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:38.457933  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.453601  8762 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.459674  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.460412  8768 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:38.461313  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.461864  8768 raft_consensus.cc:2376] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2. Re-sending same reply.
I20260709 13:15:38.453476  9783 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.454298  9879 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.454727  8760 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:38.455731  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.468839  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.434178  9873 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.450078  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.446020  9844 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.448271  9461 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:38.477249  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.481189  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.481678  8768 raft_consensus.cc:2376] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2. Re-sending same reply.
I20260709 13:15:38.457670  8765 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:38.483639  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.486466  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.487076  8768 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:38.490450  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:38.492786  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 185840us
I20260709 13:15:38.492928  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.494979  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.498474  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.499796  8764 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:38.498471  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:38.501961  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.492136  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.500269  9781 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.508380  9846 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.513167  9893 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.513814  9893 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.514015  9846 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.514765  9846 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:38.514190  9893 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.516752  9893 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.511606  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.498344  9869 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.516779  9839 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.539274  9886 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:38.536433  8762 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:38.545828  9783 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:38.546674  9846 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:38.550771  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 228112us
I20260709 13:15:38.552739  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:38.562680  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 672927us
I20260709 13:15:38.564265  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.548889  9886 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:38.566042  9903 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.569080  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:38.574891  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.575699  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.578498  8844 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:38.579181  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:38.574043  9825 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.579593  9865 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.564498  9869 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.588385  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.593197  8761 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:38.593452  9902 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.594362  9886 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.595464  9825 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:38.596637  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.597052  9903 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:38.622422  8768 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:38.623979  9902 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.626387  8769 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:38.626899  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.630432  8882 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.630775  9902 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.633445  8768 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.627676  9849 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:38.621018  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.636765  9849 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:38.637497  9859 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.639799  9859 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:38.632673  9907 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.637965  8767 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:38.642439  9825 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.628827  9869 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:38.648679  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 150054us
I20260709 13:15:38.633837  9826 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.635133  9886 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.653565  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.661689  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:38.665696  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.666441  8844 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:38.664381  9905 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:38.667716  9905 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:38.668119  9905 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.670400  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.662137  9839 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.680882  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.683375  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.654891  9783 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:15:38.685352  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.685467  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.654798  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.689927  8839 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.677073  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.672246  9903 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:38.718529  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 250912us
W20260709 13:15:38.716063  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 152260us
W20260709 13:15:38.719935  9904 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.155s	user 0.001s	sys 0.001s
I20260709 13:15:38.708177  9911 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.735146  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:38.736369  9461 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:38.740080  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:38.744773  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 234125us
W20260709 13:15:38.750859  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.740355  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:38.740135  9911 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:15:38.761009  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.762323  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.753716  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:38.769738  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.771778  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.757452  8839 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:38.804113  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:38.811033  9463 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.813154  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:38.814659  9862 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:15:38.823295  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 190172us
I20260709 13:15:38.823734  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:38.824347  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48523.1us
I20260709 13:15:38.824491  8841 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:38.824306  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:38.825917  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:38.827028  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:38.827205  8843 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:38.828703  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:38.829584  9794 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.832672  9886 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:38.833124  9886 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.833479  9886 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:38.835383  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:38.836452  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:38.843943  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.845263  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:38.845554  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.830404  9831 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:38.830232  9794 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:38.850764  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.856374  8918 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:38.851634  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:38.841341  8839 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:38.840719  9873 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:38.856038  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:38.901816  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:38.914861  9907 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:38.917682  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:38.920333  8913 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:38.837586  9893 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:38.848981  9871 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.002307  8841 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.917275  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.004238  8917 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.004473  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.005432  9857 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:39.006247  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.005386  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.007063  8912 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:38.850592  9826 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.121s
I20260709 13:15:39.006283  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:38.964176  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:38.851976  9844 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.024801  8909 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.021837  8911 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:39.026166  9839 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.026794  8917 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.027632  8763 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.026906  9898 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.180s
I20260709 13:15:39.049942  8735 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:39.051131  9919 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.054827  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:39.054932  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 218515us
I20260709 13:15:39.056208  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:39.006131  9857 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.061424  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.044981  9826 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.044981  9912 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.063351  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.065197  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.061954  9783 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.065697  9894 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:39.066426  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.070612  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:39.072841  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:39.073132  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.074265  9844 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:39.108919  8913 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:38.992331  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.108075  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.109659  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.109949  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.110275  8916 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:39.055971  9862 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:15:39.059587  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:39.118606  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48084us
W20260709 13:15:39.119041  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46254.7us
W20260709 13:15:39.075212  9856 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.004s
I20260709 13:15:39.124147  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.125633  9822 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.136072  9914 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.136297  9822 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:39.068074  9885 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.153153  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.132256  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:39.147969  9915 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.148445  9822 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.151026  8914 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.072536  9826 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:39.152218  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.156956  8910 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.158010  8764 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:39.162344  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.052731  9794 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.167590  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.168468  8910 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:39.153046  9885 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:39.170564  8916 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:39.171770  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.171953  9862 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.172115  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.172577  8917 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:39.140834  9783 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:39.173012  8916 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:39.174141  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.175284  8910 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:39.147204  8915 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:39.155478  9828 raft_consensus.cc:2764] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:15:39.181588  9908 log.cc:927] Time spent T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.376s	user 0.000s	sys 0.002s
I20260709 13:15:39.181947  8916 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.169812  8762 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:39.176357  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.181769  9922 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:39.170745  9885 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.187186  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.162357  9881 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.145875  9894 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.189884  9883 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.170799  9924 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.205538  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:39.190579  8917 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.192003  8911 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:39.192080  9916 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:15:39.195437  9870 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.196516  8916 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.176738  9831 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.154029  9856 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.198550  8914 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:39.206410  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.210530  9857 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:39.209851  9924 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.223063  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.208163  9914 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.223261  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.228102  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.212399  9893 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.233042  9839 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.234923  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.232203  8916 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.212805  9883 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:39.212952  9911 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.238622  8844 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.239956  9910 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.228798  9783 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.208791  9922 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.233865  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:39.231539  9905 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.563s	user 0.013s	sys 0.000s
I20260709 13:15:39.228474  9912 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.249795  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.250043  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:39.249897  9902 consensus_meta.cc:287] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.603s	user 0.004s	sys 0.008s
I20260709 13:15:39.251205  9893 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.234987  9921 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:39.249365  9912 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:39.243325  9849 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:15:39.197306  9907 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:39.273944  9907 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.258003  9842 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.269618  9912 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.282780  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.264483  9911 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:39.251550  9905 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.256376  9902 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:39.294163  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 135183us
I20260709 13:15:39.270563  9921 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:39.302029  8842 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.293138  8914 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.290855  8911 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:39.312386  8914 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:39.300716  9894 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.295971  9911 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:39.299316  9921 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.331929  9902 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:39.341741  9849 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.342432  9849 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:39.344441  8760 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.008s
I20260709 13:15:39.347401  8760 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:39.348443  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:39.350059  8882 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:39.350222  9870 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:39.350919  9870 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.363365  9905 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.364500  9868 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.391583  9868 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:39.393594  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.393836  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:39.364370  9911 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.342475  9846 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.365326  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.414152  9846 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:39.366777  9922 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:39.366781  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:39.368387  9886 consensus_meta.cc:287] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.002s
I20260709 13:15:39.415278  9846 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.415521  9886 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.286814  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:39.319162  9825 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.291317  9883 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.370103  9924 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:39.377207  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.360719  9856 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.380226  8840 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.382450  9862 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:39.445031  8768 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:39.383154  9828 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:39.384603  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:39.385409  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:39.386121  9912 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.344755  9849 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:39.389868  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:39.389391  9885 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.390960  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:39.480618  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89719.8us
I20260709 13:15:39.390832  9839 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:39.396252  8841 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.396965  8843 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:15:39.398175  8844 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.400839  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.402391  9917 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:39.404032  9826 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.404960  9822 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.437353  8664 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 90) took 1952 ms. Trace:
I20260709 13:15:39.416607  9846 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.448027  8768 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.468570  8911 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
W20260709 13:15:39.477569  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 227634us
W20260709 13:15:39.478478  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 229303us
I20260709 13:15:39.505319  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.506600  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.507506  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.417904  9886 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:39.470765  8918 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.444056  8840 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:39.483157  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.484973  8844 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:39.509968  8912 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.510505  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.499812  8766 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.447980  9865 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:15:39.455577  8842 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.514597  8769 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:39.515110  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.515471  8836 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.433090  9825 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.486400  9856 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.437884  9921 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:39.518432  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.480366  9857 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:39.511972  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.498147  9849 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:39.531759  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.531271  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:39.538255  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.590090  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.590699  8841 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:39.591647  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.597703  8913 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.600229  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:39.515817  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:39.603385  8837 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.501773  9924 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:15:39.607393  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:39.516116  9850 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:39.608421  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.601257  8767 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:39.589939  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.502053  9781 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:15:39.517199  9909 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 13:15:39.597213  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:39.621048  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:39.596652  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 63112.3us
I20260709 13:15:39.591246  9915 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:39.602164  9934 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.609198  9910 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:39.625335  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:39.527473  9826 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.606453  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.618286  9794 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:15:39.517409  9871 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 13:15:39.643733  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.519372  9905 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 13:15:39.595865  9849 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.514901  9919 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:15:39.517530  9923 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:15:39.630898  9842 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.630985  9869 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:39.632836  8761 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:39.651787  9915 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.667840  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.668344  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.668784  8767 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:39.633445  9781 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.671295  9915 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:39.671474  9781 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:39.635993  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.647616  8763 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:39.656787  9828 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:39.666297  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:39.638108  9794 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.657351  9825 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:39.658500  9921 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.679525  8762 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.679834  9921 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:39.680289  9921 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:39.680030  9868 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.681100  9923 consensus_queue.cc:1243] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:39.681317  8762 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.519090  9896 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:15:39.650020  9465 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:39.631323  9910 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.665915  8838 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.650091  9909 consensus_queue.cc:1243] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:39.493585  8664 rpcz_store.cc:276] 0709 13:15:37.470109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:37.470264 (+   155us) service_pool.cc:224] Handling call
0709 13:15:37.505799 (+ 35535us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b5400002490. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc760b2 00007fce75befa89 00007fce75b87da6 00007fce75b59088 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc
0709 13:15:39.418458 (+1912659us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:38.017605 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:38.022733 (+  5128us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:38.022788 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:15:38.022822 (+    34us) tablet.cc:662] Decoding operations
0709 13:15:38.023279 (+   457us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:38.023372 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:38.023399 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:38.023680 (+   281us) tablet.cc:701] Row locks acquired
0709 13:15:38.023726 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:15:38.023884 (+   158us) write_op.cc:270] Start()
0709 13:15:38.024031 (+   147us) write_op.cc:276] Timestamp: P: 1783602938023822 usec, L: 0
0709 13:15:38.024067 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:15:38.066892 (+ 42825us) log.cc:844] Serialized 532 byte log entry
0709 13:15:38.661551 (+594659us) op_driver.cc:464] REPLICATION: finished
0709 13:15:38.829212 (+167661us) write_op.cc:301] APPLY: starting
0709 13:15:38.829303 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:38.829427 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:38.829562 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:38.829881 (+   319us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:38.830222 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:38.830281 (+    59us) write_op.cc:312] APPLY: finished
0709 13:15:38.997530 (+167249us) log.cc:844] Serialized 22 byte log entry
0709 13:15:38.997744 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:38.997826 (+    82us) write_op.cc:454] Released schema lock
0709 13:15:38.997879 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:38.998309 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:38.998343 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72,"reported_tablets":4,"spinlock_wait_cycles":10615680,"child_traces":[["op",{"apply.queue_time_us":166233,"apply.run_cpu_time_us":2701,"apply.run_wall_time_us":169070,"num_ops":1,"prepare.queue_time_us":162746,"prepare.run_cpu_time_us":56936,"prepare.run_wall_time_us":289782,"raft.queue_time_us":188669,"raft.run_cpu_time_us":4718,"raft.run_wall_time_us":116889,"replication_time_us":625759,"thread_start_us":397473,"threads_started":4,"wal-append.queue_time_us":253060}]]}
I20260709 13:15:39.675426  8916 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:39.688349  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:39.679579  9935 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:15:39.620088  9850 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.677314  9828 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.672812  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:39.676352  9794 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:39.658954  9849 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.684610  9822 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.691035  8763 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.689258  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.522459  9927 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.143s
I20260709 13:15:39.681239  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:39.682265  9921 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.671295  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.694854  8843 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.672477  9781 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.714344  9781 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.714610  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.714811  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.715458  9862 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.716286  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.682890  8762 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.681334  9868 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.699450  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:39.689802  8767 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.687846  9910 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:39.644970  9934 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:39.708544  9794 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.715948  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.718173  9885 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:39.729542  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:39.717264  9466 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:39.732815  8767 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:39.730571  8761 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:39.919792  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.011560  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.015717  9932 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.003262  9857 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.016258  9932 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.017234  9894 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.017458  9921 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.018136  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 302255us
I20260709 13:15:40.018956  9932 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:40.019658  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.020388  9932 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.020767  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:39.837661  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.021339  9857 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:39.796581  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:39.778889  9862 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.023510  9857 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:39.781327  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:40.024572  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 243355us
I20260709 13:15:40.024842  9468 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:40.025429  9825 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.026427  8840 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.027451  9934 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:40.027645  8840 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:39.883558  9911 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.178s
W20260709 13:15:39.856000  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.099833  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 79139.8us
W20260709 13:15:40.010741  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 497386us
I20260709 13:15:39.736205  9919 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.101572  9919 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:40.028679  9915 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.106824  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:40.104748  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.111953  9468 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:40.116989  8734 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:39.848199  9856 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.121476  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:39.780037  9828 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.122694  9468 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:39.816004  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:40.127071  9941 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.128207  9941 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.128542  9941 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.129055  9932 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.129499  9932 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.130131  9871 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:40.131172  9466 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:40.132407  8840 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.132676  9941 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.005734  9883 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.104153  9894 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.135052  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:40.104501  9877 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.133936  8761 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:40.143527  8763 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:40.111824  9903 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.150807  9871 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.151234  9877 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.157694  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:40.158217  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1118) took 1094 ms. Trace:
W20260709 13:15:40.159015  9948 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:15:40.163539  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.074921  9905 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:15:40.170217  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.171306  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.163702  9847 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.173898  9865 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.177834  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1102) took 1262 ms. Trace:
I20260709 13:15:40.179323  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.200441  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.201130  8764 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:40.183375  9890 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.184922  9933 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:40.102577  9919 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.124342  9934 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.139554  9794 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.189389  8913 rpcz_store.cc:276] 0709 13:15:39.064215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.121049 (+ 56834us) service_pool.cc:224] Handling call
0709 13:15:39.420076 (+299027us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b58001d1f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:15:39.420312 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.602616 (+182304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.157980 (+555364us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54002931d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:40.158155 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413790848}
I20260709 13:15:40.118144  9857 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:40.163942  9828 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:15:40.148490  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:40.121232  9862 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 13:15:40.120375  9915 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:40.037400  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 352570us
I20260709 13:15:40.198949  8918 rpcz_store.cc:276] 0709 13:15:38.916401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:38.918706 (+  2305us) service_pool.cc:224] Handling call
0709 13:15:38.918988 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:39.508851 (+589863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.177573 (+668722us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54003aeb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:40.177740 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268398464}
I20260709 13:15:40.205902  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:40.209429  9933 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.168303  9903 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:40.225862  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.200731  9464 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
W20260709 13:15:40.225610  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 89959.6us
I20260709 13:15:40.229283  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:40.229806  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:40.199013  9865 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.226790  9825 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.231503  9871 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.233893  9857 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.234411  9871 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.233909  9825 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:40.234812  9871 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.226816  9886 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:40.235600  9825 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.236114  9886 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.236881  9825 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.238569  9886 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:40.238749  9865 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:40.235601  9839 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:40.257414  9839 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:40.258515  9893 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.258291  9839 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.259009  9893 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:40.261556  9783 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:40.261806  9912 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.203843  9847 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.266141  9871 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.267693  9933 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.269060  9933 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.269193  8844 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.270272  8844 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.217016  9934 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:40.295858  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.295991  9905 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.299088  9896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.028s
I20260709 13:15:40.309176  8764 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.309315  9871 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.302526  9905 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.278352  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:40.313338  8844 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.316325  9934 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.318076  9893 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.301852  9932 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:40.310657  9896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.004s	sys 0.028s
W20260709 13:15:40.314182  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 192789us
I20260709 13:15:40.322657  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:40.327313  9893 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.336653  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.337056  9850 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:40.324470  9923 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:40.339309  9934 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.340896  9933 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.341137  9794 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:40.341667  9933 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.342463  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.342761  9934 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:40.342717  9933 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.343633  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:40.344229  8768 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.344578  9941 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.345613  9915 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.346416  9877 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.347555  9941 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:40.344574  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.348449  9885 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.348907  9885 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.349757  9885 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.350145  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:40.350922  9885 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.351485  9934 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.352349  9934 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.352782  9934 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:40.353065  8763 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:40.353276  9934 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.341540  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:40.359570  9909 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:40.359829  9910 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.626s	user 0.001s	sys 0.009s
I20260709 13:15:40.360054  9909 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:40.360285  9910 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.361207  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.361950  8836 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:40.362913  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:40.363582  9462 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:40.364609  9932 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:40.365571  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.370347  9905 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.373064  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.340821  8664 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 2, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 2 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.375933  9941 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.379786  8769 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:40.362460  9910 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.377348  8768 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:40.379779  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.381351  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:40.385042  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.386862  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:40.387499  8837 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.387559  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.391112  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.381449  8760 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:15:40.389777  8664 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 2 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.385582  9461 raft_consensus.cc:2368] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4.
W20260709 13:15:40.393393  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 256596us
W20260709 13:15:40.388556  9868 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.002s
I20260709 13:15:40.385401  9883 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.385265  9859 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:40.390537  9941 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.391635  9956 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.395215  9954 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.397431  9859 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.396641  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.385850  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.408927  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.410264  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.411144  9794 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.411649  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:40.411731  9794 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.413327  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.414067  9794 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.414423  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:40.414873  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.419260  8913 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.418809  8664 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 2 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.420902  8913 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.420994  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:40.424216  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:40.424366  8918 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:40.424835  8916 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:40.421561  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:40.393853  9903 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.432442  9873 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.434146  9877 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.432957  8909 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.433311  9958 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:40.441571  9958 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.442219  9958 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:40.398350  9862 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:40.398121  9956 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:40.443807  8837 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:40.449602  8914 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.450192  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:40.450969  8837 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:40.446470  8912 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:40.400583  9859 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.426862  9868 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.453294  9868 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.455085  8809 leader_election.cc:400] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4.
I20260709 13:15:40.455415  8809 leader_election.cc:403] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:40.456228  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.458361  9905 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4.
I20260709 13:15:40.461035  9890 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.460964  9859 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.461688  9890 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.435669  9828 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.462215  8910 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 4. Ops: []
W20260709 13:15:40.465744  9432 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.664s (SENT)
I20260709 13:15:40.488582  8842 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.486402  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.427285  9794 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.498046  9954 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.485394  9937 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.497439  9905 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:40.452742  9826 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.001s
I20260709 13:15:40.533337  9871 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.461225  9847 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.531692  9954 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.577504  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.574707  9871 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.578184  9954 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.562400  9850 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.443194  9958 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.534370  9937 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.463943  9890 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:40.599130  9955 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.292s	user 0.003s	sys 0.000s
I20260709 13:15:40.535480  9794 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.507279  9934 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:40.613184  9934 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.629428  8761 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:40.631276  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.592037  9894 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.633975  8766 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.642917  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.643214  9953 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:40.644168  8837 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
W20260709 13:15:40.645592  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.644064  9953 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:40.646149  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.646541  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.647205  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 212241us
I20260709 13:15:40.650220  9937 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:40.650470  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 253930us
I20260709 13:15:40.650879  9954 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.652093  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.656617  9868 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:40.657142  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 191430us
I20260709 13:15:40.657903  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.664232  8843 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:40.669691  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.668794  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:40.676200  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:40.657795  9958 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.647725  9953 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.657450  9871 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.658183  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 789) took 1005 ms. Trace:
I20260709 13:15:40.672340  9794 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.681594  9941 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.674990  9934 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.658228  9890 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.676143  9868 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.676754  9850 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.679842  9932 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:40.715749  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:40.716145  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 74560.6us
I20260709 13:15:40.681849  9862 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:40.707937  9941 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:40.725315  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.726056  8760 raft_consensus.cc:2376] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2. Re-sending same reply.
I20260709 13:15:40.712644  9883 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:15:40.703291  8767 rpcz_store.cc:276] 0709 13:15:39.652991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.102671 (+449680us) service_pool.cc:224] Handling call
0709 13:15:40.103003 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:40.323272 (+220269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:40.324954 (+  1682us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:40.328377 (+  3423us) log.cc:844] Serialized 26 byte log entry
0709 13:15:40.394987 (+ 66610us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:40.396032 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:40.397581 (+  1549us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:40.501264 (+103683us) raft_consensus.cc:1685] finished
0709 13:15:40.501307 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:40.658115 (+156808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19427,"raft.queue_time_us":67197,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":158,"thread_start_us":224308,"threads_started":2,"wal-append.queue_time_us":115752}
I20260709 13:15:40.734530  8839 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:40.712028  9781 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:15:40.727772  9941 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.757203  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.758213  8767 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:40.764253  9859 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:40.719003  9868 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:40.766305  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:40.767184  9461 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.767939  9868 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.720659  9850 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.772369  9850 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.774165  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:40.774230  9781 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:40.777827  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.778156  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.780226  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.785257  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:40.792352  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.792809  8841 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:40.793275  8764 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:40.791054  9953 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:40.808296  9953 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.808763  9953 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.842001  8762 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:40.843626  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 846) took 1332 ms. Trace:
I20260709 13:15:40.844043  8769 rpcz_store.cc:276] 0709 13:15:39.516720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:39.596116 (+ 79396us) service_pool.cc:224] Handling call
0709 13:15:39.796389 (+200273us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b5800002d98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:15:40.843424 (+1047035us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540003d754. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:40.843530 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826780288}
I20260709 13:15:40.845204  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:40.851368  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.922s (SENT)
I20260709 13:15:40.851995  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:40.857878  9850 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.858888  9461 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:40.860790  9919 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:40.865542  9941 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.867776  9941 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:40.812276  9958 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.868681  9958 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.875288  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:40.875356  9958 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.882836  9870 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.883219  9463 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 4. Ops: []
I20260709 13:15:40.790393  9781 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:40.883776  9825 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.882899  9854 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.884644  9781 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.884842  9854 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.885946  9781 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.887038  9854 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.883426  9870 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.887296  9958 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:40.887611  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:40.888222  8915 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:40.889458  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:40.887192  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:40.892797  8909 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:15:40.884294  9825 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.900576  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.903595  9939 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.903753  9868 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.904670  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.904461  9939 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:40.888757  9915 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:40.889197  9933 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:40.902181  9958 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:40.900465  9923 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:15:40.947036  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.151s (SENT)
I20260709 13:15:40.952157  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:40.937011  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 61531.6us
I20260709 13:15:40.930634  9859 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.959278  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.897508  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:40.960477  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:40.966986  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:40.904489  9868 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.943818  9950 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:40.973990  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:40.945684  9958 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:40.945910  9915 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:40.987056  8808 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.874s (SENT)
I20260709 13:15:40.988940  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:40.959755  9825 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:40.998576  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.000131  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.000267  8918 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.013586  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.014477  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.018136  8913 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.023190  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.016137  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:41.024492  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:40.970006  8838 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:41.044817  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:40.975229  9941 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:41.046273  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 344568us
I20260709 13:15:41.008919  9862 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:40.975641  9954 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:40.963353  9923 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.017778  9919 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:40.968832  9859 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.053421  8913 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:41.055968  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.057435  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:41.014282  9870 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:41.015074  9934 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.017637  9945 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.013562  9893 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.058208  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.082031  8916 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:41.080096  9934 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.069435  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.089421  8913 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.075675  9919 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.060596  9828 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:41.051672  9862 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:40.981500  9950 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.067008  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:41.060591  9873 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.057264  9958 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.074363  9894 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:15:41.059870  9898 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:41.075037  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.050190  9941 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:41.109030  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47481.4us
I20260709 13:15:41.145196  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:41.014361  9952 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.033s	sys 0.010s
I20260709 13:15:41.145223  8918 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:41.121028  9970 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.122601  9828 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.123517  9873 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.115051  9862 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.162376  9873 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:41.125700  9825 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.169165  9825 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:40.974370  9461 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:41.130697  9854 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.133601  9939 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:41.077481  9915 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.136584  9950 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:41.146224  9952 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.035s	sys 0.010s
I20260709 13:15:41.119248  8913 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.147931  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.185750  8918 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:41.187347  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.148928  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 81860.1us
I20260709 13:15:41.152122  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.124644  9956 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.153120  9954 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.161429  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.153231  9828 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:15:41.163754  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 215922us
I20260709 13:15:41.158242  9970 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.166234  9868 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.167846  9934 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:41.163156  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.173019  9978 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.175251  8914 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.147574  9941 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.229411  9828 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.230731  9828 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:41.178417  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 163999us
I20260709 13:15:41.187271  8918 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:41.205108  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.232337  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.205991  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:41.221817  9432 leader_election.cc:336] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.925s (SENT)
I20260709 13:15:41.224565  9934 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.226352  9970 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:41.235343  9432 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.229s (SENT)
I20260709 13:15:41.200799  9956 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:15:41.241716  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65328.3us
I20260709 13:15:41.239625  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:41.241626  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.217519  9894 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.250514  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.251876  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.253176  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.182121  9854 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:41.255136  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52915.5us
I20260709 13:15:41.257659  9873 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.258316  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.260023  9868 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:41.260257  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.260640  9868 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.261281  9868 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.264694  9865 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:41.266547  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.266408  9869 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.267458  9902 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:41.222235  8911 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:41.275480  9970 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.277604  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:41.278450  8761 raft_consensus.cc:2368] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:41.279451  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:41.280133  8761 raft_consensus.cc:2376] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2. Re-sending same reply.
I20260709 13:15:41.250121  9910 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.281141  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:41.281340  9910 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.281981  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:41.282613  9462 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:41.283556  9910 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:41.248009  9992 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.284433  9992 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.212699  9839 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:41.286384  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.291433  8915 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:41.275271  9981 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.299974  9981 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.300436  9981 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.302115  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.252321  9923 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:41.284788  9992 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:41.324445  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 172430us
I20260709 13:15:41.324724  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.323592  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.286573  9919 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:41.327297  9984 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:15:41.340713  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.299093  9870 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:41.332633  8764 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.350174  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.350306  9883 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.289813  9979 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:41.340732  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 87637.2us
I20260709 13:15:41.353395  8913 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:41.353819  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.355283  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.304020  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.294124  9905 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.296774  9466 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:41.357497  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.252424  9894 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.363548  8764 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.364970  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.364849  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.365790  8764 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.331143  9825 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.368450  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.368749  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.342756  9923 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:41.372686  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.343148  9850 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:41.373890  8769 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.349118  9870 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.365990  9958 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:41.370793  9890 consensus_meta.cc:287] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.654s	user 0.003s	sys 0.011s
I20260709 13:15:41.382917  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:41.383846  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 85930.2us
I20260709 13:15:41.360930  9883 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:41.366415  9902 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.366472  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.387172  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.374763  9898 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:41.387238  9850 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:41.390451  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:41.391491  9982 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:41.372028  9859 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.391867  9854 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.347806  9934 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:15:41.374847  9905 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.385370  9870 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.402702  9898 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.415886  9850 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.448485  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.462008  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 171) took 1454 ms. Trace:
I20260709 13:15:41.416961  9999 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.402096  8911 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:41.465337  9871 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.463963  9999 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:41.424599  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.473134  8765 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.476410  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:41.477262  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.477587  9999 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.428617  9885 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.429029  9922 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.468475  9981 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.429762  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 865) took 1735 ms. Trace:
I20260709 13:15:41.480158  8766 rpcz_store.cc:276] 0709 13:15:39.694113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.112439 (+418326us) service_pool.cc:224] Handling call
0709 13:15:40.112887 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.634521 (+521634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.429474 (+794953us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b5400378f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:41.429676 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1197816704}
I20260709 13:15:41.414047  9923 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.431135  9932 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.482393  9932 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:41.431221  9868 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.388401  9902 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.485674  9902 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.486964  9868 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.431867  9894 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:41.436048  9953 consensus_meta.cc:287] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.005s
W20260709 13:15:41.425669  9986 log.cc:927] Time spent T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.003s
I20260709 13:15:41.402495  8761 raft_consensus.cc:2376] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2. Re-sending same reply.
I20260709 13:15:41.445051  9883 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.446242  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.431638  9890 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:41.384505  9958 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.467905  9970 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.477456  9854 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.477900  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.479339  9922 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:41.351188  9956 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.429800  9979 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.427865  9945 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:41.493639  9781 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.607s	user 0.016s	sys 0.002s
I20260709 13:15:41.489248  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.483830  9932 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.464157  9898 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.488241  9953 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.448606  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.462508  9463 rpcz_store.cc:276] 0709 13:15:40.007828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.030496 (+ 22668us) service_pool.cc:224] Handling call
0709 13:15:40.769067 (+738571us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:15:40.877514 (+108447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.883706 (+  6192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.461725 (+578019us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b540039ec50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:41.461919 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264032384}
I20260709 13:15:41.494448  9862 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.434253  9893 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.506219  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 793) took 1346 ms. Trace:
I20260709 13:15:41.496606  9854 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.491788  9868 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:41.522907  9854 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.511822  8768 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:41.499130  9958 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.519376  8763 rpcz_store.cc:276] 0709 13:15:40.160055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.160172 (+   117us) service_pool.cc:224] Handling call
0709 13:15:40.160446 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.353519 (+193073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.505824 (+1152305us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54000baed4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:41.506132 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442519936}
I20260709 13:15:41.490054  9941 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.501140  8762 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.523074  9868 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.511360  9999 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.510192  9859 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.538292  8764 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:41.499334  9992 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:41.543757  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.539374  9932 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.501271  9970 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
W20260709 13:15:41.549139  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 261750us
I20260709 13:15:41.530862  8767 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.548472  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:41.552178  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 196969us
I20260709 13:15:41.554075  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.555858  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:41.545106  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:41.554091  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.565604  8763 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.500355  9909 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.544987  9826 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:15:41.522107  9979 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.573597  8761 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.543671  9859 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.557360  9981 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:41.575039  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 224800us
I20260709 13:15:41.557830  9922 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.557413  9868 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.591925  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.576614  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:41.577903  8912 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:15:41.591986  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.591135  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.604347  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:41.604517  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.607963  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:41.585724  9991 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:15:41.586601  9970 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.630754  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.579746  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.625020  9981 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.567378 10001 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.610191 10004 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.589303  9969 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.629423  8767 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:15:41.630084  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:41.630452  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.631699  8836 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:41.632334  9871 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.633313  9958 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.634348  9979 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:41.634173 10002 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:41.588065  9909 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.636536  9992 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:41.583508  9902 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.652808  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.780035  8763 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:41.654872  9898 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.771729  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:41.782181  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 143823us
I20260709 13:15:41.787231  8767 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:15:41.770871  8664 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 91) took 1644 ms. Trace:
I20260709 13:15:41.681783  9432 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:41.790004  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.647980  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.638716  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.579093  9839 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.828909  8841 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:41.608580  9896 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:41.795280  8764 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.797432  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.829888  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.830178  8767 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:41.841032  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:41.841537  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.841753  8909 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.842293  8767 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:41.795670  9905 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.775241  9828 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.657135 10003 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.728652  9970 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.846043  8763 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:41.794972  9999 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.839965  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.844470  8764 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:41.659190  9859 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.637353  9893 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.796649  8664 rpcz_store.cc:276] 0709 13:15:40.126782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.128614 (+  1832us) service_pool.cc:224] Handling call
0709 13:15:41.770783 (+1642169us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:40.725380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:40.726157 (+   777us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:40.726198 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:15:40.726224 (+    26us) tablet.cc:662] Decoding operations
0709 13:15:40.726949 (+   725us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:40.727072 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:40.727113 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:15:40.734987 (+  7874us) tablet.cc:701] Row locks acquired
0709 13:15:40.735004 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:40.735141 (+   137us) write_op.cc:270] Start()
0709 13:15:40.735252 (+   111us) write_op.cc:276] Timestamp: P: 1783602940735098 usec, L: 0
0709 13:15:40.735280 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:15:40.763478 (+ 28198us) log.cc:844] Serialized 1292 byte log entry
0709 13:15:41.288681 (+525203us) op_driver.cc:464] REPLICATION: finished
0709 13:15:41.344753 (+ 56072us) write_op.cc:301] APPLY: starting
0709 13:15:41.344897 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:41.345077 (+   180us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:41.345246 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:41.345935 (+   689us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:41.346167 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:15:41.346232 (+    65us) write_op.cc:312] APPLY: finished
0709 13:15:41.346523 (+   291us) log.cc:844] Serialized 34 byte log entry
0709 13:15:41.346723 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:41.346812 (+    89us) write_op.cc:454] Released schema lock
0709 13:15:41.346848 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:41.347190 (+   342us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:41.347228 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":55777,"apply.run_cpu_time_us":2410,"apply.run_wall_time_us":2417,"num_ops":3,"prepare.queue_time_us":259975,"prepare.run_cpu_time_us":21706,"prepare.run_wall_time_us":330539,"raft.queue_time_us":146331,"raft.run_cpu_time_us":17042,"raft.run_wall_time_us":59531,"replication_time_us":553220,"thread_start_us":673747,"threads_started":4,"wal-append.queue_time_us":327818}]]}
W20260709 13:15:41.821480  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 139830us
I20260709 13:15:41.779682  9992 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:41.587404  9870 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.700599  9969 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:41.727921  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:41.659759  9953 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:41.651098  9941 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:41.851014  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.845376  9781 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:41.651194  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.652415  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.851892  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:41.786813 10004 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:41.798691  9871 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.861425  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.854665  8916 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:41.768414  8761 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:41.829321  9990 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:41.859615  9957 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:15:41.871758  8763 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:41.654763  9854 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.637260  9850 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.224s
I20260709 13:15:41.867507  9934 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.878567  8841 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.797842  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.911550  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.848052  9828 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:41.934952  9828 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.846451  9896 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:41.936839  9896 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.829521  9952 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.941318  9952 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:41.941877  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.942329  9952 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.943372  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.887274  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:41.944528  8764 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.942291  9909 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:41.947412  9909 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.948215  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 812) took 1106 ms. Trace:
I20260709 13:15:41.948724  8769 rpcz_store.cc:276] 0709 13:15:40.842248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.844957 (+  2709us) service_pool.cc:224] Handling call
0709 13:15:41.948043 (+1103086us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540034e9d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:41.948157 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214061312}
I20260709 13:15:41.888420  8767 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:41.891073  9894 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:41.892427  8915 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:41.897094  8839 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.897625  8911 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:41.947458  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:41.897913  8835 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.892776  9781 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.880833  9992 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.844951  9905 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.893139 10004 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.906332  8909 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:41.865794  8760 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:41.982095  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.982452  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58862 (request call id 58) took 1006 ms. Trace:
I20260709 13:15:41.982750  8839 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.982827  8760 rpcz_store.cc:276] 0709 13:15:40.975794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.059742 (+ 83948us) service_pool.cc:224] Handling call
0709 13:15:41.579559 (+519817us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b5800002d98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75e9c 00007fce6cc75a5b 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:15:41.982387 (+402828us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10608384}
I20260709 13:15:41.913811  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.910240  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.986018  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.986708  8836 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:41.987445  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.987948  8836 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:41.915081  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.915688  9958 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.892222 10003 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:41.989179  8763 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
W20260709 13:15:41.989486  8838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 43) took 1633 ms (client timeout 1630 ms). Trace:
I20260709 13:15:41.909847  9461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 182) took 1016 ms. Trace:
I20260709 13:15:41.908695  9953 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:41.881768  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:41.854337  9970 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.918721  9957 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:41.920598  9873 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:41.920921  9859 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:15:41.907095  9990 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.922019  9871 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.923547  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:41.925920  9898 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.928539  9902 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.933168  9854 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:41.866166  9999 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.855794  9981 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.950381  8884 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:41.885797  9911 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:41.974741  8764 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:41.886319  8917 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:42.068359  8912 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:41.976428  8841 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:41.880551  9893 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.979998  9905 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.072999  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:42.073776  8837 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:42.074222  9905 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:42.074702  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.074749  9905 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.075512  8837 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:42.075630  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:42.076287  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:41.958609  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:42.077832  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:41.981806 10004 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.078495  9893 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.078562 10004 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:42.078969  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.079193 10004 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.992961  8766 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.989672 10003 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:41.989941  8838 rpcz_store.cc:269] 0709 13:15:40.356558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.371944 (+ 15386us) service_pool.cc:224] Handling call
0709 13:15:41.989291 (+1617347us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54003a5f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:41.989395 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1281261824}
I20260709 13:15:41.999387  9953 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:41.970988  9868 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.147244  8842 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:41.959288  9937 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:41.957862  9839 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:42.025002  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 157084us
W20260709 13:15:42.038923  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:41.953830 10006 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:41.954813  9934 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:41.969496  9894 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:42.067587  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 201951us
I20260709 13:15:42.080114  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:42.070123  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 119823us
I20260709 13:15:42.043649  9873 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.081633  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 56) took 1135 ms. Trace:
I20260709 13:15:42.193660  8768 rpcz_store.cc:276] 0709 13:15:40.945998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.761165 (+815167us) service_pool.cc:224] Handling call
0709 13:15:41.761539 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:41.761886 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:41.761915 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:41.762330 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:15:41.903422 (+141092us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:41.903462 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.903548 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:42.080642 (+177094us) raft_consensus.cc:1685] finished
0709 13:15:42.080664 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.080812 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30934,"raft.queue_time_us":638,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"spinlock_wait_cycles":4352,"thread_start_us":118437,"threads_started":1,"wal-append.queue_time_us":294989}
I20260709 13:15:42.076802  8837 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.083371  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:42.196225  8841 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:15:42.088477  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 234999us
W20260709 13:15:42.158452  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 253749us
I20260709 13:15:42.189208  9893 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:42.201660  9893 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:42.187861  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.008525  9957 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:42.057467  8914 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:42.085167  9902 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.069228  9981 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.082175  9905 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.186997 10006 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.199833  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 811) took 1357 ms. Trace:
I20260709 13:15:42.193687  9909 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.201005  9956 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.970173  9969 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.203771  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:42.228292  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.163178  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.216737  9868 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:42.216511  9937 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:42.233055  9957 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.071568  9911 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.234439 10003 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.241789  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.247301  9871 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.272099  8841 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
W20260709 13:15:42.272574  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109525us
I20260709 13:15:42.272881  8734 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.240295  8837 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:42.248921  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:42.249754  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 259735us
I20260709 13:15:42.243242  9893 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.243539  8839 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:15:42.245762  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.250958  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.249233  8917 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:42.249248  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.241839 10004 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.252799  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.250736  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:42.294848  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44192.1us
I20260709 13:15:42.295631  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.296727  8882 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.249141  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.249552  8836 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:42.205323  8835 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:15:42.258069  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.254349  9902 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.255182  9953 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.279011  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:41.996646  9461 rpcz_store.cc:276] 0709 13:15:40.892633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:40.895126 (+  2493us) service_pool.cc:224] Handling call
0709 13:15:40.943439 (+ 48313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:40.963044 (+ 19605us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:41.488305 (+525261us) log.cc:844] Serialized 14 byte log entry
0709 13:15:41.864236 (+375931us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:41.869050 (+  4814us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:41.872163 (+  3113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:41.885590 (+ 13427us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:41.908665 (+ 23075us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":417,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":11181,"thread_start_us":339516,"threads_started":1,"wal-append.queue_time_us":404218}
I20260709 13:15:42.286731  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.290113  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:42.268618  9934 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.271898  9969 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.270521  9868 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:42.302189  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:42.303720  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50999.2us
I20260709 13:15:42.322372  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:42.304538  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55475.9us
I20260709 13:15:42.327493  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:42.278576  9870 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.275743  9909 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:42.284874  9933 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.308692  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.286829 10003 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.286432  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:42.275071  8838 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:42.312816  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:42.285775  9992 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.267450 10018 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:15:42.337556  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:42.349864 10018 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.350179  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.352962  8838 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:42.348501 10003 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.354012  9868 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.354833  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 872) took 1326 ms. Trace:
I20260709 13:15:42.354977 10003 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.355229  8767 rpcz_store.cc:276] 0709 13:15:41.027991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.842974 (+814983us) service_pool.cc:224] Handling call
0709 13:15:41.888190 (+ 45216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:41.954578 (+ 66388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.354662 (+400084us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54001a7f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:42.354781 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103151488}
I20260709 13:15:42.355757 10012 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.356264 10012 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.356413  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.285229  9894 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.270283  9937 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:42.332543  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.338352 10024 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:42.389292 10024 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:42.391165  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 827) took 1069 ms. Trace:
I20260709 13:15:42.391580  8766 rpcz_store.cc:276] 0709 13:15:41.321571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.481391 (+159820us) service_pool.cc:224] Handling call
0709 13:15:42.390982 (+909591us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400199454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:42.391100 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123826432}
I20260709 13:15:42.311316  9898 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:42.311910  9871 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.362259  9465 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:42.341506  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55126.2us
I20260709 13:15:42.311200  9854 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.311084  9859 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.345875  9847 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.346284  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.276616  9905 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.356660 10012 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.254890  8762 rpcz_store.cc:276] 0709 13:15:40.841961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.607425 (+765464us) service_pool.cc:224] Handling call
0709 13:15:42.069495 (+462070us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b5800002d98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75e9c 00007fce6cc75a5b 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:15:42.146124 (+ 76629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.186672 (+ 40548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.189236 (+  2564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:42.192303 (+  3067us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:42.199557 (+  7254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.199645 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.199770 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31679488}
I20260709 13:15:42.313525  9902 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.357101  8911 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:42.317636  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.355078  8840 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:42.359050  9970 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.359472  9981 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.266219  9896 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.317466  9990 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.337917  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.363345  8767 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:42.363577  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.378935  9957 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.351354  9999 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.350957  9934 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:42.413625  9934 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.415808  9934 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.343166  9909 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:42.418970  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 101399us
W20260709 13:15:42.419831  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 81988.7us
I20260709 13:15:42.420028  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.380360  9911 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.384742  9873 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.352293 10017 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.347443  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.359091  8838 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:42.307674  9850 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:42.420912  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.426817 10003 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.392642  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.427062  9890 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:42.429657  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 119635us
W20260709 13:15:42.412899 10023 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:15:42.441769  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.452095  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.394502  9898 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:42.390378 10024 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:42.457883  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:42.397770  9883 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:42.503727  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45957.6us
I20260709 13:15:42.417750  9854 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.465989  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.510165  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 832) took 1187 ms. Trace:
W20260709 13:15:42.505082  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67386.2us
I20260709 13:15:42.395706  9871 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.396027 10018 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.506492  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:42.422523  9859 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.397212  9919 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:42.407204 10021 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 13:15:42.427966 10017 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:42.509763  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43878.3us
I20260709 13:15:42.435580  9937 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.531914  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:42.533270  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 210995us
I20260709 13:15:42.534003  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.515295 10003 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:42.515851  9995 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:42.517962  9894 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.507970  9954 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:42.520946  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.441484  9981 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.481745  9873 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.558264  9873 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.558704  9873 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.456743  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.495087  9952 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:42.507414  9898 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.433832  9934 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:42.553409  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.485703  9890 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:42.554853 10032 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.512501  9854 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.509171  9883 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:42.508478  9909 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.510571  8765 rpcz_store.cc:276] 0709 13:15:41.322842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.000685 (+677843us) service_pool.cc:224] Handling call
0709 13:15:42.001096 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.017451 (+ 16355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.020737 (+  3286us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.072887 (+ 52150us) log.cc:844] Serialized 26 byte log entry
0709 13:15:42.240385 (+167498us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:42.240439 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.240524 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:42.503133 (+262609us) raft_consensus.cc:1685] finished
0709 13:15:42.504067 (+   934us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.510105 (+  6038us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4600,"raft.queue_time_us":7190,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":127,"thread_start_us":143179,"threads_started":1,"wal-append.queue_time_us":198056}
I20260709 13:15:42.557478  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:42.490511  9911 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.513586  9970 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:42.514500  9871 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.529126  9859 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.521894  9902 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.593892  9883 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.594398 10031 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 13:15:42.595391 10031 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:42.595692  8765 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:42.595779 10031 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:42.530879  9919 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:42.556504  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.522468  9905 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:15:42.608611  9905 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:42.609004  9905 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:42.577896  8839 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:42.609809  9905 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.610670  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.611147  9905 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.611855  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.612048  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.612325  8767 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:42.612504  8839 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:42.566612  9937 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.560835  9954 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:42.619925  8767 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:42.591698  8766 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:42.605341  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:42.606276  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49857.4us
I20260709 13:15:42.612666  8837 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:42.613723  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:42.591959  9970 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.584838  9890 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:42.617167  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 289756us
I20260709 13:15:42.614320  9902 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.580426  9934 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.599618  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:42.630609  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:42.632042  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:42.632411  9858 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.632814  9858 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.578240  9952 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.617568  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:42.632771  9902 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:42.601322  9911 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.587369 10017 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.626724  9970 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:42.652112  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:42.652947  9459 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:42.633350  9858 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.623597  9969 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:42.628423  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:42.649274  9464 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:42.654163  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.654270  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.627496  9937 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:42.625972  9894 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:42.657573  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.655781  9903 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:42.633378  9896 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.660518  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:42.661986  9467 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:42.663861  9868 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.663991  9862 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.682808  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 862) took 1044 ms. Trace:
I20260709 13:15:42.663344  9969 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.666546  9958 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:42.670766  9781 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:42.649292 10034 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:42.693866  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.694200  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.689531  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.697887  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.699178  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.677163  9934 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.678218  8761 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:42.661559  9954 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.680675  9847 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:42.709895  9847 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:42.710511  9847 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.654906  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:42.683231  8842 rpcz_store.cc:276] 0709 13:15:41.638290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.638407 (+   117us) service_pool.cc:224] Handling call
0709 13:15:42.682637 (+1044230us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400424854. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:42.682740 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743551360}
I20260709 13:15:42.713598  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.716521  8842 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.680955  9903 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:15:42.680747  9937 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.685472  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.686775  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.687574  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.687004  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.689808  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.674213  9868 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.727123  9868 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.626892 10031 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.728498 10031 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.699832  8916 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:42.695700  8835 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:42.701131  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.730448  8909 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:42.696419  9794 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:42.703467 10015 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:42.673491  9894 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:42.719246  9847 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.707023  9902 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.701963  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.733049  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.734149  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.759557  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.734690  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.656662  9919 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.689563  9854 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:42.751431  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90981.3us
W20260709 13:15:42.774824  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72927.6us
I20260709 13:15:42.751573 10038 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:42.761574  8767 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:42.756598  9794 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.763381  9911 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.764647  9858 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:42.749677  9850 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.767964  8842 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:42.769408  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.772408  9847 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.778221  8763 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:42.779140  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:42.781404  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.784228  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:42.794818  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.797062 10038 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:42.798048  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.817696  8843 raft_consensus.cc:2368] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4.
I20260709 13:15:42.817500  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.818297  8842 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:42.819054  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.819311  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.820053  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:42.820164  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:42.800109  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.748734 10015 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:42.753197  9894 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.823546  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 836) took 1347 ms. Trace:
I20260709 13:15:42.823721  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.824204  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.824437  8767 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:42.733630  9873 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.806443  9868 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.773075  9859 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.855746  9468 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.781364 10024 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.855926  8842 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:42.863603  9896 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.857031  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.880772  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.855109  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.882429  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:42.882977  8916 raft_consensus.cc:2368] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3.
I20260709 13:15:42.827353  8913 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:42.863916  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 80889.1us
I20260709 13:15:42.828197  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.829129  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:42.888010  8732 leader_election.cc:400] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3.
I20260709 13:15:42.888403  8732 leader_election.cc:403] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:42.852056  8766 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:42.769428  8762 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:42.859189  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:42.860294  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60314.3us
I20260709 13:15:42.889405  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.863603  8768 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:42.890219  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.814275  9858 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:42.822480  8761 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.827694  9999 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:42.831848  9954 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:42.826102  8909 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:42.869321  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:42.881963  9825 raft_consensus.cc:3055] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:42.902185  8843 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.828658  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.885422  8913 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:42.838886  8884 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.651s (SENT) [suppressed 40 similar messages]
I20260709 13:15:42.886590  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.888589  8918 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:42.906814  8767 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:42.906282  8763 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:42.864885  9958 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:42.823918  8764 rpcz_store.cc:276] 0709 13:15:41.475970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.062995 (+587025us) service_pool.cc:224] Handling call
0709 13:15:42.063344 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.206390 (+143046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.206438 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:42.206491 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:42.206532 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.823330 (+616798us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400379e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:42.823375 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.823494 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328419072}
I20260709 13:15:42.864675  9850 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:42.891150  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.913805  8768 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:42.891659  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.891695  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.855525  9957 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:42.895244  9896 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.929171 10017 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:42.929433  9859 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.901901  9999 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.887351  9898 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.892014 10002 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:42.901666  9954 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:42.930876  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.973311  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:42.965783  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 126966us
I20260709 13:15:42.904569  9854 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:42.934029  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:42.908413  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1140) took 1083 ms. Trace:
I20260709 13:15:42.905834  9825 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:42.974546  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.965751  9999 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:42.927781  9957 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:42.980818  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.986404  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.987869  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.974993  9954 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.010623  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.014058  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:42.975893  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:42.909284 10038 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:42.975237 10017 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.975196  9896 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.930841  9850 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:43.016960  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:42.980019  9957 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:42.980439  9839 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:43.016990 10046 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:15:43.012089  9922 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.011878 10024 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.035568  8767 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.015681  9945 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.039981  9868 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.043388  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.044155  9871 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.027351  9794 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.045053 10034 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:43.045640  9825 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.046470 10018 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.017222  9981 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:42.976358  8838 rpcz_store.cc:276] 0709 13:15:41.824920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.358481 (+533561us) service_pool.cc:224] Handling call
0709 13:15:42.358768 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.358981 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:42.807223 (+448242us) log.cc:844] Serialized 14 byte log entry
0709 13:15:42.879471 (+ 72248us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:42.885270 (+  5799us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:42.891545 (+  6275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.895600 (+  4055us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:42.906133 (+ 10533us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":359,"raft.queue_time_us":4620,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4542,"spinlock_wait_cycles":713472,"thread_start_us":60524,"threads_started":1,"wal-append.queue_time_us":84816}
I20260709 13:15:43.049109  8735 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.017870  9909 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.045054  9956 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.053952  8836 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.054862  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 825) took 1734 ms. Trace:
I20260709 13:15:43.040448  9893 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.069185  8843 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:15:43.037278 10012 consensus_meta.cc:287] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.596s	user 0.007s	sys 0.003s
I20260709 13:15:43.048480 10024 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.073589  8918 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:42.905181 10015 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.074666  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:43.018317  9958 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.075451  9850 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.052848  9952 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.054905  9898 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.078225  9871 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.015750  9970 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.078825  9894 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.079818  9468 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.048595  9828 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.081753  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:43.089071  8769 rpcz_store.cc:276] 0709 13:15:41.320971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.962199 (+641228us) service_pool.cc:224] Handling call
0709 13:15:41.971535 (+  9336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.189723 (+218188us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:42.253632 (+ 63909us) log.cc:844] Serialized 14 byte log entry
0709 13:15:42.485992 (+232360us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:42.486045 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:42.486087 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:42.727914 (+241827us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4800360558. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:15:43.054638 (+326724us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540003f054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:43.054687 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.054805 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43912,"prepare.queue_time_us":63889,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":44363,"raft.run_cpu_time_us":2937,"raft.run_wall_time_us":239052,"spinlock_wait_cycles":510179840,"thread_start_us":208513,"threads_started":2,"wal-append.queue_time_us":254543}
I20260709 13:15:43.095496  9992 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:43.108165  8913 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:43.094069  9893 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.096639  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:43.096349  9956 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.098299  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:43.096900  9781 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:43.108281  8911 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:43.079523 10034 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.112629  9893 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.120108  9893 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.115195  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:43.102253  9825 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.099202  9909 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.117269 10024 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.105547 10015 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.108548  9992 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:43.123188 10034 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.124075  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 868) took 1320 ms. Trace:
I20260709 13:15:43.124918  9839 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:43.104748 10003 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:15:43.127254  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:43.129036  9970 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.127585  9781 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:43.113902  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 174368us
W20260709 13:15:43.133507  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.124969  9956 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.098964 10012 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:43.151376  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.111955  8761 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:43.138885  9992 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.139637  9909 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.132207  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1141) took 1307 ms. Trace:
I20260709 13:15:43.145046  8844 rpcz_store.cc:276] 0709 13:15:41.804043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:41.820268 (+ 16225us) service_pool.cc:224] Handling call
0709 13:15:41.852547 (+ 32279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:42.081575 (+229028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:42.081602 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:42.082012 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:15:42.280120 (+198108us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:42.280158 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.120744 (+840586us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540006bb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:43.120779 (+    35us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:43.120810 (+    31us) raft_consensus.cc:1685] finished
0709 13:15:43.120818 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.123915 (+  3097us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43021,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":17621,"spinlock_wait_cycles":525950720,"thread_start_us":27342,"threads_started":1,"wal-append.queue_time_us":87632}
I20260709 13:15:43.148541 10001 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.154961 10006 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.156718  9890 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3.
I20260709 13:15:43.166702  8765 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:43.171110  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.172025  8844 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:43.155432  9970 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.177465  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:43.181357  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:43.182618 10034 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:43.174270 10012 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.188836  8910 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:43.160223 10001 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.190940  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:43.197685  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.204972  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.207222  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:43.193863 10012 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:43.209111  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.209211  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:43.174634  9999 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.211373  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.201915  9781 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.199810 10002 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.214131  9826 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.214726  8844 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:43.191534  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.158668  8835 rpcz_store.cc:276] 0709 13:15:41.825252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.345829 (+520577us) service_pool.cc:224] Handling call
0709 13:15:43.132008 (+786179us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b540021cd54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:43.132125 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640290688}
I20260709 13:15:43.189805  9970 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.223400 10017 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.219599  9826 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.212669  9958 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.224345  9826 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.221338 10002 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.226110  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1144) took 1400 ms. Trace:
I20260709 13:15:43.226610  8841 rpcz_store.cc:276] 0709 13:15:41.825984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.295187 (+469203us) service_pool.cc:224] Handling call
0709 13:15:43.225862 (+930675us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b5400241b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:43.226036 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050735360}
I20260709 13:15:43.227218 10002 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.215287  9781 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.228158  9781 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.228266  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.230628  9970 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.231024  9919 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.234299  8914 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:15:43.237453  8836 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:43.215659 10012 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:43.215837 10001 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.258186 10001 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.249570  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.259454  9969 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.255014  8914 pending_rounds.cc:85] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 2
I20260709 13:15:43.261302  8914 pending_rounds.cc:107] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:15:43.261653  8914 raft_consensus.cc:2917] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:15:43.262176  8914 raft_consensus.cc:2889] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:43.262725  9954 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.217235  9893 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.256520 10032 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.256675 10012 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.269007  9883 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.219008  9894 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:43.275249  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 107070us
W20260709 13:15:43.277551  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.248735  9992 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.279875  9992 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.283376  8809 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.276834  9434 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.284250 10032 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.284819 10015 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.288511 10015 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:43.250949  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:43.209357  9957 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.289040  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:43.300701  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49873.2us
I20260709 13:15:43.288388  9781 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.305081  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.305734  8844 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.306557  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.307049  8844 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.307844  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.308945  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.310132  8763 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:43.314113  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.315805  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.315837  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.316587  8766 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.317785  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.318452  8767 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:43.315058  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:43.319582  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.319875  8837 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 3. Ops: []
I20260709 13:15:43.267416  9999 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.322932  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.328033  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.331930  8766 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.332387  8767 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.334695  9467 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:15:43.335144  9467 pending_rounds.cc:85] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 2
I20260709 13:15:43.335234  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.335471  9467 pending_rounds.cc:107] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:15:43.300179  9992 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:43.304663  9894 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.336357  9467 raft_consensus.cc:2917] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:15:43.350221  9467 raft_consensus.cc:2889] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:43.337865  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:43.357223  8769 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.343262  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.304337 10006 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:43.328734  8911 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:43.309427  9933 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:43.320504  9956 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.359697  9992 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.360164  9858 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:43.358551  8766 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.299407  9893 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.331308 10002 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.345626 10018 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.349915  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:43.361876 10058 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:15:43.374874  8915 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.362185  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:43.400094  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:43.358965  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82275.9us
I20260709 13:15:43.380352  8767 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:43.349817  9894 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.346158  9903 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:43.407912  9903 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:43.408394  9903 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.411366  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 870) took 1546 ms. Trace:
W20260709 13:15:43.394541  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.412909  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:43.413268  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.370110 10038 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.405114  8844 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:43.305563  9958 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:15:43.404951  8761 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.408212  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.404198  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.377739 10012 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.370774  9933 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.441642  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.442533  8762 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.442622  8843 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.443295  9933 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.444669  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.445350  8839 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.445901  9957 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.403978  9979 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:15:43.411808  8840 rpcz_store.cc:276] 0709 13:15:41.864765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.416474 (+551709us) service_pool.cc:224] Handling call
0709 13:15:42.416782 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.410847 (+994065us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54000693a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd11dc0 00007fce6fd9c1c0 00007fce6fd9d231 00007fce6fd99d8f 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c
0709 13:15:43.411020 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.411049 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:43.411098 (+    49us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:43.411128 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.411191 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:43.411308 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25753472}
I20260709 13:15:43.447718  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.449052  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.450520  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.451256  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.419765 10011 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.451505  9826 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:43.452462 10011 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:43.425750  9898 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.453531  9898 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.454720 10011 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.426581 10038 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.455911  9898 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.456666 10038 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.376276  9858 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.417500  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:43.421222  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.461475  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.462591  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.463579  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.464058  8843 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.464322  8764 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.421967  8766 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.403101  9970 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.413318  9894 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.436251  9893 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.440083  9954 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.398276 10006 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:43.383857 10002 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.400368  9902 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:15:43.430570  9434 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.384321  9781 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.371979  9956 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:43.404148  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.451691  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.431303  8838 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.490491  8764 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.423462  9825 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:43.500109  8843 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.501135  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:43.501945  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.502274  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.502947  8843 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:43.503747  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.504500  8843 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.493609  8760 raft_consensus.cc:2368] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3.
I20260709 13:15:43.513165  8767 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:15:43.505434 10059 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:15:43.514437  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110348us
I20260709 13:15:43.521088  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.459034 10012 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.525727  9826 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.526489 10012 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.523422 10002 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.523795 10039 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.527312 10039 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:43.527755 10039 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.529987  9858 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.505756  9992 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.506480  9969 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.493150 10015 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:15:43.533279  9969 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.534058  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:43.535689  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.537106  8844 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.537441  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.510063 10032 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:43.524761  9956 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.510344  8840 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.547089  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1149) took 1112 ms. Trace:
I20260709 13:15:43.547497  8837 rpcz_store.cc:276] 0709 13:15:42.434800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.872534 (+437734us) service_pool.cc:224] Handling call
0709 13:15:42.872744 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.320287 (+447543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.546793 (+226506us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400242054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:43.547012 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027962752}
I20260709 13:15:43.554533  8882 leader_election.cc:400] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3.
I20260709 13:15:43.557966  8763 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.559798  8837 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:43.561749  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:43.521250  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 98343.8us
I20260709 13:15:43.539414  9826 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:43.562676  8763 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:43.575222  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.576102  8764 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.546566 10004 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.523448  9903 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.585682  9871 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.587477  9873 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.560218 10031 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.552800  9970 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:43.570729  9868 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.582579  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:43.574100  8839 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.659291  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.602686  9826 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.660497  9954 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.660948  9826 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.662582  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.663178  8769 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.637570  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.665413  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.666260  8761 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:43.642329  9970 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.669216  9970 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.643121  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:43.643344  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.667286  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.644320 10003 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.644340  8764 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:43.673898  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.674042 10003 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.674559  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.675174  8764 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:43.643882  9979 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.675886  9979 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.676158  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:43.642354  8762 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.676939  8764 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.677744  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.678220  9979 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.649961  9434 leader_election.cc:400] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4.
I20260709 13:15:43.678810  9979 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.678972  9434 leader_election.cc:403] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:43.647130 10039 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:43.679783  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 91127.4us
I20260709 13:15:43.680887 10039 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.683080  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.683605  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.684393  8844 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:43.684687  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.684393  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.648607  9859 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.685958  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.686205  9859 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.686424 10018 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4.
I20260709 13:15:43.609884 10004 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.687278  9859 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.685766  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:43.651887  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.689257  8768 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:43.631269  9871 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.654707  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.690639  8760 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:43.691344  9871 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.691685  8760 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:43.653334  9934 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.656728  9868 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.692775  9934 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.693544  9868 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.694854  9934 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.695293  8769 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:43.657330  9890 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:43.657742  9969 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.632145 10031 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.678829  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4128699de59a470a9275f001cbd35515"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:15:43.697333  8762 raft_consensus.cc:606] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.697703  8762 raft_consensus.cc:614] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.697607 10031 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.688740  9859 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.698770  8766 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.699677  8764 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:43.700224 10004 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.651134  9903 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:43.659932  9463 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:43.673460  9999 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:43.701107  9999 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:43.675100  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.647547  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 898) took 1392 ms. Trace:
I20260709 13:15:43.704002  8842 rpcz_store.cc:276] 0709 13:15:42.255063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.821338 (+566275us) service_pool.cc:224] Handling call
0709 13:15:42.855616 (+ 34278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:42.873210 (+ 17594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.647348 (+774138us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b54003a5f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:43.647478 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78002560}
I20260709 13:15:43.676214 10003 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:43.686342  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.689450  8844 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:43.696110  8809 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.659323  8838 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:43.657590  8763 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:15:43.640419  9894 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.702184  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:43.706343  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.687213  8761 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:43.709357  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.710430  8842 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.701534  9999 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.712453 10017 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.715854  8841 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.710736  8735 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.722215  9893 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:43.722594  9969 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.728514  9979 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:15:43.723883  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:43.724488  9432 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.725246  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:43.725660  9903 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.728010  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:43.728542  8664 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.689294  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.755326  8664 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 2, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.756575  8840 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:43.757082  9952 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.753095  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.758533  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:15:43.759109  8762 raft_consensus.cc:606] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:43.759459  8762 raft_consensus.cc:614] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.716566  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.731520  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.762530  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:43.711622  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.763288  8836 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:43.687923  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.722846 10032 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:43.755196  9893 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:43.755694  9934 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:43.751986  9969 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:43.760706  8762 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:43.761550  8664 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 2, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.770689  9465 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:43.781407  9465 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:43.782040  9956 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:43.782281  9465 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.762727  8766 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:43.761206 10018 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:15:43.783641  8763 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.783699  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.740918 10004 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:43.760494  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44015.3us
I20260709 13:15:43.784418 10018 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:43.785248 10018 consensus_queue.cc:1243] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:15:43.743242 10002 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.763644  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.785467  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.769351 10012 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:43.773329  9934 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.778998  9894 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.779349  8760 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:15:43.779633  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:43.767491  9871 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.767607  9903 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.793752  9934 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:43.794941  9903 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:43.767700  9898 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.785881  9979 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:15:43.783926  9952 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:43.800356  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.802757  8764 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:43.774386  8769 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:15:43.776162  8664 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 2 to 4, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:43.806329  8664 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.785616  8763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:15:43.787568  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.765417 10003 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.789106 10017 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.789481  9825 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.821254  9979 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.821766  9979 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.789538  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 64) took 1244 ms. Trace:
I20260709 13:15:43.822135  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.791317  9956 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.768105 10032 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:43.767658  9893 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.792193  9969 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:43.808369  8763 raft_consensus.cc:606] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:43.811762 10006 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:43.812716  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 351600us
I20260709 13:15:43.839464  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:43.839676 10006 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:43.814265 10003 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.842326  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:43.812958  8664 catalog_manager.cc:5697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 2, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.847692  8664 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:43.815479  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:43.816287 10015 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:43.789882 10002 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:43.822158  9979 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.830427  8763 raft_consensus.cc:614] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:15:43.822330 10017 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.856841 10001 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:43.840157 10006 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:43.839550  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:43.871158  8839 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:43.852341  9898 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:43.872589 10001 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.873260  9898 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.872816 10006 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.874154  9898 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.874521 10006 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.874801 10001 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:43.857898  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.824810 10032 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.827407  9894 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:43.843865 10003 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.825008  9825 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:43.830883  9956 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:43.855206 10002 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.858035 10004 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.852679  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.896973  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:43.869917  9871 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:43.877012  9893 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:43.877414  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:43.877955  9969 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:43.855108  9903 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:43.883288  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:43.989094  8763 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:43.880508  9894 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.043784  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:44.047840  9911 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:43.823355  8765 rpcz_store.cc:276] 0709 13:15:42.545397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.596716 (+ 51319us) service_pool.cc:224] Handling call
0709 13:15:42.597085 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.173935 (+576850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.789205 (+615270us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b5400338454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:43.789465 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283669760}
I20260709 13:15:44.060043  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:44.062155  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:44.063078  8844 raft_consensus.cc:2368] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3.
I20260709 13:15:43.890244 10004 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.044700  8839 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.890580 10001 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:43.987257  9858 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:43.988771  9903 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.002457  8840 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:43.889853  9957 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.202s
I20260709 13:15:43.891160  9934 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.092267 10004 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:44.018472  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.105515  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:44.111299  9903 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.141028  8909 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:43.897995  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:44.143359  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:44.150349  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 252516us
I20260709 13:15:44.150763  8916 raft_consensus.cc:2410] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:44.097680  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 227549us
I20260709 13:15:44.143267  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.146564  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:44.143258  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.144747  8913 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:44.145761  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.145946  8911 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:44.155169  8914 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.077387  9894 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:44.105995 10001 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:44.166471  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:43.900177  9859 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.269s
I20260709 13:15:44.104414  9858 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.148015  9992 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.173743  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.174881  8913 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:44.156464  8838 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.158452 10012 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.118927  9825 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.123559 10017 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:44.193001  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.053s	sys 0.129s
W20260709 13:15:44.193617  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.053s	sys 0.130s
I20260709 13:15:44.201395  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:44.183274 10012 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.204757  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:44.139454  9956 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.187532  9957 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:44.182467  9911 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:15:44.230475  8884 leader_election.cc:400] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3.
I20260709 13:15:44.231817  8884 leader_election.cc:403] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:15:44.295414  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 83514.7us
W20260709 13:15:44.212452  9463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.077s	sys 0.078s
I20260709 13:15:44.183030  9992 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.365743  9992 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:44.209017 10012 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:44.209890 10038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.015s	sys 0.042s
W20260709 13:15:44.369130 10038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.016s	sys 0.043s
I20260709 13:15:44.369953  9858 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:44.246883  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 492256us
I20260709 13:15:44.373082  8883 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:44.323328  9902 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.380791  8760 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:44.360345  9865 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:44.248628 10031 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.014s	sys 0.013s
W20260709 13:15:44.248950 10024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.029s	sys 0.059s
I20260709 13:15:44.250756  9903 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.257678  9859 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:44.258613  9794 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.266469  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.405405  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:44.268203  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.406675  8913 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:44.406955  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:44.270893  9781 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.407608  9781 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.229596  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:44.276490  8918 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:44.282476  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.283738  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:44.241621  9909 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:44.270053 10034 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:44.272715  8837 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.010s	sys 0.014s
I20260709 13:15:44.316481  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:44.421198  8837 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.010s	sys 0.015s
I20260709 13:15:44.412534  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.231902  9957 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:44.273837  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 61946.8us
I20260709 13:15:44.392097  9826 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:44.314381  8768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.036s	sys 0.041s
W20260709 13:15:44.247710  9954 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.013s
W20260709 13:15:44.374392 10068 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:15:44.378073  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:44.408938  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:44.393426 10031 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.014s	sys 0.013s
I20260709 13:15:44.390426 10001 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:44.285112  9839 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.026s	sys 0.045s
I20260709 13:15:44.421818  8918 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:44.423863  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:44.450199  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.390246  9911 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:44.428366  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.454842  8916 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:44.420846 10034 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:15:44.445990  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.405246 10024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.030s	sys 0.059s
I20260709 13:15:44.408769  9859 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.437014  9781 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:44.448764  9839 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.026s	sys 0.045s
I20260709 13:15:44.408610  9794 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.417901  9934 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:44.393779  9865 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.426199  9909 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.436015  9826 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:44.498478  9979 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.000s
I20260709 13:15:44.499450 10015 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:44.489583  9911 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.512979 10015 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:44.529918 10088 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:44.569383 10082 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:15:44.571166 10074 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
I20260709 13:15:44.546711 10088 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:44.587499 10088 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:44.624516  8664 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.013s	sys 0.001s
W20260709 13:15:44.625456  8664 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.014s	sys 0.001s
W20260709 13:15:44.630693  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 473514us
W20260709 13:15:44.426954  8768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.036s	sys 0.041s
I20260709 13:15:44.651690  8768 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:44.293889  8762 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:15:44.655162  8764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.004s	sys 0.008s
W20260709 13:15:44.656065  8764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.004s	sys 0.008s
W20260709 13:15:44.658241  8769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.014s	sys 0.001s
W20260709 13:15:44.658808  8769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.014s	sys 0.001s
W20260709 13:15:44.660892  8808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.005s	sys 0.019s
I20260709 13:15:44.356616  8838 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:15:44.661502  8808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.005s	sys 0.020s
W20260709 13:15:44.665326  8835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.001s	sys 0.037s
W20260709 13:15:44.665892  8835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.001s	sys 0.037s
W20260709 13:15:44.667372  8836 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.008s	sys 0.017s
W20260709 13:15:44.667843  8836 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.008s	sys 0.017s
W20260709 13:15:44.673230  8841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.022s	sys 0.013s
W20260709 13:15:44.673938  8841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.022s	sys 0.013s
W20260709 13:15:44.675130  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:44.450551  8843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.050s	sys 0.057s
W20260709 13:15:44.678702  8843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.051s	sys 0.057s
W20260709 13:15:44.673254  8844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.006s	sys 0.022s
W20260709 13:15:44.679500  8844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.007s	sys 0.022s
W20260709 13:15:44.677182  8842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.002s	sys 0.012s
I20260709 13:15:44.680531  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:44.681452  8842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.002s	sys 0.012s
I20260709 13:15:44.446154  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.456269  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.839043  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.840011  9794 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:44.840420  8916 raft_consensus.cc:2410] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:44.457928  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.841470  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1186) took 1006 ms. Trace:
I20260709 13:15:44.841987  8918 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 13:15:44.429301  9954 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.005s	sys 0.013s
I20260709 13:15:44.680430  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 914) took 1377 ms. Trace:
W20260709 13:15:44.733927  9868 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.931s	user 0.038s	sys 0.047s
I20260709 13:15:44.750531 10001 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.774667  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:44.835664  9826 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:44.771565  8915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.010s	sys 0.003s
W20260709 13:15:44.757905 10017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.031s	sys 0.048s
I20260709 13:15:44.763999  9911 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:44.776165  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:44.773594  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 199) took 1071 ms. Trace:
I20260709 13:15:44.898044  9903 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:44.839825 10088 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.899178  9903 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:44.901065 10088 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:44.901360  9868 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.039s	sys 0.048s
I20260709 13:15:44.766237 10109 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:44.902586 10109 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.903465  9859 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:44.897035  8915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.010s	sys 0.003s
W20260709 13:15:44.897490 10017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.031s	sys 0.048s
I20260709 13:15:44.909153 10001 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.910982 10109 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:44.911548  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.509975  9979 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.758180 10089 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.218s
I20260709 13:15:44.912128 10001 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:44.970554  8763 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:44.841960  8842 rpcz_store.cc:276] 0709 13:15:43.835033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.835216 (+   183us) service_pool.cc:224] Handling call
0709 13:15:43.835661 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.836101 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.836141 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.843549 (+  7408us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.785286 (+941737us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:44.840955 (+ 55669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.841086 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.841161 (+    75us) raft_consensus.cc:1685] finished
0709 13:15:44.841176 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.841393 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1983,"raft.queue_time_us":568,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6083,"thread_start_us":802953,"threads_started":1,"wal-append.queue_time_us":699725}
W20260709 13:15:44.945976  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 540493us
I20260709 13:15:44.949033  9794 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:44.971495  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:44.982021  9794 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:44.982568  9794 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:44.982656  8760 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:44.975452  9839 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:44.976635  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:44.983964  9839 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:44.984725 10077 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.076s	user 0.002s	sys 0.000s
I20260709 13:15:44.971508  9781 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:44.945880  8910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.023s	sys 0.034s
W20260709 13:15:44.985634  8910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.025s	sys 0.034s
I20260709 13:15:44.985806  9781 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:44.987402  9909 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:44.987877  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:44.969430  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:44.988286 10006 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.113s	user 0.015s	sys 0.006s
I20260709 13:15:44.970767  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:44.982833 10075 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 1.076s	user 0.011s	sys 0.033s
W20260709 13:15:44.949079  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.022s	sys 0.019s
I20260709 13:15:44.972934  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:44.900313  9903 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:44.993789 10003 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.109s	user 0.015s	sys 0.002s
W20260709 13:15:44.964414  8914 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.792s	user 0.015s	sys 0.010s
I20260709 13:15:44.970043  9952 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:15:44.950519 10004 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.812s	user 0.014s	sys 0.010s
I20260709 13:15:45.049978  9952 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:44.973809 10015 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:44.957630  9890 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:44.950791 10024 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.011137  9979 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:45.011737 10032 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 1.094s	user 0.015s	sys 0.008s
I20260709 13:15:45.058017 10032 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:45.019774  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.024s	sys 0.020s
W20260709 13:15:44.982566 10012 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.010s
I20260709 13:15:45.065354 10012 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:44.949204  9999 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.194s	user 0.009s	sys 0.004s
I20260709 13:15:45.068686  9999 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.029188  8909 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.580s	user 0.006s	sys 0.019s
I20260709 13:15:45.071107  8909 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:45.029910  9781 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.029964  8768 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:15:45.031436 10002 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.114s	user 0.007s	sys 0.008s
I20260709 13:15:45.073122 10002 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.075873 10002 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:44.987423  9839 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.077217  8767 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:45.032215  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.032514  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:45.079488  8764 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:45.033519  9865 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.081084 10032 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.082492  9468 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:15:45.034277  8839 consensus_meta.cc:287] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.912s	user 0.017s	sys 0.002s
I20260709 13:15:45.084986  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:45.086282  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 920) took 1194 ms. Trace:
I20260709 13:15:45.087011  8839 rpcz_store.cc:276] 0709 13:15:43.892067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.918627 (+ 26560us) service_pool.cc:224] Handling call
0709 13:15:45.086054 (+1167427us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:45.035142  8840 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.903s	user 0.002s	sys 0.015s
I20260709 13:15:45.089166  8840 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:45.090051  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1184) took 1263 ms. Trace:
I20260709 13:15:45.090509  8840 rpcz_store.cc:276] 0709 13:15:43.826381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.829747 (+  3366us) service_pool.cc:224] Handling call
0709 13:15:45.089945 (+1260198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.035514  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.093497  8918 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:45.093780  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.036576  9903 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.037621  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:45.038345  8916 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:15:45.038887  9894 consensus_meta.cc:287] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.011s
I20260709 13:15:44.945901 10031 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.149s
I20260709 13:15:45.039701 10109 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:45.041016  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:44.898155  9463 rpcz_store.cc:276] 0709 13:15:43.701626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.702878 (+  1252us) service_pool.cc:224] Handling call
0709 13:15:43.703234 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.703809 (+   575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.703875 (+    66us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.704497 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.377125 (+672628us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:44.377178 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.377255 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.772757 (+395502us) raft_consensus.cc:1685] finished
0709 13:15:44.772800 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.773262 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1117,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":2286,"thread_start_us":659038,"threads_started":1,"wal-append.queue_time_us":857080}
W20260709 13:15:45.041772  8735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.009s	sys 0.041s
I20260709 13:15:45.042224 10003 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.043519  8809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.875s	user 0.007s	sys 0.030s
I20260709 13:15:45.044224  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 924) took 1150 ms. Trace:
I20260709 13:15:44.950958  9957 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.044726  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.046468  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 907) took 1193 ms. Trace:
I20260709 13:15:45.046150  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:44.887866  8843 rpcz_store.cc:276] 0709 13:15:43.303313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.514801 (+211488us) service_pool.cc:224] Handling call
0709 13:15:43.515056 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.515240 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:43.890191 (+374951us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.679682 (+789491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:44.679808 (+   126us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:44.679933 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:44.680050 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:44.680330 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342017,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":285337,"thread_start_us":1158892,"threads_started":2,"wal-append.queue_time_us":677403}
I20260709 13:15:45.047678  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.050491  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:45.168643  8809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.007s	sys 0.030s
I20260709 13:15:45.169263  9464 raft_consensus.cc:2410] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:45.171216  9462 raft_consensus.cc:2410] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:15:45.171717  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.023921  9794 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.049212  9956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.002s	sys 0.029s
I20260709 13:15:45.049079  8914 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:44.958137  9969 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:45.034351  8762 raft_consensus.cc:2368] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:45.050215 10004 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.164973  8844 rpcz_store.cc:276] 0709 13:15:43.893773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.070732 (+176959us) service_pool.cc:224] Handling call
0709 13:15:44.071104 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:44.071340 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:44.115054 (+ 43714us) log.cc:844] Serialized 14 byte log entry
0709 13:15:44.939198 (+824144us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.007040 (+ 67842us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:45.043847 (+ 36807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.043966 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.044164 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42830,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":294692,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":768815,"threads_started":2,"wal-append.queue_time_us":459989}
W20260709 13:15:45.172516  8735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.010s	sys 0.041s
I20260709 13:15:45.178791  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1183) took 1353 ms. Trace:
I20260709 13:15:45.222756  9467 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:45.285458  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 899) took 1145 ms. Trace:
I20260709 13:15:45.285195 10109 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.238147  8765 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:45.197068  9858 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.273393 10015 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:45.238065 10002 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:45.184291 10038 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:45.185096  9903 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.286136  8914 rpcz_store.cc:276] 0709 13:15:44.139561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.146262 (+  6701us) service_pool.cc:224] Handling call
0709 13:15:45.284838 (+1138576us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:45.287010  9956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.003s	sys 0.033s
I20260709 13:15:45.271966  9890 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.312232  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.030s	sys 0.021s
I20260709 13:15:45.196489 10104 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:15:45.319998  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.031s	sys 0.021s
W20260709 13:15:45.317241  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 271312us
I20260709 13:15:45.280181  8836 rpcz_store.cc:276] 0709 13:15:43.825161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.825332 (+   171us) service_pool.cc:224] Handling call
0709 13:15:43.825768 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.826026 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:44.668402 (+842376us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.028755 (+360353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.028851 (+    96us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:45.178401 (+149550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.178509 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.178736 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7159,"prepare.queue_time_us":45528,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":18861,"raft.run_cpu_time_us":347,"raft.run_wall_time_us":991,"spinlock_wait_cycles":1842944,"thread_start_us":1153490,"threads_started":2,"wal-append.queue_time_us":615952}
I20260709 13:15:45.312783  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.319017  9465 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.304891  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.315238  9781 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.324734  8842 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:45.167614  8769 rpcz_store.cc:276] 0709 13:15:43.853500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.853706 (+   206us) service_pool.cc:224] Handling call
0709 13:15:43.855465 (+  1759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.856675 (+  1210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.856705 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.857145 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:15:44.659558 (+802413us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:44.941764 (+282206us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.043747 (+101983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.046049 (+  2302us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.046136 (+    87us) raft_consensus.cc:1685] finished
0709 13:15:45.046153 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.046350 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":854,"prepare.queue_time_us":376107,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":67,"raft.queue_time_us":21858,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":7468,"thread_start_us":1064120,"threads_started":2,"wal-append.queue_time_us":697092}
I20260709 13:15:45.307322 10012 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.196275  9934 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:45.179028  9894 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.272987 10024 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.334425  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 96564.7us
I20260709 13:15:45.327306  9969 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.337061  9954 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:45.337966  9954 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.339263  9969 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.332577  9781 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.311072 10032 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:45.271631  9952 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.314811  9979 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.346335  8844 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:45.344652  8838 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:45.351616  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.322058  9858 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.353986  9934 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.354842  9979 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.356179  9858 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.353763  8766 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:45.357295  8915 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:45.351805  8836 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.361168  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:45.361632  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 883) took 1141 ms. Trace:
I20260709 13:15:45.360562 10088 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:45.362058  8767 rpcz_store.cc:276] 0709 13:15:44.220473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.220613 (+   140us) service_pool.cc:224] Handling call
0709 13:15:44.775542 (+554929us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b5800002d98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:15:45.361379 (+585837us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400378054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:45.361524 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415749632}
I20260709 13:15:45.345316  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 59) took 1632 ms. Trace:
I20260709 13:15:45.332674  9462 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 1.
I20260709 13:15:45.347951  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 935) took 1019 ms. Trace:
I20260709 13:15:45.366994  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1182) took 1012 ms. Trace:
I20260709 13:15:45.357453  9839 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.357259  9979 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.347084  9903 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.407016  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 934) took 1196 ms. Trace:
I20260709 13:15:45.407523  8838 rpcz_store.cc:276] 0709 13:15:44.210597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.766924 (+556327us) service_pool.cc:224] Handling call
0709 13:15:44.767600 (+   676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.362983 (+595383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.406708 (+ 43725us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54002f21d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:45.406949 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1026420608}
I20260709 13:15:45.376329  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1176) took 1037 ms. Trace:
I20260709 13:15:45.356201  9934 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.408775  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 903) took 1267 ms. Trace:
I20260709 13:15:45.353837  9893 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.413664  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 930) took 1514 ms. Trace:
I20260709 13:15:45.383690  9794 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:45.376199  8839 rpcz_store.cc:276] 0709 13:15:44.325984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.088449 (+762465us) service_pool.cc:224] Handling call
0709 13:15:45.167213 (+ 78764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.314972 (+147759us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.318383 (+  3411us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.321898 (+  3515us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:45.327985 (+  6087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.332757 (+  4772us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.345420 (+ 12663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.387912 10004 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.387740  8913 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260709 13:15:45.376667  9902 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.989s	user 0.010s	sys 0.009s
I20260709 13:15:45.419278  8913 pending_rounds.cc:85] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:45.419680  9902 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3.
W20260709 13:15:45.405743 10083 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.059s	user 0.000s	sys 0.003s
I20260709 13:15:45.395153  9839 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.421037  8912 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:45.421396  9839 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:45.419656  8913 pending_rounds.cc:107] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:15:45.406318  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.386706  9461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 197) took 1970 ms. Trace:
I20260709 13:15:45.414939 10127 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.375711  8915 rpcz_store.cc:276] 0709 13:15:44.352189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.356542 (+1004353us) service_pool.cc:224] Handling call
0709 13:15:45.356962 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.363543 (+  6581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.364323 (+   780us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.416975  8837 rpcz_store.cc:276] 0709 13:15:43.898787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.666832 (+768045us) service_pool.cc:224] Handling call
0709 13:15:44.667418 (+   586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.668090 (+   672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.668120 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.735974 (+ 67854us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.290510 (+554536us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:45.290548 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.290614 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.413232 (+122618us) raft_consensus.cc:1685] finished
0709 13:15:45.413251 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.413427 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":242160,"spinlock_wait_cycles":154500352,"thread_start_us":412471,"threads_started":1,"wal-append.queue_time_us":534063}
I20260709 13:15:45.406437  9890 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.419762  8909 rpcz_store.cc:276] 0709 13:15:44.337139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.289131 (+951992us) service_pool.cc:224] Handling call
0709 13:15:45.347815 (+ 58684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.374339 (+ 26524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.374368 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.374418 (+    50us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:45.374447 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.374516 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.374688 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.422089  8913 raft_consensus.cc:2889] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:45.409528  9970 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:15:45.376837  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.430895  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 933) took 1225 ms. Trace:
I20260709 13:15:45.363914  9999 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.430068 10003 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.418504 10034 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:45.435379  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47214.2us
I20260709 13:15:45.357576 10002 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.411075  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:45.437779  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 757745us
I20260709 13:15:45.365746 10088 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:45.433287  9903 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:45.442412 10119 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:15:45.439795  9970 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.443250  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.444235  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.444983 10117 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:45.406912  9858 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.448166  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:45.385778  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1170) took 1114 ms. Trace:
I20260709 13:15:45.364358 10032 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.383821  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:45.451548  9956 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.452904 10012 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.453256  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 882) took 1235 ms. Trace:
I20260709 13:15:45.456629 10024 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.459437  9894 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.434674  8841 rpcz_store.cc:276] 0709 13:15:44.205165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.675787 (+470622us) service_pool.cc:224] Handling call
0709 13:15:44.676356 (+   569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.892509 (+216153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.892825 (+   316us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.994091 (+101266us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.327140 (+333049us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:45.327195 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.327281 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.429254 (+101973us) raft_consensus.cc:1685] finished
0709 13:15:45.429271 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.430757 (+  1486us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":294107,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":131,"thread_start_us":532028,"threads_started":2,"wal-append.queue_time_us":403616}
I20260709 13:15:45.459995 10121 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.466075 10002 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.467357  9432 leader_election.cc:400] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:45.495157  9432 leader_election.cc:403] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:45.467741 10125 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.416316  8910 rpcz_store.cc:276] 0709 13:15:44.141627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.142190 (+   563us) service_pool.cc:224] Handling call
0709 13:15:44.142569 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.154634 (+ 12065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.154681 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.155326 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.028450 (+873124us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:45.028530 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.028664 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.388986 (+360322us) raft_consensus.cc:1685] finished
0709 13:15:45.389006 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.408714 (+ 19708us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11676,"raft.queue_time_us":11730,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6435,"thread_start_us":834280,"threads_started":1,"wal-append.queue_time_us":1100906}
I20260709 13:15:45.468658  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.468604  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:45.423187 10127 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.350282 10104 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.467440 10106 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.478492  9781 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:45.499871  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 63903.2us
I20260709 13:15:45.484181  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:45.489987  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 79207.6us
I20260709 13:15:45.486408  8766 rpcz_store.cc:276] 0709 13:15:44.217819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.217955 (+   136us) service_pool.cc:224] Handling call
0709 13:15:44.218416 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.357333 (+1138917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.452976 (+ 95643us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001a7f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:45.453178 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2604652928}
I20260709 13:15:45.498081  8768 raft_consensus.cc:2368] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:45.500109  9781 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:45.501133  9781 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.501478  9781 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.482597  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1189) took 1031 ms. Trace:
I20260709 13:15:45.501938  8913 rpcz_store.cc:276] 0709 13:15:44.451369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.386650 (+935281us) service_pool.cc:224] Handling call
0709 13:15:45.387167 (+   517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.482347 (+ 95180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.482542 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:45.490927  9459 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:45.512135  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 151176us
I20260709 13:15:45.497588 10109 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.513082 10018 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.511746  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.534778  8839 raft_consensus.cc:2410] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:45.535362  9999 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.536070  9999 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.505734 10121 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.538756  9999 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.509110  9969 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.541618  9969 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.542157 10127 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.544322  9969 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.366503  8835 rpcz_store.cc:276] 0709 13:15:43.713411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.714334 (+   923us) service_pool.cc:224] Handling call
0709 13:15:43.722053 (+  7719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:43.722355 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:44.666525 (+944170us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.286995 (+620470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.310781 (+ 23786us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:45.319562 (+  8781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.323184 (+  3622us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.343247 (+ 20063us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18956,"prepare.queue_time_us":149009,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":95986,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":143,"thread_start_us":1495566,"threads_started":3,"wal-append.queue_time_us":343700}
I20260709 13:15:45.546011 10105 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:45.547022 10105 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:45.547490 10105 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:45.549738  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:45.553355  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.553715  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 877) took 1354 ms. Trace:
I20260709 13:15:45.513545  9952 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.540335  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.548602  9970 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.531317 10004 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:45.516105  9954 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.550812  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.551028  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.519140  9956 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.528183  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:45.552392  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.551736  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.539994  9894 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.539251 10121 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.540488  9958 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.513208 10034 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:45.554369  8914 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:45.567791  8910 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:45.571516  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:45.529906  9903 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:45.517535 10012 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.422703  9461 rpcz_store.cc:276] 0709 13:15:43.416572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.417991 (+  1419us) service_pool.cc:224] Handling call
0709 13:15:43.433167 (+ 15176us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:43.433730 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:43.433793 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:43.665215 (+231422us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b2c00047778. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:15:43.665772 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 13:15:43.906125 (+240353us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:43.906192 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:43.906286 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:44.981679 (+1075393us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:45.386257 (+404578us) raft_consensus.cc:1685] finished
0709 13:15:45.386276 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.386507 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":598,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":186,"spinlock_wait_cycles":103768704,"thread_start_us":239908,"threads_started":1,"wal-append.queue_time_us":240322}
I20260709 13:15:45.526966  9858 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.517325 10106 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.562978 10004 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.561394 10002 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:45.553351  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:45.513510 10125 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.594522  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 112547us
I20260709 13:15:45.554208  8765 rpcz_store.cc:276] 0709 13:15:44.199560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.200430 (+   870us) service_pool.cc:224] Handling call
0709 13:15:45.553468 (+1353038us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b540034f8d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:45.553636 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1696440192}
I20260709 13:15:45.596961  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:45.598343  8913 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:45.548496 10105 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.576373  9903 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:45.574717 10088 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.574347  8838 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.595885 10004 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:45.621245  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 54934us
I20260709 13:15:45.571280  9999 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.643128  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.645651  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:45.645186  8837 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:45.595518 10104 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.651826  9979 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.599912  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 99) took 1206 ms. Trace:
I20260709 13:15:45.619624  9903 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.614486  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:45.649894  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.653357  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:45.600674  9894 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.615164  9956 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.600765  9954 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:45.647821  9898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.468s	user 0.005s	sys 0.026s
I20260709 13:15:45.617792 10002 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:45.659811  8843 raft_consensus.cc:2410] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:15:45.482517  8911 rpcz_store.cc:276] 0709 13:15:44.271430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.272515 (+  1085us) service_pool.cc:224] Handling call
0709 13:15:44.281961 (+  9446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:44.359778 (+ 77817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:44.360691 (+   913us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:44.408958 (+ 48267us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.180920 (+771962us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:45.181020 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.181130 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.385295 (+204165us) raft_consensus.cc:1685] finished
0709 13:15:45.385338 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.385571 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186,"raft.queue_time_us":14779,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4243,"thread_start_us":278701,"threads_started":1,"wal-append.queue_time_us":882512}
I20260709 13:15:45.592224  9958 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.602764  9934 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:45.656502  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:45.687700  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:45.667332  9956 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.688720  9956 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.690425 10135 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.691227  9956 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.691138 10135 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.692354 10105 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.677386  9979 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.667522  8835 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:45.668038  9999 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:45.669915  9898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.005s	sys 0.027s
W20260709 13:15:45.718729  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.658736  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 936) took 1279 ms. Trace:
W20260709 13:15:45.708045  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155307us
I20260709 13:15:45.744449  9956 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.743500  9979 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.678882 10032 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.748495  9781 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.770633  8768 raft_consensus.cc:2368] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
W20260709 13:15:45.739555  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 81501.3us
I20260709 13:15:45.745800 10135 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:45.658864 10118 consensus_queue.cc:1175] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:15:45.744226  9894 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.744762  9954 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.657398  9970 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:45.764292  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 209868us
I20260709 13:15:45.765640  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:45.696451 10106 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.741627  9934 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.860394  9781 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.896183  9432 leader_election.cc:400] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
W20260709 13:15:45.839861  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45723.5us
I20260709 13:15:45.910799  9432 leader_election.cc:403] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:45.860149  8843 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:15:45.768718  9858 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.821303  9958 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:45.865917  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.816983  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:45.913281  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:45.816484  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.920197  8844 raft_consensus.cc:2368] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:45.913888  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:45.871469  9465 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.006s
W20260709 13:15:45.923213  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 82090.5us
I20260709 13:15:45.819248  9956 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.929363  8836 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:45.821067 10123 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:45.875744 10012 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.885914  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:45.878852  9826 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:45.893090  9957 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.938179  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.897298 10095 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:45.940440  8842 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:45.926420 10018 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:45.943260 10140 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:45.946480  9839 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.004s
I20260709 13:15:45.927546 10125 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.927646  9858 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.951327  9979 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:45.969926  9979 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.951769  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.952363 10032 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:45.952823  9999 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.954104  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.933967 10106 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:45.935812 10017 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:45.939429  9461 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:45.965198  9858 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.965729  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.967784  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.885371 10002 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.974001  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:45.976387  8844 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:45.977475  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:45.934172  9970 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.003778  9970 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.976804  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:45.950332 10123 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:45.983667  9465 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:15:45.981329 10140 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:45.991387  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.995322  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.975142  9979 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.982335  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:45.964217  9839 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.980665  8839 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:45.963804  9826 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.021569  9826 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:46.021745  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.023826 10140 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:45.993995  9434 leader_election.cc:400] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:45.994971  9459 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:45.994201  9462 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:46.009675  9465 pending_rounds.cc:85] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 4
I20260709 13:15:46.006693  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:46.031105  9467 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:46.006115  9466 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:45.977689  9957 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:45.990454 10032 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.036747  8836 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:46.014099 10105 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.017486  9970 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.054711  9957 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:46.055344  8912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1172) took 1774 ms (client timeout 2289 ms). Trace:
I20260709 13:15:46.056236  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.074005  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:46.074338  8765 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
W20260709 13:15:46.042878  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 70481.8us
I20260709 13:15:46.050379  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:46.075300  8767 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:15:46.073782  8912 rpcz_store.cc:269] 0709 13:15:44.281899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.282208 (+   309us) service_pool.cc:224] Handling call
0709 13:15:46.055018 (+1772810us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b540041ffd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:46.055255 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296061184}
I20260709 13:15:46.076465  9434 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.076908  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:46.077927  8761 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.079288  9952 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.079687  9952 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:46.080044  9952 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.081284  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.081507  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.082068  8839 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:46.082501  8766 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:46.083184  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.033283 10143 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:46.011149  9463 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:46.076644  9894 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:46.000270 10017 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.041107  9465 pending_rounds.cc:107] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:15:46.010313 10106 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.091853  9858 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.092939  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.101413  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:46.102447  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 154143us
I20260709 13:15:46.107699  8766 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.112164  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.104189  9465 raft_consensus.cc:2889] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:46.096510  9934 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.121165  8842 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:46.123749  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:46.126291  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129299us
I20260709 13:15:45.998889 10095 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.125356  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:46.118050 10024 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:46.114444  9894 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:46.095140 10105 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.136175  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.146557  8769 raft_consensus.cc:2368] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:46.108654  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:15:46.108160  9903 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.132172  9957 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.139982  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.140259 10038 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:46.140594  9898 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:46.109238  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:46.141279  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.142825  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:46.120297  9826 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:46.142241  8767 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:46.124523 10032 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.154054  9956 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.149566  9957 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.170756  9957 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:46.172260  8838 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.529s	user 0.001s	sys 0.011s
I20260709 13:15:46.173134  8838 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:46.174528  9954 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.168448  9463 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:46.175756  9999 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.176256  9999 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.176510  9894 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.155129  8839 raft_consensus.cc:606] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:46.146214 10089 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.134119 10024 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:46.184024 10112 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 1.218s	user 0.007s	sys 0.000s
W20260709 13:15:46.184981  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.185096 10089 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.182024  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.186597  8841 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:46.156555  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.158664  9898 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:46.189247 10034 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:15:46.189587  9898 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:45.741150  8840 rpcz_store.cc:276] 0709 13:15:44.379284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:45.091635 (+712351us) service_pool.cc:224] Handling call
0709 13:15:45.092352 (+   717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:45.282449 (+190097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:45.282508 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:45.326822 (+ 44314us) log.cc:844] Serialized 26 byte log entry
0709 13:15:45.518902 (+192080us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:45.599002 (+ 80100us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.623695 (+ 24693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.645486 (+ 21791us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:45.648463 (+  2977us) raft_consensus.cc:1685] finished
0709 13:15:45.650929 (+  2466us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.657110 (+  6181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8247,"prepare.queue_time_us":86241,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":238089,"raft.run_cpu_time_us":485,"raft.run_wall_time_us":24283,"thread_start_us":124810,"threads_started":2,"wal-append.queue_time_us":171576}
I20260709 13:15:46.190043  9464 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:46.190254  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1192) took 1514 ms. Trace:
I20260709 13:15:46.157069  9979 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.175189 10125 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.193424  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.193710  9979 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.193468 10024 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.195034  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.155829  9839 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.060938 10123 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:46.196255 10136 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.552s	user 0.003s	sys 0.000s
I20260709 13:15:46.196362  9979 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.184552  9999 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.190672  8916 rpcz_store.cc:276] 0709 13:15:44.675782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.189277 (+1513495us) service_pool.cc:224] Handling call
0709 13:15:46.189646 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:46.189919 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:46.189946 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:46.190005 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:46.190032 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.190088 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:46.190183 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:46.193424  9958 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:46.194083 10125 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.185655  8839 raft_consensus.cc:614] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:46.193398  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 64879.1us
I20260709 13:15:46.205348  9839 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:46.218927  9839 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.193778  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.221180  9970 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:46.221705  8838 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:46.179944 10095 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.167162  8766 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
W20260709 13:15:46.206365  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71004.9us
I20260709 13:15:46.205446  9826 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:46.182489 10015 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.859s	user 0.012s	sys 0.002s
W20260709 13:15:46.177294  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82435.8us
W20260709 13:15:46.212127 10131 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.520s	user 0.003s	sys 0.000s
I20260709 13:15:46.177546 10032 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:46.257891  8840 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:15:46.260490 10032 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:46.261252 10032 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.262581  9952 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.265755  9952 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.266548  9468 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:15:46.267928  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49632.3us
I20260709 13:15:46.216003 10017 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.217176  9465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54286 (request call id 259) took 2433 ms. Trace:
W20260709 13:15:46.246724 10145 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:15:46.181404 10105 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.299465  8835 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:46.302178 10117 raft_consensus.cc:1064] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:46.272619  9957 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.324059 10024 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.330472  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:46.244253  9958 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:46.196918 10038 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.344674  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:46.348807  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52332.8us
I20260709 13:15:46.346817  9825 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.353396  9825 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.353900  9825 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.354084  9898 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.354506  9898 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:46.354915  9898 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.293697  9465 rpcz_store.cc:276] 0709 13:15:43.758822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.761153 (+  2331us) service_pool.cc:224] Handling call
0709 13:15:43.769165 (+  8012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.271143 (+1501978us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b580037cdd0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fcf60aa 00007fce6fd78447 00007fce6fd90fe7 00007fce6fd927de 00007fce6fd9cb49 00007fce6fd9d416 00007fce6fd99d8f 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4
0709 13:15:46.142617 (+871474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:46.169190 (+ 26573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111390080}
I20260709 13:15:46.332890 10151 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.351855 10105 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.389808 10105 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.394531  9898 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.395150  9999 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.395838  9999 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.398594  9954 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:46.405815  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55536.2us
W20260709 13:15:46.425119 10133 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.757s	user 0.000s	sys 0.004s
I20260709 13:15:46.333376  8761 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:45.656416  9460 rpcz_store.cc:276] 0709 13:15:44.389880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.391772 (+  1892us) service_pool.cc:224] Handling call
0709 13:15:45.197864 (+806092us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:15:45.198337 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:45.198948 (+   611us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:15:45.481729 (+282781us) log.cc:844] Serialized 14 byte log entry
0709 13:15:45.563529 (+ 81800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:45.568326 (+  4797us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:45.570613 (+  2287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:45.594198 (+ 23585us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:45.596322 (+  2124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":314981,"prepare.run_cpu_time_us":108,"prepare.run_wall_time_us":11386,"raft.queue_time_us":90693,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":25645,"spinlock_wait_cycles":11307520,"thread_start_us":293000,"threads_started":2,"wal-append.queue_time_us":71785}
I20260709 13:15:46.441952 10017 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.425840  9970 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:15:46.666241  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.667167 10139 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:15:46.656409  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.669849 10139 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.667614  9898 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.616124  9826 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:46.477577  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:46.438180  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.668670  9957 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:46.560462  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 90212.9us
W20260709 13:15:46.518275 10138 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.824s	user 0.003s	sys 0.000s
W20260709 13:15:46.677474  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 333972us
I20260709 13:15:46.668669  9958 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:46.669911 10004 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.015s	user 0.011s	sys 0.026s
I20260709 13:15:46.672422 10139 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.682790  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.469787 10002 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.683501  8769 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:46.690799  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.469527  9979 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.440349  9461 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:46.533198  9825 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.676232  9839 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.572122  9903 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.680727 10006 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.696202  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:46.699312  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.685438  9970 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:46.700347  9467 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:46.442643 10151 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.486102 10017 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.695770  8835 raft_consensus.cc:2368] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:46.701942  9970 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:46.698973 10006 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.713014 10105 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.712832  9970 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.696395  9979 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.713690 10006 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.714337  9970 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.715217  9979 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.715330  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:46.713347 10089 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:46.719244 10151 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.681887 10004 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.702956 10088 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.724905  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:46.729794  9903 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:46.730180  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.731053 10032 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.729780  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:46.584543 10117 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.743060  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.733422  9467 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.730389  9903 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:46.708957 10038 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.735448  8768 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:46.725595  8838 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:46.737171  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:46.737664 10147 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:15:46.721845  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:46.738299  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.738888 10004 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.738747 10155 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:46.733820 10148 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:46.739652  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.739867  9898 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:46.740888  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.741025  8843 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.740903  9999 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.741586  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:46.742321  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.745848  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.747332  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.786556  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:46.787124  8762 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:46.787263  9464 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.788278  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.747803 10017 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.783106  8837 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:46.778759  8840 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.789992  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.791395  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.791822  9898 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:46.752905  9903 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:46.792341  9898 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:46.793434  9898 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.794857  9898 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:46.753311  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.754433  9825 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.755744 10125 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.757031  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.757189 10024 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.796838  8840 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:46.797227  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:46.799824  8766 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.798623  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.800634  8764 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:46.695534 10002 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.746789  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.759912 10032 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:46.761276  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:46.761376  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.808748  8841 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:46.762348  9434 leader_election.cc:400] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:46.762841  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.765007 10003 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.765928  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.769889  9467 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:46.770660  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.770607  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.779065  9432 leader_election.cc:400] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:46.813264  9432 leader_election.cc:403] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:46.769948 10006 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.779521  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.775669  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.784052  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.784704  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:46.784854  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.825088  8767 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:46.811561  8760 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:46.785802  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:46.826184  8841 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:46.791975  8837 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:46.797179  8842 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:46.806897  8843 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:46.810343  8844 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:46.810708  9434 leader_election.cc:403] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:46.826213  8768 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
W20260709 13:15:46.822851  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54493.8us
W20260709 13:15:46.823493  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 56828.1us
I20260709 13:15:46.811138  8762 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:46.821087  8766 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
W20260709 13:15:46.822755  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43872us
I20260709 13:15:46.834146  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.835777  9464 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:46.839474 10151 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.840058 10151 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.842248 10151 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.843323  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.844259  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.847103  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.845105 10017 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:46.849144  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:46.826622 10024 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.828681 10139 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.855475  8808 leader_election.cc:400] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:46.855813  8808 leader_election.cc:403] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:15:46.856424  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:46.856370  9999 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.857029  9999 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.857424  9999 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.826738 10089 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:46.850841 10125 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:46.866827  8838 raft_consensus.cc:2368] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4.
I20260709 13:15:46.867494 10017 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:46.867381  9839 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.871260  9839 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.849319  8839 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:46.832773  8835 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:46.869200 10153 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.869249  9979 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:46.870625 10002 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.829099 10003 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.854954 10032 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:46.911149  9839 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:46.861050 10139 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.862913 10004 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:46.855353  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 93193.1us
I20260709 13:15:46.865464 10105 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.918265 10004 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.919014 10105 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.863133 10104 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:46.907517 10151 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:46.913820 10153 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:46.922653 10151 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:46.923079 10151 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.923723 10153 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.906433 10125 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:46.925107 10125 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.926338 10004 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.870801 10017 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.910821 10003 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:46.860606 10024 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:46.912885  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.915457  8763 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:46.916587 10139 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:46.930168  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:46.928164 10024 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:46.908012 10015 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:46.868515  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.894054  9954 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:15:46.930580 10106 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:46.939679  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71327.4us
W20260709 13:15:46.985528  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 117532us
I20260709 13:15:46.988408  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.996712  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.930912  9903 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.945063 10003 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:46.997623  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:46.998253  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:47.000048  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 265273us
W20260709 13:15:46.998543  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 467039us
W20260709 13:15:47.002261  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 229949us
W20260709 13:15:47.006914  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.007728  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.004349  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:46.938129 10015 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:46.989146 10105 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:47.018572  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 303305us
W20260709 13:15:47.013566  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 273381us
I20260709 13:15:46.994836  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:47.001742 10002 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.033100  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:47.033787  9467 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:47.001456  9893 raft_consensus.cc:1027] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: attempt to promote peer 3b34c95a175945b88b17f07fbc650abf: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:15:47.003575 10125 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:47.035367  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.036847  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:47.001163 10003 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:47.012768 10032 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.030007 10153 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:15:47.084657  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.104018  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 99699.5us
I20260709 13:15:47.021709 10006 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:47.122385  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 87085.2us
W20260709 13:15:47.098922 10159 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:15:47.091809  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 93591.5us
I20260709 13:15:47.122992  8884 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:47.037729 10002 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.033640  9957 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.075433 10125 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:47.109413 10153 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:47.169804  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:47.175591  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 64348.5us
I20260709 13:15:47.110128  9463 raft_consensus.cc:2410] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:15:47.074368 10106 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.108518 10003 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.185242  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:47.188195  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 61478.8us
W20260709 13:15:47.188232  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 252007us
I20260709 13:15:47.126816  9954 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:47.076191  9958 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 13:15:47.095788  9970 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:15:47.127594  9894 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:47.175518  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53155.5us
W20260709 13:15:47.180693  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 54354.9us
I20260709 13:15:47.194195  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.274812  9467 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.197057  9957 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.257408 10123 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.184690 10006 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:47.184784  9464 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:15:47.256769  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0541270439998698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2258s for a response
W20260709 13:15:47.271358  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 86964.1us
I20260709 13:15:47.109273 10032 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:47.283509 10185 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:15:47.283679 10139 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.284533 10032 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.285198  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.285815  9462 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.286293  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.267383  9825 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:47.269030 10155 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:47.280478  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0468915040000866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22890000000000002s for a response
W20260709 13:15:47.281131 10161 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:15:47.280506 10180 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.297118 10180 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.296916 10153 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.297578 10180 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.297838  9826 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:47.298266  9826 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.299635 10038 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:47.300055 10038 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.301263  9958 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:47.302276  9957 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.281661 10006 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.280478  9461 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:47.189738 10002 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.237666 10106 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.287865  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.196669 10162 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 13:15:47.270916  9954 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:47.290828 10104 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:47.289238 10178 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.300951 10038 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.301947  9958 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:47.281467  9903 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.277710  8734 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:15:47.313017  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.280105 10123 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.317360  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:47.316270  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 193363us
I20260709 13:15:47.277019 10175 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:15:47.323076 10183 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.334954 10123 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.322914 10178 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.343951  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.328717  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.353790  9467 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:47.314404 10125 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.329643  9999 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.357482  9893 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:15:47.389254  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45401.3us
I20260709 13:15:47.358273 10038 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:47.412581 10088 consensus_meta.cc:287] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.003s
I20260709 13:15:47.358966 10006 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.359253 10104 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.345091 10178 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.360293 10183 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.361747  8761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:15:47.362675  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.363890  9958 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:47.364109  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.364588  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:47.365406  9898 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.002s
I20260709 13:15:47.360620  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:47.387871  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.390836 10179 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.392318  9999 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.394052  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:47.397629 10182 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:15:47.399302 10151 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.401234 10106 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.402127  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.329275  9954 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.402714  9839 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.403301 10191 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.358855  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.432024  9826 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.415093 10139 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.449237 10015 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.442239  9894 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:47.453212  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:47.465997 10024 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.006s
I20260709 13:15:47.413834  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.414507 10155 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.447407  9459 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:47.471855  9462 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:47.474115  8667 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.476490 10123 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.478349  8664 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 177) took 4695 ms. Trace:
I20260709 13:15:47.428443 10180 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.435775 10002 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:47.481220  8732 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.905s (SENT)
W20260709 13:15:47.486269  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 98496.6us
I20260709 13:15:47.533727  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:47.486871 10179 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:47.535645 10179 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.487339  8838 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:47.484849  8769 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:47.489670  8762 raft_consensus.cc:2368] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4.
I20260709 13:15:47.489722  8761 raft_consensus.cc:606] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:47.491614 10151 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:47.544004  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.494436 10191 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:47.492259  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90211.8us
I20260709 13:15:47.494769  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:47.495965  9894 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.517599  9898 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.481446 10104 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:47.542047 10193 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:47.546073  9898 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.522231  9958 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:47.495105  9826 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.545859  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.525838  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.547885 10151 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:47.548062  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.548310 10151 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.548712 10151 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.548797  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.548990  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:47.520702  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.547111  9958 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.546685  9898 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.550575  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.550635  9958 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.551496  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.551998  9958 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.544703 10191 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:47.546200 10104 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.553637  9894 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.558095  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:47.558811  9464 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
W20260709 13:15:47.517700  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 103962us
I20260709 13:15:47.559834  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.560642  9466 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:47.526837 10178 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.561348 10151 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.561792  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.516959 10024 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.563037 10178 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.563472 10151 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.529033  8664 rpcz_store.cc:276] 0709 13:15:42.782714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:42.782849 (+   135us) service_pool.cc:224] Handling call
0709 13:15:47.478221 (+4695372us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:44.564244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:44.564933 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:44.564994 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:15:44.565013 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:44.585162 (+ 20149us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:44.585249 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:44.585293 (+    44us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:15:44.586059 (+   766us) tablet.cc:701] Row locks acquired
0709 13:15:44.586084 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:15:44.586302 (+   218us) write_op.cc:270] Start()
0709 13:15:44.586443 (+   141us) write_op.cc:276] Timestamp: P: 1783602944586211 usec, L: 0
0709 13:15:44.586465 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:44.590259 (+  3794us) log.cc:844] Serialized 2834 byte log entry
0709 13:15:46.182674 (+1592415us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:46.711323 (+528649us) op_driver.cc:464] REPLICATION: finished
0709 13:15:46.763951 (+ 52628us) spinlock_profiling.cc:243] Waited 9.1 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6cc900ac 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce737d0ef0
0709 13:15:47.335187 (+571236us) write_op.cc:301] APPLY: starting
0709 13:15:47.335323 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:47.335637 (+   314us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:47.335692 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:47.356305 (+ 20613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:47.356682 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:15:47.356740 (+    58us) write_op.cc:312] APPLY: finished
0709 13:15:47.357183 (+   443us) log.cc:844] Serialized 58 byte log entry
0709 13:15:47.357366 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.357545 (+   179us) write_op.cc:454] Released schema lock
0709 13:15:47.357607 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:47.358025 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:47.358052 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4369,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":621289,"apply.run_cpu_time_us":3484,"apply.run_wall_time_us":22859,"num_ops":7,"prepare.queue_time_us":672651,"prepare.run_cpu_time_us":17113,"prepare.run_wall_time_us":412390,"raft.queue_time_us":493466,"raft.run_cpu_time_us":47479,"raft.run_wall_time_us":289542,"replication_time_us":2124671,"spinlock_wait_cycles":50772608,"thread_start_us":1791818,"threads_started":4,"wal-append.queue_time_us":375029}]]}
I20260709 13:15:47.530589 10180 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.532392 10123 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.560444  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:47.569584 10123 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:47.569789  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.481262  9468 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:15:47.482369  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 359847us
I20260709 13:15:47.528057  8667 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:47.494134  9839 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.487033 10006 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:47.532169 10002 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:47.532891  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 215605us
I20260709 13:15:47.572996 10089 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:47.573930  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.573444  8667 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.483673 10183 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.574755 10183 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.574918  8735 leader_election.cc:400] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4.
I20260709 13:15:47.575162 10183 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.575558 10183 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.575513  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.577056 10180 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.577193 10106 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.577629  9839 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.577661 10187 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:47.577855 10123 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.578366  9839 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.578545 10187 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.578761 10196 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.579216 10196 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.579089 10123 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.579660 10196 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.579594 10187 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.577672 10106 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.577535 10180 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.573473 10089 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.581040  9903 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.581243 10180 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.581497  9903 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:47.581909  9903 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.584157 10089 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.578503 10197 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.586079 10197 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.586462  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.586452 10197 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.587337 10038 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:47.588410 10038 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:47.588763 10038 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:47.589169 10038 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.589509 10162 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:47.589892 10162 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.581089 10106 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:47.590764 10162 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.591995 10162 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.598197  8762 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:47.598855  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.599262  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:47.599424  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:47.600732 10194 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:47.600615 10038 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.586453  9839 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.526445 10003 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:47.609124  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47426.5us
I20260709 13:15:47.609526  9839 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.610000 10006 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:47.610213  9999 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.610314 10003 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.610628  9999 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:47.611064  9999 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.610972 10006 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.604106 10024 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.609112 10095 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:47.616031 10095 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:47.617044  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:47.619127  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 66513.7us
I20260709 13:15:47.619870  9999 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.621963  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.623093  9894 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.624459  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.625247  9468 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:47.625432  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65086.7us
I20260709 13:15:47.626286  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:47.627727 10106 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.624632 10089 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:47.629091 10155 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:47.617081 10095 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.629247 10089 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:47.630057 10155 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:47.631176 10155 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.630283 10089 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:47.535079  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53907.2us
W20260709 13:15:47.639982  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 365217us
I20260709 13:15:47.614578  9903 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.642930  9468 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:47.650328  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.651614 10024 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:47.652390 10024 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:47.653470 10024 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.655735  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:47.656473  8840 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:47.660966  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.662657  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:47.663589  8835 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:47.664011 10180 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.643496 10038 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.643694  9999 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.666468  8764 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:47.667701  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:47.667930 10183 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.668442 10180 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.685729  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:47.686582  8840 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:47.687821  8839 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:47.692895  9903 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:47.693910  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.694301 10106 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:47.695623  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.695223 10197 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.696271  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:47.696473  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:47.697659 10088 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:47.696239  9894 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.698091 10088 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:47.608554 10196 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.698004 10197 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.698647 10088 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:47.700317 10196 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:47.701342  8838 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:47.656912 10191 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.715660  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.716260  8840 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:47.716464  9898 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.717742  8762 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:47.723178  8763 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:47.728327  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.729393  8767 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:47.732627  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:47.733775  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:47.731534  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.736502  8836 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:47.736650  9467 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:47.736937  8842 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:47.737399  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:47.737556  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.707167 10104 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:47.736892  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:47.737994  9462 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.704296 10191 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:47.685217 10089 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.760355  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.761205  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.758322  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.763829  8769 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:47.708935 10175 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:15:47.799644  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:47.738227  8760 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:47.756942  9898 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:47.714112 10179 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.804451  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.807276  8769 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:47.807858  8917 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:47.808101  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.808748  8769 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:47.800724  8766 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:47.805472  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:47.812101  8916 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:47.759431  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:47.803081  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:47.820115  8913 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:47.823083  9467 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:47.797693  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:47.818687  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:47.757017 10006 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:15:47.844043 10088 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:47.803561 10183 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:47.883814  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:47.858913  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.064098  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.061005  9467 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:47.889590  8767 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
W20260709 13:15:47.952339  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.064275  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.071774  8769 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:48.064983  8912 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:47.995785  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:48.034054  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.078749  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.081317  8913 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:47.847169 10205 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:15:48.086319  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 90614.9us
I20260709 13:15:48.082319  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.083981  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.088585  8909 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:48.043352  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.084092  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:48.089725  8917 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:48.090003  8837 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:48.091251  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:48.091483  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.085947 10175 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:15:48.092233  8839 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:48.092291  8837 raft_consensus.cc:2410] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:48.093204  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.093478  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.094260  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.094780  8839 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.090054  9466 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:48.096371  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:48.079553  9431 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.958s (SENT) [suppressed 33 similar messages]
I20260709 13:15:48.098771  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:47.848635 10089 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:48.099773  8763 raft_consensus.cc:2393] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.092628 10175 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:48.105871  9432 leader_election.cc:400] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4.
I20260709 13:15:48.109139  9432 leader_election.cc:403] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.101599  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.110715  9432 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.106930  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.100173  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.105412  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.111819  8840 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:47.856303  9459 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:48.070906  9462 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:48.045274  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.112636  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.115852  8909 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.116010  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.116608  8837 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:48.119125  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.120359  8766 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:47.845640 10197 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.261s
I20260709 13:15:48.129489  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.128707  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.128626  8843 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:48.130012  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.129326  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.114027  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.098341  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.112425  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.100203 10179 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:48.135247 10089 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:48.139575 10089 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.135366  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.136049  8916 raft_consensus.cc:2368] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:48.135092  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.133071  8918 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:48.141011  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.141312  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.141705  8915 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:48.108358 10095 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.118342  8761 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.142231  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.146981  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.148716  8913 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.149541  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.150125  8763 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.145695  8760 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.153206  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.154429  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.155131  8767 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.155869  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.156364  8767 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.144312  9999 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:48.139608  8765 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:48.157728  9999 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.158293  9999 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.158664  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.159935  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.160501  8765 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.161361  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.140010 10089 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.108791 10175 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:48.115867 10189 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4.
I20260709 13:15:48.167805  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:48.137076  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.164505  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.162423  8911 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.135067  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.145656  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.171706  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.108161  9825 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:15:48.172703  8916 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:48.173007  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.174150  8763 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:48.144254  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.177196  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.180452  8766 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.181210  8913 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:48.146380 10024 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:48.143944 10188 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.164966  9898 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.178613  8909 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:48.178975  8837 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:48.179806  8840 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:48.162737 10125 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:48.184226  8915 raft_consensus.cc:2368] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:48.189173  8840 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:48.193364  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.194454  8916 raft_consensus.cc:2368] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
W20260709 13:15:48.195755 10212 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:15:48.195667 10175 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.198280  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.199196  8912 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:48.179322  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.203178  8767 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:48.202778  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.205183  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.185897 10024 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:48.207275 10024 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:48.208932  9898 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:48.209389  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 99837.2us
I20260709 13:15:48.210340  9999 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.211297  9898 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:48.211860  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.212661  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.213675  8912 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.214661  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.216217  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.185504  8917 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:48.218570  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.219285  8764 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:48.219175  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.186102 10104 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:48.220753  8764 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:48.221180  8910 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.229523  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:48.249202  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.223194  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 102875us
I20260709 13:15:48.222563  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.191075 10125 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.229903  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:48.278841  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 199301us
I20260709 13:15:48.279134  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:48.276834  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 166210us
I20260709 13:15:48.281260  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:48.285362  8912 raft_consensus.cc:2368] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:48.285112  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:48.285187  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.288388  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.288425  8840 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.224601 10200 raft_consensus.cc:993] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 3b34c95a175945b88b17f07fbc650abf to start an election
I20260709 13:15:48.279840  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.291181  8837 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.292887  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.294178  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.295219  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.296679  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.297435  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.298094  8909 raft_consensus.cc:2368] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:48.298717  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:48.221138  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.306547  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.307184  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:48.308167  9468 raft_consensus.cc:2368] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4.
I20260709 13:15:48.303066  9466 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.229013 10006 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.222146  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.317880  8839 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:48.233639 10139 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:48.226640  9999 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:48.227774 10088 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:48.286630 10125 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.336758  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.311125  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.304885  8764 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:48.279449  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.304282  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.329018  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.322808 10095 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:48.345739  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.346176  8911 raft_consensus.cc:2368] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:48.346841  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.347074  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.300508  9898 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.347587  8918 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.348052  8761 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:48.335479  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.330116  8917 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.346846  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.332454  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.321470 10183 raft_consensus.cc:1081] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Signalling peer 3b34c95a175945b88b17f07fbc650abf to start an election
I20260709 13:15:48.349623  8916 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:48.350021  8909 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:48.345561 10095 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.350955  8760 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:48.352510 10095 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:48.193490 10188 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.328821  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.355006  9462 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.356909  8837 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
W20260709 13:15:48.581422  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 250607us
I20260709 13:15:48.412760  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.544625  9468 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:48.582913  8763 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:15:48.363847  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59651.2us
I20260709 13:15:48.584411  9825 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:48.585287  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.389289 10024 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.352658  8760 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:48.589071  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.589473  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.593017  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.593379  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.594111  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.594919  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.595206  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.589885  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.590091  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.596498  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.597599  8909 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:48.598469  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.599309  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.328130 10139 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:48.590566  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.609695  8913 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:48.543900 10089 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.596354  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.612478  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.329056 10006 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.617862  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:48.606196  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 236891us
I20260709 13:15:48.612051  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.571871 10155 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:48.623279  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.392282 10183 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:48.623566  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.377190  9898 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:48.625039  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.628211  8839 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.631877  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.633167  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.635438  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:48.635952  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.636235  8918 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.637603  8734 leader_election.cc:400] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4.
I20260709 13:15:48.637950  8734 leader_election.cc:403] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:15:48.621999 10104 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:48.611508  8914 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:15:48.627794  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.644892  8909 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:48.646015  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.649870  8840 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:48.652215  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:48.645085  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 340048us
I20260709 13:15:48.675760  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.676257 10183 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:48.676731 10213 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:48.677349 10213 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:48.678323 10213 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.626791 10155 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.678617 10183 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.675499 10104 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:48.693800  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:48.697016  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57151.9us
I20260709 13:15:48.706246  8916 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:48.699793  8762 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:48.695472 10104 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.710433  8917 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:48.710983  8917 pending_rounds.cc:85] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:48.711308  8917 pending_rounds.cc:107] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:48.711645  8917 raft_consensus.cc:2889] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:48.711802  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.712356  9903 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:48.712652  8913 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:48.712756  9903 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:48.645437 10139 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:48.653254  9462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8"
dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:54286
I20260709 13:15:48.682257  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.784988  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.718355  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.789979  8768 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:48.713753  9903 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.785382  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.792235  9903 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.776206  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:48.793108  9894 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:48.790102  8910 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:48.793242  8763 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.714913  9464 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:48.718883  9898 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:48.796741 10006 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:48.791438  9462 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:48.760004  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 968) took 1030 ms. Trace:
I20260709 13:15:48.799840  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:48.806347  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:48.713563  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:48.747885  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.691687 10200 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4.
W20260709 13:15:48.809640  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 172132us
W20260709 13:15:48.815065  9431 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.539s (SENT)
W20260709 13:15:48.817261  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:48.817328  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.817798  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:48.819851  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:48.806030  8836 rpcz_store.cc:276] 0709 13:15:47.729387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.708302 (+978915us) service_pool.cc:224] Handling call
0709 13:15:48.755796 (+ 47494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:48.759508 (+  3712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.759553 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:48.759635 (+    82us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:48.759679 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:48.759761 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:48.759921 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1277,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":14895}
I20260709 13:15:48.719450  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:48.837210  8765 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.002s
I20260709 13:15:48.837589  8765 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:48.838397  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:48.839143  8762 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:48.743836  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.840093 10155 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:48.798928 10024 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:48.744048 10002 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.097s
I20260709 13:15:48.841372 10193 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:48.708257 10223 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:48.808182 10179 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:15:48.843297  8838 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:48.843775  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 969) took 1107 ms. Trace:
I20260709 13:15:48.843914 10196 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:48.844383 10196 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.844135  8838 rpcz_store.cc:276] 0709 13:15:47.747482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.641581 (+894099us) service_pool.cc:224] Handling call
0709 13:15:48.843718 (+202137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:48.844841 10196 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.845301  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.846227  8910 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:48.847556  8840 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.847738 10089 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:48.848661 10089 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:48.850072  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.850863 10139 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:48.851351  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.852708  8841 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.848572  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.845450  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:48.859879  8842 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:48.861232  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:48.863724  8763 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:48.868279  8840 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:48.871207  9467 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:48.865886  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:48.872342  9432 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:48.874678  8836 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:48.875135 10024 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:48.876281  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.877210 10217 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:48.877676 10217 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:48.878088 10217 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.878804  8912 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:48.881695 10175 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:48.714609 10188 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:48.816239  9462 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:48.824983  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:48.820899 10006 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:48.859670 10153 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:48.859848 10223 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:48.919641  8841 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:48.859633 10088 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:48.909235  9431 leader_election.cc:336] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.585s (SENT)
W20260709 13:15:48.933923  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 306100us
W20260709 13:15:49.028932  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.043759  8842 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:49.050355  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 141192us
I20260709 13:15:49.039196  8835 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:15:49.049281  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 166087us
I20260709 13:15:49.036749 10223 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:49.052345  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 180095us
W20260709 13:15:49.053267  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 187194us
W20260709 13:15:49.057870  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.058281  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.055615  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 194547us
I20260709 13:15:49.049665  8911 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:49.063469  8769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94e939be989f4d59b1983955951ab90f"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
W20260709 13:15:49.064277  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 241995us
I20260709 13:15:49.064841  8769 raft_consensus.cc:606] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.065315  8769 raft_consensus.cc:614] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:15:49.070861 10224 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:15:49.071584  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 252541us
I20260709 13:15:49.071817 10200 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:49.072366 10200 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.074270  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:49.074558 10200 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:49.075076  9467 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:49.075774  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1224) took 1157 ms. Trace:
I20260709 13:15:49.076308 10225 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:49.076949 10225 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:49.078109  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:49.077917 10225 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.080075  8762 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:49.082610  9467 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:15:49.084287  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:49.065865 10002 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.085013  8762 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.085297 10002 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.087574 10189 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.087901 10002 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:49.088958  8763 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:49.088080 10189 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.091272 10189 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:49.076201  8844 rpcz_store.cc:276] 0709 13:15:47.918197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.074977 (+1156780us) service_pool.cc:224] Handling call
0709 13:15:49.075282 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.075451 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.075481 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:49.075522 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:49.075553 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.075608 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.075718 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:49.064188  9898 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:15:49.097214  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.099126  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.064666  8911 pending_rounds.cc:85] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:49.102193  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.102855  8769 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:49.104592  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:49.117657 10197 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:49.116986  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.105355  8769 raft_consensus.cc:2376] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2. Re-sending same reply.
I20260709 13:15:49.120415 10197 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:49.130132  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:49.130992  8769 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.131986  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.132720  8918 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.054704 10088 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.061105 10006 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:15:49.110359  8911 pending_rounds.cc:107] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:49.141752  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.142812  8763 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:49.113111  9825 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.149334  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:49.149919  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:49.149338  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:49.154160  8732 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.544s (SENT)
I20260709 13:15:49.116016  8762 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:49.161952  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.161710  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.164996  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.161901  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:49.168277  8836 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.173117  8916 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:49.102573 10196 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.176891  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.146229  8911 raft_consensus.cc:2889] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:49.147535 10153 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:49.192668  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.194993  9462 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:49.209777  9431 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.602s (SENT)
W20260709 13:15:49.210727  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.611s (SENT)
W20260709 13:15:49.192572  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.213835  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:49.197706  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.147960  9898 consensus_queue.cc:1243] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:49.157445  9825 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:49.172713 10228 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:15:49.223140  8918 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:49.205309  8761 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:49.210132 10123 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:15:49.229581  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.173481 10188 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:49.259791  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.297586  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129776us
I20260709 13:15:49.289671  8836 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
W20260709 13:15:49.259829  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.178509  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.291453  9468 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:49.156968 10187 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:15:49.178025 10242 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:49.172257 10155 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:15:49.232228 10200 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:49.242849  9825 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:49.327459  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 129817us
I20260709 13:15:49.339289  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.339417  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.339891  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.340708  8918 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.329485  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.290755 10089 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:49.331113  8732 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.725s (SENT)
I20260709 13:15:49.181476 10240 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:15:49.353658  8916 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:49.359920  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.364907  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.331274 10242 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:15:49.370476  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 193722us
I20260709 13:15:49.330885 10002 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:15:49.372478  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.376680  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:49.381197  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.381460  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.383610  8910 raft_consensus.cc:2376] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2. Re-sending same reply.
I20260709 13:15:49.382581  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.385651  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.387337  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.390080  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:49.391630  9431 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.820s (SENT)
I20260709 13:15:49.332739 10095 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:15:49.353452 10253 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.300988 10250 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:15:49.413296  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:49.400225  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101703us
I20260709 13:15:49.397014  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:49.399410  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 73) took 1184 ms. Trace:
I20260709 13:15:49.388273 10188 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.417030  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:49.396179  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:49.420554  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 95628.4us
I20260709 13:15:49.379302 10236 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:15:49.427093  8732 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.785s (SENT)
I20260709 13:15:49.427569  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.391477  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:15:49.383311 10217 consensus_meta.cc:287] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.002s
I20260709 13:15:49.353037 10200 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.417022  8915 rpcz_store.cc:276] 0709 13:15:48.214776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.305214 (+ 90438us) service_pool.cc:224] Handling call
0709 13:15:49.399158 (+1093944us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540036f6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:49.399333 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1606181632}
I20260709 13:15:49.391428 10189 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:49.390784 10242 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.395771 10104 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.392397 10248 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:49.444139  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.430107 10236 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:49.424232  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.428360  9898 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:15:49.451746  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71684.8us
I20260709 13:15:49.452538  8769 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:49.433439 10217 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.384785 10153 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.429627 10259 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:49.452711 10233 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:15:49.444368 10261 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.452383 10180 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.459060 10254 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.430980 10188 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:49.461318  8732 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.786s (SENT)
I20260709 13:15:49.474566  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.462451 10088 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:49.464448 10245 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:15:49.477401 10196 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:49.448001 10232 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 13:15:49.478040  9903 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:49.478513  9903 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:49.479282  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1226) took 1560 ms. Trace:
I20260709 13:15:49.480515  8917 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:49.454589  9898 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:49.476809 10188 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:49.482383  8732 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.880s (SENT)
I20260709 13:15:49.482955 10244 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.479658  8843 rpcz_store.cc:276] 0709 13:15:47.918798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.135172 (+216374us) service_pool.cc:224] Handling call
0709 13:15:48.135514 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.139413 (+  3899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.139446 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.072479 (+933033us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b180038a9a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a
0709 13:15:49.081320 (+  8841us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.166550 (+ 85230us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:49.166589 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.166654 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.478983 (+312329us) raft_consensus.cc:1685] finished
0709 13:15:49.479002 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.479224 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":905,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5005,"spinlock_wait_cycles":9921536,"thread_start_us":84675,"threads_started":1,"wal-append.queue_time_us":215232}
I20260709 13:15:49.473047 10261 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.483798  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.395591 10123 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:15:49.485203  8909 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:49.486680  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.444530 10189 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:49.480733 10175 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 13:15:49.484714 10217 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:49.486116 10238 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:15:49.468014 10255 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.484704 10200 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:49.521778 10187 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:49.524351 10180 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:49.527158  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44807.4us
W20260709 13:15:49.530730  8732 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.010s (SENT)
I20260709 13:15:49.531265  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.534142  9459 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:49.487566 10260 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.491204 10258 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.544135 10223 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.545851 10261 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:49.517665 10188 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 13:15:49.545862  8732 leader_election.cc:336] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.019s (SENT)
I20260709 13:15:49.548585  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.550015  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:49.540508 10125 consensus_meta.cc:287] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.162s	user 0.011s	sys 0.002s
I20260709 13:15:49.532205 10187 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:49.557969 10189 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:49.562980 10267 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:49.594483  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:49.594856  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 230020us
I20260709 13:15:49.558413  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 961) took 1760 ms. Trace:
I20260709 13:15:49.479322  9903 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:49.597283  8767 rpcz_store.cc:276] 0709 13:15:47.798241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.308235 (+509994us) service_pool.cc:224] Handling call
0709 13:15:48.331202 (+ 22967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:48.331620 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:48.331660 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:48.334801 (+  3141us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.233586 (+898785us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b18004073e0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:15:49.373864 (+140278us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:49.373918 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.374043 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:49.558058 (+184015us) raft_consensus.cc:1685] finished
0709 13:15:49.558079 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:49.558344 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3504,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":49317,"spinlock_wait_cycles":34913536,"thread_start_us":140066,"threads_started":1,"wal-append.queue_time_us":1144852}
I20260709 13:15:49.591292  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.547737 10175 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.595301  8912 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:49.528170 10241 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:15:49.594046 10267 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:49.603615 10175 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.604602 10267 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.605259 10189 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:49.606022 10175 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:49.605868 10189 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:49.608520  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:49.596030  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 129672us
W20260709 13:15:49.600190  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54353.1us
I20260709 13:15:49.532636 10243 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
W20260709 13:15:49.610634  8732 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.619s (SENT)
I20260709 13:15:49.611346  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.612962 10244 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.613183 10242 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:49.615674  8732 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.725s (SENT)
I20260709 13:15:49.616000 10242 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:49.617444  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.593503 10180 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.553095 10261 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:15:49.622260  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.625619 10241 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:49.626386 10241 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:49.627233 10241 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.629549  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.630184 10241 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.547181  9898 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.631506  9898 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:49.633708  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:49.635938  9999 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:49.636436  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.637637  9903 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.637878 10255 raft_consensus.cc:2764] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:15:49.636720  9999 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:49.640208  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:49.592263 10125 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.638885  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:49.648051  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.648623  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.608556 10189 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:49.638283 10225 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.642441  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.654354  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:49.644217  9825 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.663882  8917 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:49.665450  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.666600  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:49.667316  8843 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.670403  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.647356  9999 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:49.672734  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:49.664511 10024 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:49.678627  8766 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:49.654127 10243 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.677772  8767 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:49.654354  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:49.678619  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 230262us
I20260709 13:15:49.597620  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.668555 10187 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:49.688459  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.695061  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.693269  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:49.689615  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:49.692569  8766 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:15:49.696851  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.673251  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:49.699270  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.699851  8766 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:49.703702  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:49.704447  8843 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:49.704624  8767 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:49.687186 10259 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:49.712045  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 114551us
I20260709 13:15:49.766062  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.770761  8913 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:49.767361 10125 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:49.760535  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.771004  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.712128  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:49.773130  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61085.6us
I20260709 13:15:49.774509  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:49.770260  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 64293.8us
I20260709 13:15:49.787367  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.788538  8910 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 2 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:49.791826  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.792773  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.744390 10123 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 13:15:49.744511 10187 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.769919  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:49.809883  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.712633 10024 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:49.744076 10243 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:49.746701 10006 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:15:49.706935  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:49.786280 10253 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:49.713465 10264 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:49.811465  9825 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:49.819710  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.821170 10270 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:49.706408 10276 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:15:49.784225 10153 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:49.696412 10260 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
W20260709 13:15:49.817932  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 105962us
W20260709 13:15:49.829257  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55567.9us
I20260709 13:15:49.819206 10274 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:49.832901  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.835273  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.841331  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.842772  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.843390  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.888422  8916 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:49.824810  8835 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:49.881634  8913 raft_consensus.cc:2410] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:49.883543  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:49.809052 10125 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:15:49.891458  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.901245  8916 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:49.891780  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.836529 10258 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:15:49.905354  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.915606  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:49.939322  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 98070.6us
I20260709 13:15:49.941927  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:49.934023  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.844372 10089 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:49.955654  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:49.844727 10274 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:15:49.957212  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73799.8us
I20260709 13:15:49.957088  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:49.840378  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 151494us
I20260709 13:15:49.883167  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.959560  8917 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:49.892616  9825 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:49.961738  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.882120 10270 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:49.965739  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:49.969937  8917 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:49.969878  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:49.972657  8916 raft_consensus.cc:2410] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:49.894613 10153 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:49.975697  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:49.968096  8913 raft_consensus.cc:2376] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3. Re-sending same reply.
W20260709 13:15:49.987417  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:49.889304  9999 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.989915  9466 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:49.962357 10276 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:15:49.987373 10153 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.961203 10274 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:49.961449 10243 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:49.958770 10250 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:15:49.967772  9825 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:49.897404 10279 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.131s
I20260709 13:15:49.971946 10089 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:49.890563 10259 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.966445 10024 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:49.957641 10264 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:15:49.958850 10255 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:50.275353  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.379063  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:50.027588  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.473016  8916 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:50.378003  9903 consensus_meta.cc:287] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.000s
W20260709 13:15:50.294770  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.475009  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.475606  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.477402  8912 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:50.067039 10260 consensus_queue.cc:1243] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:50.038913  9898 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.438s
W20260709 13:15:50.064010  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 104435us
I20260709 13:15:50.036804 10123 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:50.485395  8881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.020s
W20260709 13:15:50.489019  8881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.003s	sys 0.020s
W20260709 13:15:50.489905  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.491771  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.039120  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:50.487498  9999 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:50.494393  8914 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:50.028252 10270 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:50.509109 10189 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.523463  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.527228  8916 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.528097  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.528790  8917 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:15:50.530686  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:50.517277  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 490064us
I20260709 13:15:50.502080  9825 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:50.533828  9898 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.516393 10089 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.543021 10289 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.543569 10289 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:50.571841  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 970) took 1975 ms. Trace:
I20260709 13:15:50.556658  8769 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:50.535355 10123 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:50.575475  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 374471us
W20260709 13:15:50.581106  9431 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.958s (SENT)
I20260709 13:15:50.533353 10285 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:15:50.582160  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:50.585011 10189 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:50.586877  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.573268 10290 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.580022  9825 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:50.572396  8911 rpcz_store.cc:276] 0709 13:15:48.612908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.643265 (+ 30357us) service_pool.cc:224] Handling call
0709 13:15:48.889804 (+246539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:49.210974 (+321170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.571495 (+1360521us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54002b1450. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:50.571750 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517779712}
I20260709 13:15:50.542102  9898 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:50.604800  8918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.077s	sys 0.104s
W20260709 13:15:50.605335  8918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.077s	sys 0.104s
I20260709 13:15:50.632077  8769 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:50.586547 10123 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.598925 10290 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:50.651862  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 88409.8us
I20260709 13:15:50.655751  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:50.655974  8732 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.919s (SENT)
W20260709 13:15:50.652477  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.611614  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.658553  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.659987  8917 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:50.660745  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.659307  8916 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:50.636723 10289 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:50.664111  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.664775  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.665346  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.668515  8917 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:50.653716  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.669759  8916 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
W20260709 13:15:50.671377  8732 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.077s (SENT)
I20260709 13:15:50.673010  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.678447  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.678879  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.679100  8917 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:50.679999  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.683907  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.684464  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.684813  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.669903  8914 raft_consensus.cc:2376] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3. Re-sending same reply.
I20260709 13:15:50.683063  8911 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:50.687361  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.706970  8914 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:50.708326  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.702859  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.687903 10123 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:50.689067  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.712532  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:50.713069  8910 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:50.713230  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.713533 10024 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.713954  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.714246  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.714056 10024 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:50.714788  8910 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:50.715261  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.715541  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.715987  8917 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.716236  8910 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 2: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.716303 10024 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:50.691812 10290 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:50.716759  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.692919  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.717845  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.718106  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:50.702899 10284 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.686s	user 0.002s	sys 0.000s
W20260709 13:15:50.686690  8732 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.084s (SENT)
I20260709 13:15:50.719422  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:50.719660 10024 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:50.694450  9898 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:50.695914 10274 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.000s
I20260709 13:15:50.698869  9462 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:50.705078  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.720602  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.733237  8910 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.685992  8918 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:50.676956  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 87234.2us
I20260709 13:15:50.718909  8911 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:50.718885  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.724248 10297 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:15:50.699025 10187 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.000s
I20260709 13:15:50.737000  8917 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:50.721167 10024 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:50.743428  8918 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:15:50.745580  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.746130  8916 raft_consensus.cc:2368] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:50.746359  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.747118  8918 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.734400 10270 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:50.749751 10024 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.750046 10270 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.750758  9434 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:50.752391 10270 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:50.732167  9462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54286 (request call id 283) took 2095 ms. Trace:
I20260709 13:15:50.750432 10304 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.753628  8915 raft_consensus.cc:2410] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:50.754618  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.755838  8917 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.731606 10274 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:50.749827 10300 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.756685  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:50.750473 10301 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:15:50.772118  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:50.774097  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.776296  8918 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:50.777815 10274 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:50.778193  9431 leader_election.cc:336] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.568s (SENT)
I20260709 13:15:50.778929  8913 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:50.779441  8913 pending_rounds.cc:85] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:50.779690  8913 pending_rounds.cc:107] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:50.779942  8913 raft_consensus.cc:2889] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:50.782120  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.757483 10300 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.795826 10300 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:50.754278  9462 rpcz_store.cc:276] 0709 13:15:48.636617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.639443 (+  2826us) service_pool.cc:224] Handling call
0709 13:15:50.698705 (+2059262us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4c001d6c00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e066a20 00007fce6e077a29 00007fce6e07813f 00007fce6e03c2ab 00007fce6e069f3c 00007fce6e06a3fe 00007fce6e2f788b 00007fce6fcf6495 00007fce6fd4730f 00007fce6fd91a55 00007fce74d61cd0
0709 13:15:50.732058 (+ 33353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19074432}
I20260709 13:15:50.781627 10304 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
W20260709 13:15:50.821451  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 57976.9us
W20260709 13:15:50.822324  8882 connection.cc:256] RPC call timeout handler was delayed by -1.56308186199999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:15:50.822892  8882 connection.cc:256] RPC call timeout handler was delayed by -1.5090818619999027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
W20260709 13:15:50.823338  8882 connection.cc:256] RPC call timeout handler was delayed by -1.4703818620000675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
W20260709 13:15:50.823724  8882 connection.cc:256] RPC call timeout handler was delayed by -1.3371818620000795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:15:50.824110  8882 connection.cc:256] RPC call timeout handler was delayed by -1.3236818620000577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:15:50.824486  8882 connection.cc:256] RPC call timeout handler was delayed by -1.30658186200003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20040000000000002s for a response
W20260709 13:15:50.824878  8882 connection.cc:256] RPC call timeout handler was delayed by -1.1940818620000755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:15:50.825266  8882 connection.cc:256] RPC call timeout handler was delayed by -1.1211818619999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:15:50.825634  8882 connection.cc:256] RPC call timeout handler was delayed by -1.0707818620001035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22660000000000002s for a response
I20260709 13:15:50.841526  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:50.843292  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:50.844835  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:50.845042 10294 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:50.848104 10264 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:50.850948 10294 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:50.851058  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:50.845511  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 88965.5us
I20260709 13:15:50.853332  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:50.857123 10307 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:50.857409 10311 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:50.847710 10123 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.808799 10024 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:50.847493 10297 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.857795 10307 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:50.857929 10311 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:50.869654 10123 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:50.876644  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:50.878283  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 191625us
I20260709 13:15:50.882545 10307 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.874176 10297 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:50.873222 10311 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:50.891645  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:50.894380 10297 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.898043 10297 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:50.901552  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.903074  8918 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.905018  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.904182  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.911572  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.913666  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.915292  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:50.899240 10314 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:50.890477 10123 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:50.924944  9898 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:50.925469  9898 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:50.925876  9898 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:50.928001  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.930660 10024 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:50.931173 10248 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:50.931618 10248 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:50.941244  8732 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.566s (SENT)
I20260709 13:15:50.943171  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:50.945256  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:50.946352  8767 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:50.948767  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.949194  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:50.949941  8910 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:50.950234  8765 raft_consensus.cc:2393] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:50.950649  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 986) took 1252 ms. Trace:
I20260709 13:15:50.950994  8765 rpcz_store.cc:276] 0709 13:15:49.697999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.701076 (+  3077us) service_pool.cc:224] Handling call
0709 13:15:50.950597 (+1249521us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.951789 10260 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:50.952188  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:50.952478 10317 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:50.936985 10308 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.936008 10297 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.932462 10248 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.954726  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1240) took 1325 ms. Trace:
I20260709 13:15:50.979655  8916 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:50.979827  8912 rpcz_store.cc:276] 0709 13:15:49.628990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.629259 (+   269us) service_pool.cc:224] Handling call
0709 13:15:50.954511 (+1325252us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54002ab7d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:50.954662 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947682176}
W20260709 13:15:50.967228  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:50.981289  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.982129  8916 raft_consensus.cc:2376] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5. Re-sending same reply.
W20260709 13:15:50.947157  8732 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.689s (SENT)
I20260709 13:15:50.950997  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:50.984212  8767 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:49.709033  8762 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:50.954881 10304 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:50.958704  9903 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:50.952821  8765 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:50.952196 10260 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:50.986887  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:50.997424 10304 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:50.998286 10248 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:50.983556 10297 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:50.983570 10024 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:50.986441  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.002741  8767 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:50.984671  8732 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.700s (SENT)
I20260709 13:15:51.007892  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:51.009202  8732 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.887s (SENT)
I20260709 13:15:51.009650  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:50.983777 10308 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.007066  8912 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:51.014273  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:51.014932  8912 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.015868 10024 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.020174 10024 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:51.020787 10260 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.021998  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:51.022349 10260 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.023854 10307 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.023058 10297 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.024324 10307 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:51.024798 10307 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.026468  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:51.027829  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:51.028085 10311 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.030946 10237 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:51.032204  8915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1242) took 1363 ms (client timeout 1671 ms). Trace:
I20260709 13:15:51.013128 10318 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.032951 10311 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:51.032713  8915 rpcz_store.cc:269] 0709 13:15:49.668421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.668932 (+   511us) service_pool.cc:224] Handling call
0709 13:15:51.031996 (+1363064us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000389d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:51.032136 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489096960}
I20260709 13:15:51.034235  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.035614  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:51.036749  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.038208  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:51.039119  8915 raft_consensus.cc:2368] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:51.041095  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.042172  8917 raft_consensus.cc:2410] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:51.011313  8732 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.899s (SENT)
I20260709 13:15:50.953006 10317 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.013198  9898 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:51.134541  9898 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:51.000648  9903 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.135710  8918 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:51.135815  9903 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.096081 10155 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.048208 10308 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.050223  9431 leader_election.cc:400] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3.
I20260709 13:15:51.136914 10155 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.137348  9903 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:51.137449  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 87932.5us
W20260709 13:15:51.073596  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.063971 10307 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.426597 10307 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:51.061044  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.112344  8765 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:51.093916  8762 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
W20260709 13:15:51.428990  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58862 (request call id 92) took 1780 ms (client timeout 2226 ms). Trace:
I20260709 13:15:51.083348  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.429422  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.430727  8765 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.430795  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.431903  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.432106  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.051151 10318 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.433288  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.433167 10318 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:51.429401  8762 rpcz_store.cc:269] 0709 13:15:49.648621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.665253 (+ 16632us) service_pool.cc:224] Handling call
0709 13:15:51.428930 (+1763677us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.435164  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.435843 10318 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:51.119992  8912 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:51.435993  8762 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:51.044930  8767 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:51.438798  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.439426  8762 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:51.439468  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.440116  8767 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.440444  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.441129  8762 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.442008  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.443109  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.444164  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.134737 10317 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:51.136305  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.047523  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.002533  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.005978 10304 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.445037  8762 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:51.449021 10304 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:51.045884  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 104321us
I20260709 13:15:51.138010 10155 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.177073 10267 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.208952  8760 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:15:51.459790  8760 pending_rounds.cc:85] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 4
I20260709 13:15:51.460155  8760 pending_rounds.cc:107] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:15:51.460433  8760 raft_consensus.cc:2889] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:51.461375  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 989) took 1760 ms. Trace:
I20260709 13:15:51.461719  8760 rpcz_store.cc:276] 0709 13:15:49.701381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.706710 (+  5329us) service_pool.cc:224] Handling call
0709 13:15:51.208529 (+1501819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:51.461045 (+252516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.461296 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.463138  8760 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.464372  8760 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.265126  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58862 (request call id 89) took 1625 ms. Trace:
I20260709 13:15:51.445747 10318 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.446377  8914 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:51.464998  8769 rpcz_store.cc:276] 0709 13:15:49.639686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.639841 (+   155us) service_pool.cc:224] Handling call
0709 13:15:51.264884 (+1625043us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400339354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:51.265049 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2105541376}
I20260709 13:15:49.703250  8761 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.466348  8769 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.467522  8769 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.468593  8769 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.268370 10261 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.469043 10261 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.469935 10261 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.471194 10261 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:51.297144 10282 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 1.284s	user 0.004s	sys 0.000s
I20260709 13:15:51.304800  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:51.473457  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 168729us
I20260709 13:15:51.474647  8761 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
W20260709 13:15:51.475239  8761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58862 (request call id 90) took 1827 ms (client timeout 1833 ms). Trace:
I20260709 13:15:51.348206 10306 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:51.349699 10259 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.479408 10318 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:51.475602  8761 rpcz_store.cc:269] 0709 13:15:49.647845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.654036 (+  6191us) service_pool.cc:224] Handling call
0709 13:15:51.475177 (+1821141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:51.479493 10259 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.464373  8762 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.481848 10306 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:51.482180  8762 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:51.482942 10259 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:51.482721 10306 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.483384  8762 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.358400 10153 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:51.484161 10306 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.445300 10294 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.484572 10153 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.485316 10294 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.486770 10153 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.360520 10241 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.362154  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.487497 10241 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:51.488441  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.489133  8838 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:51.476680  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 235) took 1788 ms. Trace:
I20260709 13:15:51.489744 10241 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.490120  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.362162  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.369736  8841 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
W20260709 13:15:51.384577  8807 connection.cc:256] RPC call timeout handler was delayed by -1.3203431699998873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1574s for a response
W20260709 13:15:51.400442  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.409269  8665 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 2 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:51.413857  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.414224  8835 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.418881 10188 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:51.419454 10287 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.419883  9903 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:51.420083 10252 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 2.120s	user 0.007s	sys 0.008s
I20260709 13:15:51.437569  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.449585  9898 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:51.445576  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 434276us
I20260709 13:15:51.317821 10311 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:51.480692  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:51.489251  8766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.723s	user 0.009s	sys 0.001s
W20260709 13:15:51.391960  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:51.503297  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.491799  9431 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.507452  8767 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:51.357072 10240 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.492790  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.514745  8841 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.514622 10240 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.515829  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:51.516422  8841 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:51.491093 10279 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:51.517009  8840 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:51.517400 10279 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.520097 10279 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:51.494702  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.498881 10188 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.521813  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:51.522620 10260 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.499169  9903 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.523356 10260 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.523731 10260 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.524080 10260 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.432682  8764 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:51.500510  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 982) took 2351 ms. Trace:
W20260709 13:15:51.501175  8732 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.943s (SENT)
W20260709 13:15:51.502815  8766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.737s	user 0.010s	sys 0.001s
I20260709 13:15:51.526912  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.527390  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 988) took 1826 ms. Trace:
I20260709 13:15:51.491690  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:51.489641  9468 rpcz_store.cc:276] 0709 13:15:49.688135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.688417 (+   282us) service_pool.cc:224] Handling call
0709 13:15:49.688802 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.694717 (+  5915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.694747 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.722829 (+ 28082us) log.cc:844] Serialized 26 byte log entry
0709 13:15:49.837517 (+114688us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:49.837544 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.837604 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.296557 (+1458953us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:51.472636 (+176079us) raft_consensus.cc:1685] finished
0709 13:15:51.472661 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.476616 (+  3955us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":12410,"spinlock_wait_cycles":102468352,"thread_start_us":53988,"threads_started":1,"wal-append.queue_time_us":192270}
I20260709 13:15:51.528275  8836 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.527768  8766 rpcz_store.cc:276] 0709 13:15:49.700689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.701882 (+  1193us) service_pool.cc:224] Handling call
0709 13:15:49.702186 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.702507 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.702534 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.715925 (+ 13391us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.527075 (+1811150us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:51.527113 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.527178 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.527217 (+    39us) raft_consensus.cc:1685] finished
0709 13:15:51.527228 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.527338 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4366,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":12966,"thread_start_us":1761071,"threads_started":1,"wal-append.queue_time_us":35660,"wal-append.run_cpu_time_us":2125,"wal-append.run_wall_time_us":1002578}
I20260709 13:15:51.526130  8763 rpcz_store.cc:276] 0709 13:15:49.148976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.150922 (+  1946us) service_pool.cc:224] Handling call
0709 13:15:49.151646 (+   724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:49.152096 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:49.152136 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:49.160355 (+  8219us) log.cc:844] Serialized 556 byte log entry
0709 13:15:49.185276 (+ 24921us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:49.185314 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:49.185389 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:51.419447 (+2234058us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:51.500179 (+ 80732us) raft_consensus.cc:1685] finished
0709 13:15:51.500199 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:51.500421 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3077504,"thread_start_us":24151,"threads_started":1,"wal-append.queue_time_us":133698}
I20260709 13:15:51.531004  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:51.531243  8766 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.531775  8763 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.532918  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:51.512743 10307 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:51.527915  8732 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.088s (SENT)
I20260709 13:15:51.493503 10259 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.534392  8769 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:51.537474  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.498629  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.498021 10153 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.487504 10294 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:51.497866 10155 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.490754  8838 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:51.543622  8836 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:51.498945 10287 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:51.571569  8838 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.572890 10287 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:51.573976  8838 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:51.546801 10314 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.578588 10314 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.578938 10314 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.581171  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:51.581527  8837 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.582037  9466 raft_consensus.cc:2410] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:51.501430 10311 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.544024  8841 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:15:51.541450  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:51.500126  8765 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:51.537025 10307 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:51.526631 10241 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.522626 10188 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:51.550559 10296 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.500759  9898 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.551462 10153 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.532554  9903 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:51.555541  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1268) took 1083 ms. Trace:
I20260709 13:15:51.599092  8913 rpcz_store.cc:276] 0709 13:15:50.472596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.472709 (+   113us) service_pool.cc:224] Handling call
0709 13:15:50.473021 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.780467 (+307446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.555290 (+774823us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002aadd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:51.555477 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702274304}
I20260709 13:15:51.601871 10283 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.593779 10307 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.607084 10241 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.611032  8835 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:51.612120 10276 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.613603 10251 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.614096 10251 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.615231 10251 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.616233 10253 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.616808 10253 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.618355 10236 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.619474 10236 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.622190 10248 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.623157 10248 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.627744 10240 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:51.629303  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.630182  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.631067  8840 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.632296  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:51.634148  8839 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:51.635239  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.635805  8839 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:51.556994  8769 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:51.544544 10259 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.532706 10304 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:51.568625  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72647us
I20260709 13:15:51.570923  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.699555  8836 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:51.700407  8841 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:51.587402  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 59506.6us
W20260709 13:15:51.701613  8732 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.163s (SENT)
I20260709 13:15:51.538123 10279 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.563838  8665 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:51.590507 10311 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:51.591029  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49662.5us
W20260709 13:15:51.705438  8807 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.830s (SENT)
I20260709 13:15:51.705717  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:51.706370  8807 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.510s (SENT)
I20260709 13:15:51.706808  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:51.707038  8807 connection.cc:256] RPC call timeout handler was delayed by -1.2127291230001447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:15:51.707587  8807 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.965s (SENT)
W20260709 13:15:51.708446  8807 connection.cc:256] RPC call timeout handler was delayed by -1.1914862030000677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
W20260709 13:15:51.695705  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53235.3us
W20260709 13:15:51.696597  8808 leader_election.cc:336] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.938s (SENT)
I20260709 13:15:51.702225  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.591144 10287 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.710098 10287 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.710505 10287 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.715610 10314 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.717497 10237 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.718192 10314 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:51.719105  8732 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.258s (SENT)
W20260709 13:15:51.720541  8732 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.289s (SENT)
I20260709 13:15:51.722677 10287 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.724601 10287 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:51.725368  8732 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.435s (SENT)
I20260709 13:15:51.725761  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.726445 10237 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:51.727308  8732 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.638s (SENT)
I20260709 13:15:51.727634  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.728237 10237 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:51.728533  8732 leader_election.cc:336] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.717s (SENT)
W20260709 13:15:51.734084  8807 connection.cc:256] RPC call timeout handler was delayed by -1.1213358439999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:15:51.734750  8807 connection.cc:256] RPC call timeout handler was delayed by -1.05786983400003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
I20260709 13:15:51.736163  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.737918  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.738219  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.616235 10251 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.740136  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:51.748570  8918 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:15:51.612632 10276 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:51.699164  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.750566 10024 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.703373 10296 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.750156  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:51.752251  9825 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:51.753084  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.753751  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.770718  8840 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.746526 10188 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:51.697067 10240 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:51.745307  9826 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:15:51.733242  8838 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 13:15:51.739096 10294 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.602330 10283 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.779508 10283 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.781015 10283 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.781450 10241 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.782090 10241 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:51.783506 10241 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:51.774091  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.758486 10314 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.771999 10089 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.761015  9903 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:15:51.789259  9898 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:51.789656 10314 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.790505 10248 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.774364 10188 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.769585 10024 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.789021 10125 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:51.800426  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 69724.4us
I20260709 13:15:51.817144  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.790663  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:51.819119  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.749786 10290 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:51.820399  9826 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:51.821410  9826 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:51.821826  9826 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.822826  9826 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:51.824203  9826 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.825790 10253 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.833896  9466 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:15:51.835872  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:51.838075  9468 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:51.840037  9459 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:51.845553  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:51.846804  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:51.848459  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.812602  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.849452  8840 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.851033 10259 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.820685 10290 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.851856 10290 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.851936 10279 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:51.852348 10279 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:51.852843 10290 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.878973 10290 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.853106 10279 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.881261 10279 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:51.857559  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:51.885317  8843 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:51.871133  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:51.877625  8836 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:51.872444  8842 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:51.873660 10153 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:51.875856  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:51.875372  9468 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:51.786332  8762 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:51.785821  9825 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:51.899539  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.793381 10241 raft_consensus.cc:2764] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:15:51.909463  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.803345 10089 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:51.906315  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:51.797520 10287 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:51.772559 10296 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.889793 10188 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:51.929673  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.778146 10240 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:51.872534  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:51.895318  9898 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.934382  8909 raft_consensus.cc:2410] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:51.810073 10264 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.109s
I20260709 13:15:51.890141 10125 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:51.902578  9825 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:51.944051  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 191038us
I20260709 13:15:51.918725 10089 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.948660  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.951922  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.954176  8916 raft_consensus.cc:2410] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:15:51.955713  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.934909  9903 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:51.818959  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:51.964881  8769 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.937656 10125 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:51.938591 10287 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:51.969278  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:51.974403  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.939179  9898 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:51.953564 10153 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:51.940927  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:51.975656  8807 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:51.976063  8769 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:51.948051 10237 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:51.979759  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.949677 10241 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:15:51.989491  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:51.964443  9903 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:52.017467  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:51.953619 10274 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:15:51.967684 10267 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:51.968271 10253 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:52.022858  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 123405us
I20260709 13:15:51.976656  9898 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:51.987720 10248 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:51.967896 10264 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:15:52.016845 10270 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.039981  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:52.042766  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52049.1us
W20260709 13:15:52.046265 10332 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:15:52.044165 10197 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:51.988813 10336 raft_consensus.cc:2764] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:15:52.053409 10287 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.056288 10294 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:52.058998 10294 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:52.060043 10294 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:52.060387 10294 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:52.028308  9903 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.040836 10248 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:52.063953  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:52.067679  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.037207 10253 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:52.068771  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.078555 10341 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.078855 10024 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.080170 10296 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.061633  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:52.088390  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52814.1us
I20260709 13:15:52.089329 10314 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.094726  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.096485  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:52.092022  8807 leader_election.cc:400] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3.
I20260709 13:15:52.069628 10248 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.069512 10336 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.040567 10267 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.075188 10253 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.102612  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.103288  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.109790  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.111274  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.102049 10240 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.121083 10249 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.115706 10241 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:52.061090  9825 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.122766  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 384884us
I20260709 13:15:52.124048  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:52.122987  9825 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:52.125200  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 70408.4us
I20260709 13:15:52.096617 10296 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.102388 10344 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.114403 10243 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:52.117420 10260 consensus_meta.cc:287] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.001s
I20260709 13:15:52.144542 10339 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:52.137428 10345 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.130764  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:52.146669 10276 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.152166  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:52.154309  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.158604  8790 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2b60 after lost signal to thread 7660
I20260709 13:15:52.161063 10264 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.168910  8909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1239) took 2548 ms (client timeout 2395 ms). Trace:
I20260709 13:15:52.094731 10294 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.172642  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:52.190610  8914 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.197511  8761 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:52.197914 10290 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:52.127956 10241 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:52.185283 10260 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.139782 10342 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:15:52.177448  8767 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:52.200165 10241 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.178341 10267 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:52.180176 10307 consensus_meta.cc:287] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.005s
I20260709 13:15:52.181871  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:52.202385  8913 raft_consensus.cc:2376] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3. Re-sending same reply.
I20260709 13:15:52.202294 10307 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:52.202844 10236 consensus_meta.cc:287] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.583s	user 0.005s	sys 0.012s
I20260709 13:15:52.203384  9467 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.203616 10123 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.204126 10123 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:51.889868 10261 consensus_queue.cc:1175] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "773340b2958e4af5b2010b902b9e9c04" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:52.183745  9826 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.205752  9826 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:52.205588 10321 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:52.206463 10321 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.206861 10321 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:52.206640  9826 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.188324  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:52.192202  8909 rpcz_store.cc:269] 0709 13:15:49.620702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:49.620946 (+   244us) service_pool.cc:224] Handling call
0709 13:15:52.168544 (+2547598us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b540026be54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:52.168752 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5284295040}
I20260709 13:15:52.197664  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.170763 10153 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:52.194881  8790 debug-util.cc:398] Leaking SignalData structure 0x7b08001070e0 after lost signal to thread 8701
I20260709 13:15:52.140420 10344 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:52.195336 10125 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.194466 10264 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.201568 10260 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:52.185352 10337 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:15:52.192199  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.197582 10294 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.210491  9825 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:52.232585  9825 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:52.233826  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.233522  9825 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.234464  8840 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:52.222801  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.140911 10283 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:52.236337  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.236392  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.237329  8844 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:52.207858  9826 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.230507  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.231501  8839 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:15:52.237998  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 105195us
I20260709 13:15:52.240051  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:52.235350  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.210497  8882 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:52.210101  8765 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:52.207737 10123 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.246294  8837 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:52.247579  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.251632  8841 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.241694  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.206102 10248 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.257148  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.259231  8841 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:52.260658  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.262212  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:52.262856  8763 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:52.207757 10270 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.222200 10344 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.237248 10236 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:52.226897  8762 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:52.269290  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.275324  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.241515 10267 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.270310 10296 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:15:52.236627 10283 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:52.282788 10283 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:52.207655 10321 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.284137 10321 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.286729  9903 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.287717 10253 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.280071  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:52.289760  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:52.290635 10339 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.291350  8843 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.257946 10345 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:52.290850 10237 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.266160 10123 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:52.348018  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58206.7us
I20260709 13:15:52.256672 10276 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.292889 10279 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.241820 10188 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.357558  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 67864.5us
I20260709 13:15:52.270660 10304 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.364032  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:52.314167 10308 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:52.315243  8790 debug-util.cc:398] Leaking SignalData structure 0x7b080025a6e0 after lost signal to thread 8793
I20260709 13:15:52.348392 10270 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.347955  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:52.317078 10339 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.332309  9903 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.349435 10237 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.278937 10236 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.354652 10123 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.362548  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:52.394560  8761 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.397864 10237 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.397013 10350 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:52.385376 10341 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.413813 10236 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.424285  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 87) took 1519 ms. Trace:
I20260709 13:15:52.429086  8916 rpcz_store.cc:276] 0709 13:15:50.904649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.989164 (+ 84515us) service_pool.cc:224] Handling call
0709 13:15:52.424062 (+1434898us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b540036f6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:52.424219 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1165339520}
W20260709 13:15:52.389861  8790 debug-util.cc:398] Leaking SignalData structure 0x7b080037d0e0 after lost signal to thread 8794
I20260709 13:15:52.377028 10308 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:52.393653 10339 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.430410  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:52.419261 10123 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.392004 10270 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.434083  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 142265us
W20260709 13:15:52.434820  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 82737.9us
I20260709 13:15:52.447431  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:52.426640  8762 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.352941 10279 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.439807 10308 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.452164 10253 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:52.466338  8790 debug-util.cc:398] Leaking SignalData structure 0x7b08002d71a0 after lost signal to thread 8868
I20260709 13:15:52.482203 10341 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.482721 10241 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:52.483179  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.463617 10125 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:52.489101 10329 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.779s	user 0.005s	sys 0.008s
I20260709 13:15:52.491567  8914 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
W20260709 13:15:52.492640 10353 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:15:52.493301 10349 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:15:52.502092 10089 consensus_meta.cc:287] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.001s
I20260709 13:15:52.502203 10283 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:52.486213  8790 debug-util.cc:398] Leaking SignalData structure 0x7b08000e9200 after lost signal to thread 8869
I20260709 13:15:52.475340 10264 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.546025 10237 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.551736  8790 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa240 after lost signal to thread 8942
I20260709 13:15:52.552484 10237 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.539698 10188 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.547295 10089 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.553897  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 991) took 1618 ms. Trace:
I20260709 13:15:52.555102 10089 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.554273  8768 rpcz_store.cc:276] 0709 13:15:50.935883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.162712 (+226829us) service_pool.cc:224] Handling call
0709 13:15:51.163086 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.491269 (+328183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.491296 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:51.491793 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:15:51.704404 (+212611us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:51.704441 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:51.870235 (+165794us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54000bb3d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:51.870311 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.488495 (+618184us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:52.553682 (+ 65187us) raft_consensus.cc:1685] finished
0709 13:15:52.553703 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.553836 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13898,"raft.queue_time_us":15121,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":771939968,"thread_start_us":212291,"threads_started":1,"wal-append.queue_time_us":217493}
I20260709 13:15:52.550192 10283 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:52.564071  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1004) took 1194 ms. Trace:
I20260709 13:15:52.564538  8835 rpcz_store.cc:276] 0709 13:15:51.369667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.498349 (+128682us) service_pool.cc:224] Handling call
0709 13:15:52.563883 (+1065534us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b54003a6454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:52.564010 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146580224}
I20260709 13:15:52.504535 10248 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.573427 10279 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.579389 10123 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.580664  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 359781us
W20260709 13:15:52.581723  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.582053  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:52.582337  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.585922  8665 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 2 to 4, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 4 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:52.587033  8762 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:52.282423  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:52.569422  8840 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:52.592140  8667 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 218) took 9208 ms. Trace:
I20260709 13:15:52.570232  9463 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
W20260709 13:15:52.595997 10356 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:15:52.596323  9898 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
W20260709 13:15:52.598675  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 209055us
I20260709 13:15:52.528343 10341 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.609830  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:52.593572  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 91) took 1087 ms. Trace:
I20260709 13:15:52.585942 10270 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.614328 10347 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:52.620069  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 172714us
W20260709 13:15:52.620625  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 162699us
I20260709 13:15:52.594918  8665 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:52.535429 10241 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.645057  9466 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:52.593642 10279 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.650270  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.652375 10183 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.654237 10357 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.654438  8761 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:52.654633 10361 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.654845 10357 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.655242 10361 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.592554  8667 rpcz_store.cc:276] 0709 13:15:43.397523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:43.401974 (+  4451us) service_pool.cc:224] Handling call
0709 13:15:52.578977 (+9177003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.157238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.157938 (+   700us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.158003 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:15:48.158027 (+    24us) tablet.cc:662] Decoding operations
0709 13:15:48.158684 (+   657us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.158810 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.158835 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:15:48.159260 (+   425us) tablet.cc:701] Row locks acquired
0709 13:15:48.159311 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:15:48.159477 (+   166us) write_op.cc:270] Start()
0709 13:15:48.159635 (+   158us) write_op.cc:276] Timestamp: P: 1783602948159409 usec, L: 0
0709 13:15:48.159657 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.160319 (+   662us) log.cc:844] Serialized 1359 byte log entry
0709 13:15:48.653018 (+492699us) op_driver.cc:464] REPLICATION: finished
0709 13:15:49.040809 (+387791us) write_op.cc:301] APPLY: starting
0709 13:15:49.040931 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:49.041102 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:49.041252 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:49.041864 (+   612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:49.042104 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:15:49.042168 (+    64us) write_op.cc:312] APPLY: finished
0709 13:15:49.042447 (+   279us) log.cc:844] Serialized 34 byte log entry
0709 13:15:49.057558 (+ 15111us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.066291 (+  8733us) write_op.cc:454] Released schema lock
0709 13:15:49.066352 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:49.109654 (+ 43302us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:49.122533 (+ 12879us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67617,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":380331,"apply.run_cpu_time_us":2632,"apply.run_wall_time_us":28410,"num_ops":3,"prepare.queue_time_us":536080,"prepare.run_cpu_time_us":3482,"prepare.run_wall_time_us":14028,"replication_time_us":481946,"thread_start_us":388402,"threads_started":2}]]}
W20260709 13:15:52.652578 10365 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:15:52.657778 10183 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:52.658298 10183 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.661017 10279 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.646252 10283 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.662096 10283 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.663211 10279 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:52.664101 10283 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:52.667567  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:52.668505  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48033.5us
W20260709 13:15:52.644778  8790 debug-util.cc:398] Leaking SignalData structure 0x7b0800287f80 after lost signal to thread 9492
I20260709 13:15:52.668241  9466 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:52.674290  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.679627 10362 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:52.617835  9898 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.680497 10362 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.681437 10362 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.681874 10362 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:52.683156  9898 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.682881 10362 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.684301 10362 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.678278 10361 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.685478 10361 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.685961  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.687027 10183 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.687700  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.689100 10237 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.675630 10321 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:15:52.666702 10358 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:52.677673  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.693430  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:52.656563 10308 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.621032 10350 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.695142  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.690148 10237 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.627632 10345 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:15:52.701890  9468 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:52.616799 10344 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:52.672796  8790 debug-util.cc:398] Leaking SignalData structure 0x7b080037d480 after lost signal to thread 9493
I20260709 13:15:52.693473  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:52.710773  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.713690  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:52.716161  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.701344 10358 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:52.707026 10357 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:52.718335  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.722285  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.722613  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:52.717636 10361 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.721356 10347 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:52.753119  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:52.714970 10350 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:52.722970  9898 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:52.758981  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:52.764312 10270 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:52.725386 10237 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.720386 10318 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.747159 10276 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:52.764840 10270 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:52.746304 10123 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.788091 10339 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.769654 10237 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.828002  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:52.771567 10350 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:52.630672  8838 rpcz_store.cc:276] 0709 13:15:51.505925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:51.856718 (+350793us) service_pool.cc:224] Handling call
0709 13:15:51.967183 (+110465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:51.990283 (+ 23100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:51.992628 (+  2345us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:52.069853 (+ 77225us) log.cc:844] Serialized 26 byte log entry
0709 13:15:52.226435 (+156582us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:52.229634 (+  3199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:52.241669 (+ 12035us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:52.582248 (+340579us) raft_consensus.cc:1685] finished
0709 13:15:52.582278 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:52.589602 (+  7324us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":124315,"threads_started":1,"wal-append.queue_time_us":262200}
I20260709 13:15:52.769817 10183 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.782140 10344 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.783720 10358 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.765357 10248 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:52.785007  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 555337us
I20260709 13:15:52.790230 10308 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.790791 10283 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:52.794672  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:52.796798  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:52.841126  8763 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:52.841189  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46588us
I20260709 13:15:52.798115  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:52.798740 10341 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.798832  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:52.799790  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:52.756138 10261 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.842278  8762 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:52.757725 10347 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.744649 10300 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:52.822942  8916 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:52.842289  8768 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:52.828727  8909 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:52.845806  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:52.779922 10236 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.763070  9898 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.837677  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:52.837797  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:52.839130  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:52.839392  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 118668us
I20260709 13:15:52.833467  9826 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:52.770941 10361 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:52.909245  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71406.4us
I20260709 13:15:52.770876 10276 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:52.797592  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:52.911931  8769 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.846428  8918 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:52.917913  8763 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:52.918392  8918 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:52.910908  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:52.906957  8912 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:52.920042  8918 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:52.759091 10357 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:15:52.768226 10274 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:15:52.905926  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:52.927829  8909 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:52.869920  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105066us
I20260709 13:15:52.907740  8910 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:52.851343  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:52.848448  8761 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.922713  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:52.924582 10296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.009s	sys 0.018s
I20260709 13:15:52.845492 10347 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:52.928938  8915 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:52.856572  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:52.930043  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:52.928733  8769 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:52.845124  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:52.932245  8913 raft_consensus.cc:2410] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:52.847962 10089 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:52.848187 10248 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:52.946314 10248 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.936647 10123 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:52.936774 10296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.010s	sys 0.019s
I20260709 13:15:52.953737  8915 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:52.956231  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:52.957834 10237 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.965247 10270 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.969331 10125 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:52.970665 10125 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.971275 10125 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.974537 10236 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:52.975673 10341 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:52.975814  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:52.976428 10341 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:52.977950 10341 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.979871 10279 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.912807 10241 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:52.980400 10279 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.981240 10241 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:52.981658 10241 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:52.982575 10279 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.982430 10241 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:52.983701 10241 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.983984 10236 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.984480 10236 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.986545 10236 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.922000 10276 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:52.988200 10236 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:52.988750 10236 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.990890 10236 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.992765 10279 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:52.993394 10279 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:52.994388  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:52.995556 10279 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.996232 10125 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:52.997656  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:52.998864 10359 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:52.999428 10359 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:52.911826  9826 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.000259 10359 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.000835 10294 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:53.001410 10294 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.002859  9826 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.003417 10294 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:52.912025 10188 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:52.945134 10089 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:53.016355  8915 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.009346  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:52.848256 10261 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.019794  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.027565  8840 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.021183  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.028443  8843 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:53.022177  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.029140  8841 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.029353  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:52.929457 10287 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.029927  8843 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.029932  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.030673  8841 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.015381  8909 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:53.025048  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:52.930433 10358 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.032883  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:52.845811 10283 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.031922  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.032266  8839 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:52.932489  9898 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.033607  8912 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:53.046720  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.023847  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.047662  8916 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 1.
I20260709 13:15:53.037700  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.048439  8842 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.049008  8918 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:53.043503  8909 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.044406  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.056826  8837 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:53.045181  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.058218  8915 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:53.046180  8910 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:15:53.039351  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.044334  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.059067  8843 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.050558  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:53.051180  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 121240us
I20260709 13:15:53.059876  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.059897  8916 raft_consensus.cc:2410] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:15:53.021510 10236 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.059137  8844 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.062635  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.062798  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.061691  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:53.056139  8840 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.069480  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.072202  8909 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:53.071458  8916 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:53.075331  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.075875  8916 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.076778  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.077852  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.080005  8843 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:53.080123  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.080262  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.080679  8912 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.077025  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.081897  8839 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:53.082511  8909 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:53.033326 10287 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.071488  8841 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:53.062866  8914 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:53.018214 10363 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:15:53.085816  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.110484  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:53.110728  8912 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:53.111025  8913 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.102581  8909 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.108769  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.051792 10188 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.113597  8837 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:53.115494  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:53.116570  8909 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.118979  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:53.119679  8915 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:53.076774 10308 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.127592  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:53.086072 10287 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.129581  8912 raft_consensus.cc:2368] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:15:53.137640  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.138852  8915 raft_consensus.cc:2410] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:53.114724 10123 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:53.145951  9432 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.539s (SENT) [suppressed 72 similar messages]
I20260709 13:15:53.084450 10236 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.153584 10339 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.154496 10236 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.157616  8762 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:53.158283  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.156782  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.137034 10308 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.160059  8762 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:53.160471  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.161073  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.161360 10308 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:53.161624  8767 raft_consensus.cc:2376] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5. Re-sending same reply.
I20260709 13:15:53.162086  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:53.162678  8915 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:53.162622  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.163457  8768 raft_consensus.cc:2376] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4. Re-sending same reply.
I20260709 13:15:53.164017  8915 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:15:53.165606  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.165846  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.166355  8768 raft_consensus.cc:2376] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4. Re-sending same reply.
I20260709 13:15:53.168537  8766 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.169221  8767 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:53.169540  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.165694  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.170157  8766 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
W20260709 13:15:53.170848  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110163us
I20260709 13:15:53.175772  8842 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:53.179114  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.180337  8764 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:53.109283 10375 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:15:53.189657  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.124192 10188 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.194332  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.195894  8767 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.193924  8909 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:53.197750  8909 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.198698  8909 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:53.199483  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:53.201666  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:53.205664  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.206440  8763 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.206590  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.206853  8761 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:53.207325  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.207834  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.208487  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:53.209801  8766 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:53.210988  8766 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:53.212648 10261 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.213812 10283 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.209350 10287 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:53.215778  8916 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:53.217425 10287 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.218214 10359 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:53.219712  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.149590 10089 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.221431  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.223800  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.207243  8769 raft_consensus.cc:2376] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3. Re-sending same reply.
I20260709 13:15:53.225274  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.225910  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.226759  8769 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:53.227139  8767 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:53.228248  8766 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:53.229820  8766 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:53.228385  8913 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:53.208648  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.250056  8844 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:15:53.229350  8909 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:53.252427  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.253475  8763 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.240904  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.259548 10347 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.260533 10283 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.261312  8766 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.262485  8764 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.207857  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.263310  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.265414  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.266919  8842 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:53.272202  8769 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:53.273001  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.273481  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.237035 10306 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.278916  8844 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:53.279588  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.280177  8769 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.267637  8918 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:53.271054  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.219731 10359 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:15:53.263265  8767 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:53.277525  8766 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.287998  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.286078  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:53.289860 10380 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:15:53.291327 10188 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.293866  8768 raft_consensus.cc:2368] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:15:53.296829  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.299098  8763 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:53.300635  8769 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.302542  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.303161  8764 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:53.306044  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.306905  8768 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:53.308331  8763 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:53.303184 10188 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.310608  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.310563 10188 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.311574  8763 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:53.300104 10236 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.285017  8761 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:53.313041 10236 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.271576 10283 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.317013  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.317611  8764 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:53.331446  8917 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:15:53.332592 10362 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.648s	user 0.006s	sys 0.006s
I20260709 13:15:53.262315 10253 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:53.333341 10359 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:53.334899 10347 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:53.338608 10283 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.340071  9898 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.344466 10236 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.345271 10188 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.332366 10276 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.349628  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.381708  8767 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:53.349964 10123 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.353528  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.355558  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.357160  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:53.358640 10361 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.354730  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.365979  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.407740  8769 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:53.369836  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:53.377883 10304 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:53.378814  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.410876  8768 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.384714  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.391464  8882 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.412215  8766 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:15:53.401969 10361 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:53.413591  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:53.403666  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 78113.8us
I20260709 13:15:53.390695  9468 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.405045 10347 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.405157 10395 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:53.408742  8763 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:53.408447  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:53.417232  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.419966 10264 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:53.421154 10264 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:53.374403  8760 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:53.420002  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.426860  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:53.389278 10123 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.424556  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.442214  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.443437  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.444743  9825 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:53.447149  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.407238 10188 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.442860  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.433769  8769 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:53.460101  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.461411  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:53.462225  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 69119.7us
I20260709 13:15:53.463564  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.418107 10347 consensus_queue.cc:1243] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:53.403121 10089 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:15:53.454768 10279 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.416880 10283 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.472801  8766 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.473278  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:53.473537  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.428690 10125 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:15:53.450721 10358 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.455389 10287 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:53.422734 10261 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:53.456555 10188 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.454598 10363 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:53.466874 10360 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.445398 10236 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.475126 10248 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:15:53.523561 10261 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:53.524458 10391 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.151s	user 0.002s	sys 0.000s
I20260709 13:15:53.525230 10261 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.526294  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.529320 10287 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:53.530612 10287 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:53.534794 10388 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:15:53.535202 10276 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.488412 10283 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.482061 10361 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.471712 10274 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:53.542552 10274 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:53.543093 10274 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.490162 10241 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:15:53.473800 10387 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:53.475221 10341 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.550390 10341 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.550820 10341 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.490748  8766 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.478291 10270 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:15:53.490921 10373 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:53.554446 10270 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:53.554876 10270 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:53.491688 10400 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:15:53.556293  8911 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:53.555974 10270 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.493103  8808 leader_election.cc:400] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:15:53.471921 10376 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:53.557062  8808 leader_election.cc:403] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:15:53.557276 10376 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:53.557648  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 64773.4us
I20260709 13:15:53.545094 10241 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.558391 10241 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.558535  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.450941 10362 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:53.506893  9826 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.560122  9826 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.560539  9826 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.560998 10382 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.561415 10382 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.561766 10382 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.520582  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.501571 10264 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.518769  9898 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.499449 10358 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.564392 10358 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.518335 10406 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:53.503749  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:53.565171 10406 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.560129  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.455651 10259 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:53.571295 10307 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:53.572317 10307 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.567662 10406 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:53.557734 10376 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.545315 10360 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:53.560341 10378 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:15:53.569072 10395 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.515141 10188 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:53.569769  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 66104.8us
I20260709 13:15:53.599879  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:53.537169  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:53.573087 10259 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:53.521378 10236 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.573676 10361 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.574306  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.575546  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.605382  8836 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:53.502743 10279 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:53.606201  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:53.596290 10125 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.546381 10283 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.576905  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.607887  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:53.608094  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 154937us
I20260709 13:15:53.578510  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.608966  8841 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:53.576714  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.586258  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.597770  9825 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:53.607228  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:53.611819  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:53.612483  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.608762  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.615646  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:53.616343  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.610538  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.610589  9825 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.616976  8843 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.617810  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:53.620678  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.621711  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.622632  8841 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:53.622496  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.623754  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.624120  8841 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:53.624782  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.626355  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.641299  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.636875  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.605305 10270 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.604645 10236 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.653479  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:53.646600  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.648135 10416 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.649001  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:53.649246 10415 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.649791  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:53.603826  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:53.606906 10125 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.611565  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.606204 10307 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:53.632661 10378 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:53.655063  8841 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.679709  8912 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:53.680835  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:53.658033  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:53.640229 10276 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.640690  9898 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:53.632936 10248 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:53.694813  8843 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:53.633107 10373 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.632787 10407 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:53.645790 10406 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.698654  9898 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.690896  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:53.679450 10125 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.678701 10415 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.686952 10378 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.692575 10276 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.688436 10370 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:53.741688  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:53.741235  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 277776us
I20260709 13:15:53.706516 10373 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.729000  8841 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:53.698424 10248 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.661842  9826 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.742024 10378 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.751581  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:53.752364 10408 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.752928 10290 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.753357  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:53.735280  8840 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:53.718926 10407 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:53.739727  9898 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.801440  9825 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:15:53.736477  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 292782us
I20260709 13:15:53.749500 10276 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.740322 10415 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.750383 10406 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:53.841472 10408 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.889324 10408 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.841199 10290 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.891649 10290 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.755234 10294 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:53.892148 10294 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.892604 10294 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.684383 10360 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.842497 10259 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:15:53.839931 10248 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:15:53.897212  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.884117  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 265267us
I20260709 13:15:53.759876 10370 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.894693 10274 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.908967 10274 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:53.758558 10373 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:53.912846  9826 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.923703  9826 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.924258  9826 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:53.925794 10413 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.276s	user 0.003s	sys 0.000s
I20260709 13:15:53.927821  9826 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.928555  9826 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:53.928952 10370 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.929198  9826 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.931988  9826 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.914772  8844 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:53.910012 10366 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:53.932744 10366 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:53.928769 10294 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.933652 10366 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:53.934800 10366 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:53.740950 10372 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:15:53.936676 10372 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:53.937125 10372 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:53.921401 10411 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:53.938046 10248 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:53.766718  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:53.945616 10412 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:15:53.938072 10372 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.948805 10372 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.950740 10248 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:53.755836 10264 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:53.954373 10370 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:53.954921 10370 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.737116 10279 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.939678 10294 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:53.958354 10370 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:53.953562 10264 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:53.959539 10264 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:53.865078  9463 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:53.738919 10123 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:53.865989 10407 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:54.000671  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 359917us
I20260709 13:15:53.987177 10406 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:54.045708  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:54.049970  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 401058us
I20260709 13:15:53.866228 10307 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:54.053720  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.005240 10395 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:15:54.054406  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 225288us
I20260709 13:15:54.055748  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1019) took 1041 ms. Trace:
I20260709 13:15:54.052850  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:54.074975  8916 rpcz_store.cc:276] 0709 13:15:53.013911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.079822 (+ 65911us) service_pool.cc:224] Handling call
0709 13:15:54.055468 (+975646us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002ab7d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:54.055669 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309607552}
I20260709 13:15:54.076038  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:54.076318  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:54.080425  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.086905  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:54.037312  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47951.2us
I20260709 13:15:54.016129 10241 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.086273  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:54.093379  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 412595us
I20260709 13:15:54.095825  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:54.071470  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:54.097996  8764 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:54.102820 10417 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.103534 10417 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.104064  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.105103 10125 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.105949 10417 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.107507 10125 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.108218 10125 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:15:54.095686  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.099977  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.114086  8839 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:54.104733  8835 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.092445 10416 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:54.101336 10358 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 13:15:54.094745 10270 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:54.135020  8764 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:15:54.108798 10290 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.124315 10306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.019s	sys 0.029s
W20260709 13:15:54.147354  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47483.6us
I20260709 13:15:54.159588  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.143132  8766 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:54.108709 10125 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.162546  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:54.169396  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.170028  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83871.7us
I20260709 13:15:54.171736  8764 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.181916 10427 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:54.182070 10424 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.182734 10424 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.184700  8911 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:54.185154  8911 pending_rounds.cc:85] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 5
I20260709 13:15:54.185098  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.185642  8911 pending_rounds.cc:107] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:54.185961  8911 raft_consensus.cc:2889] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.184723  8909 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:54.185153  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.187906  8916 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.188512 10424 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.186568  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.187158  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.189798  8914 raft_consensus.cc:2368] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5.
I20260709 13:15:54.190939  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.193141  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.193933  8910 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:54.194852  8911 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:54.195850  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.196556  8910 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:54.197184  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.200536  8910 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: [1.3-4.4]
W20260709 13:15:54.165506 10306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.019s	sys 0.030s
W20260709 13:15:54.209321  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49894.2us
I20260709 13:15:54.213527  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.215130  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.158051 10405 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.227182  8910 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:54.227557  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:54.227795  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.237605  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.204753 10417 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.239540  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:54.249804  8762 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.145658 10270 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.146306 10358 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.247079  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.212291 10306 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:54.252751  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.225061 10424 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.254987  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:54.221838 10287 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.271912  9431 leader_election.cc:400] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5.
I20260709 13:15:54.272256  9431 leader_election.cc:403] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:54.135311 10406 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.245651 10123 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.283128 10431 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:15:54.285454 10422 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.272430 10405 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.273573 10357 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:54.143641 10395 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.288174  8761 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:54.289908 10300 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:54.294127 10429 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:54.299316 10421 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:15:54.295085 10425 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:54.297544 10361 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
W20260709 13:15:54.297690 10382 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:15:54.299422 10241 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.252444 10416 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.301663 10357 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:54.306604  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53946.2us
I20260709 13:15:54.307807  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:15:54.294592 10404 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:15:54.321940  8764 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:54.350286  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:54.351788  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.354903  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:54.315250  9467 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:15:54.328625  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 151449us
I20260709 13:15:54.261940 10417 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.335619  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:54.274782 10359 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:15:54.305718  8762 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:54.271360 10410 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.204s
I20260709 13:15:54.375403  8807 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:54.378592  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:54.386834  8764 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.350454 10357 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.379638  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:54.381490  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:54.322006  8916 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:54.404181 10437 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:54.355204 10370 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:54.409755  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:54.412817  9826 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:54.413611  8764 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:54.414136  9826 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:54.414649  9826 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.415457  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:54.420085  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.362809 10358 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.420960  8839 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:15:54.432247  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.433482  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:54.422047  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.423571  8841 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:54.434732  8840 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.424419  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.384179 10405 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:54.426421  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:54.427038 10420 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 13:15:54.427361 10261 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:54.437668  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.438174  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:54.438294  8842 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.382670 10287 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.343267 10382 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.419323 10188 consensus_meta.cc:287] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.002s
I20260709 13:15:54.434350  8764 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:54.404722 10437 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.420117 10370 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:54.461539 10370 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.461710 10419 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.343344 10408 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.449313 10432 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:15:54.431511 10427 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:54.429685  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:54.481570  8762 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:54.456517  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:54.408444 10279 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:54.343863 10418 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.125s
W20260709 13:15:54.383534  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45674.6us
I20260709 13:15:54.399119 10290 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.375486 10345 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 13:15:54.467682 10373 consensus_meta.cc:287] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.003s
I20260709 13:15:54.430689 10125 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:54.470562 10276 consensus_meta.cc:287] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.000s
I20260709 13:15:54.408942 10362 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
W20260709 13:15:54.473905 10283 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.003s
I20260709 13:15:54.475387 10370 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.473927  8842 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:54.445267  9826 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.477607  9898 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.003s
I20260709 13:15:54.523190  9898 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.484778  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:54.354712 10306 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:54.490229  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 137466us
I20260709 13:15:54.494472  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:54.362293 10429 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.118s
I20260709 13:15:54.465032 10437 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:54.530051  9898 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.478807 10188 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.549264  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54887.2us
I20260709 13:15:54.550232  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:54.503334 10427 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.524591  8764 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:54.561805  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.491746 10270 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.525067  8909 raft_consensus.cc:2368] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4.
I20260709 13:15:54.525153  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:54.526408 10445 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:54.527823 10376 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.933s	user 0.015s	sys 0.004s
I20260709 13:15:54.556260  8807 leader_election.cc:400] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:15:54.573032  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:15:54.548004 10341 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.997s	user 0.012s	sys 0.000s
I20260709 13:15:54.521420  8840 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:54.523087 10276 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.549439 10261 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.504374 10373 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.581964  8768 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:54.547732 10366 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.004s
W20260709 13:15:54.583904 10439 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:15:54.583767 10261 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:15:54.575707 10248 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:54.505486 10345 consensus_queue.cc:1243] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:54.585978  9898 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:54.578991  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:54.576992 10449 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:15:54.577469  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 48538.4us
I20260709 13:15:54.623642  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:54.579433 10434 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:15:54.579520 10426 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:54.527297 10283 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.604763  8766 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:54.619098  9898 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.566310  8764 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:54.591087 10270 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:15:54.567374  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:54.627228  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 48339.7us
I20260709 13:15:54.635043  9898 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.578538  8917 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:54.581974 10287 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:54.615238 10438 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:15:54.630733  8836 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:54.636458 10287 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.639451 10287 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.580569 10370 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.584650  8835 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:54.576066 10125 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:15:54.607522 10424 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:54.641876  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 111066us
I20260709 13:15:54.592799 10372 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:15:54.582443 10276 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:54.620677 10443 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 13:15:54.621768  8768 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:54.574942 10419 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:15:54.667057 10370 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.667279 10419 consensus_queue.cc:1243] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:15:54.667739  9463 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.672s	user 0.011s	sys 0.000s
I20260709 13:15:54.667609 10370 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.612027 10405 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.669064 10405 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.670200 10283 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.671115 10300 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:54.671710 10373 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.650154  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1035) took 1075 ms. Trace:
I20260709 13:15:54.671725 10300 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.672477  8835 rpcz_store.cc:276] 0709 13:15:53.574911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.596710 (+ 21799us) service_pool.cc:224] Handling call
0709 13:15:54.103874 (+507164us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:15:54.650068 (+546194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11599616}
I20260709 13:15:54.643327 10274 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.673815 10274 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.674233 10300 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:54.674611 10415 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.715s	user 0.005s	sys 0.004s
I20260709 13:15:54.674819 10300 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:54.653116 10417 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.677922 10300 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:54.679368 10264 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.000s
I20260709 13:15:54.679783 10264 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.680238 10407 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.672s	user 0.014s	sys 0.011s
I20260709 13:15:54.659416  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:54.622579 10449 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:54.666169 10444 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:54.666028 10125 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:15:54.666038 10441 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:15:54.675016 10415 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.676184  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.676944  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.702242 10448 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.670539 10370 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.644807 10270 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:54.702788 10448 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.703800 10415 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.703524 10270 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.704088  8766 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.592671 10341 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.654590 10436 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:15:54.651656 10427 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.682904  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:54.683755  8841 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:54.718863  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.719911 10341 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.720278  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.682812  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.721158  8837 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:54.721716  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:54.722345 10447 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:15:54.682268  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.642151 10445 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:54.578235 10376 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.690516 10300 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:54.691008  8842 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:54.695966  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.668095  9463 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:54.699213  8844 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:54.660048 10372 consensus_queue.cc:1243] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:54.696359 10451 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.692263 10373 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.696838 10426 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:54.741904  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59096.1us
I20260709 13:15:54.686721 10407 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.707890 10236 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.027s	user 0.012s	sys 0.000s
I20260709 13:15:54.805317  8841 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:54.722345  8843 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.794368  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:54.799220  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 142) took 1049 ms. Trace:
I20260709 13:15:54.718269 10437 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.815174 10437 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.808588  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:54.812701  9463 rpcz_store.cc:276] 0709 13:15:53.749461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.751229 (+  1768us) service_pool.cc:224] Handling call
0709 13:15:54.799115 (+1047886us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.818454  8838 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:54.664047 10425 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:15:54.807188 10415 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:54.690438 10433 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:15:54.812873 10236 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.834015 10236 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.813145  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.837167  8840 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:54.843691  8843 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:54.845522  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:54.765916 10382 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.778007 10445 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:54.851855  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.854825  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.856369  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.856664  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.857601  8843 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:54.846299 10405 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:54.846307 10455 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:54.848608 10188 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.741323 10276 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:54.765488  8914 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:54.742134 10408 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.771656 10279 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.862480  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.864734  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.866379  8915 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:15:54.884532  8915 pending_rounds.cc:85] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:54.884898  8915 pending_rounds.cc:107] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:54.885046  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.885205  8915 raft_consensus.cc:2889] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.886138  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.867170  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.888235  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.889174  8913 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:54.890021  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.890841  8913 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:54.766146 10357 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:54.858695 10378 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.016s	user 0.010s	sys 0.001s
I20260709 13:15:54.873291  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.894553 10378 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.895262  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.896636 10378 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.896453  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.857843 10236 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:15:54.897855  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.898595 10357 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.898849  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.899075  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.893677  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.899935  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.875883 10455 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.876386 10304 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:54.880730  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:54.862768  8911 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:54.857894 10370 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.860176 10358 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:54.886521  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.806515  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.909955  8841 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.908183 10455 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.902987  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:54.904829  8912 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:54.916143  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:54.900791  8913 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:54.919559  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.920171  8913 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.878335 10276 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:54.803661 10451 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.871106 10448 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:54.908077 10396 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 1.504s	user 0.000s	sys 0.003s
I20260709 13:15:54.896404 10361 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:54.909523  8915 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:54.940126  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:54.908200 10376 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.932134  8913 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:54.906590 10304 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.942909  8915 pending_rounds.cc:85] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:54.943240  8915 pending_rounds.cc:107] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:15:54.943511  8915 raft_consensus.cc:2889] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.936528 10454 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:54.937755 10407 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.911306 10433 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:54.938302 10445 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.929522 10264 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:54.849462 10449 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.913499 10358 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.912760 10370 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:54.942317 10361 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.930477 10276 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:54.965378  9826 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.975557  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:54.977082  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:54.909621 10426 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:54.950749 10449 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:54.950133 10454 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:54.959805 10358 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.961959 10370 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:54.964040 10361 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.970547 10304 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:54.954381 10451 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:55.013684 10454 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:55.017774 10422 consensus_meta.cc:287] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.732s	user 0.013s	sys 0.000s
I20260709 13:15:55.018450 10422 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5.
I20260709 13:15:54.905339  8843 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:55.073223  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.074620  8763 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:55.075850  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.076632  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.077904  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.079017  8843 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:55.079105  8839 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:55.082571  8843 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:55.084271  8843 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.090224  8839 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:55.101454  8910 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:54.946141  8913 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:55.102962  8841 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:55.108198  8839 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: [1.3-4.4]
I20260709 13:15:55.110746  8915 pending_rounds.cc:85] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:15:55.125670  8915 pending_rounds.cc:107] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:15:55.126262  8915 raft_consensus.cc:2889] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:54.940500 10279 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.128157  9463 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.131966 10290 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:55.133206  8916 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:55.133136 10290 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.142490 10449 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:55.142705  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1037) took 1131 ms. Trace:
I20260709 13:15:55.143816 10449 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:55.146091  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.150130 10304 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.150921 10304 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:55.159706 10473 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:15:55.145768  8761 rpcz_store.cc:276] 0709 13:15:54.011431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.016711 (+  5280us) service_pool.cc:224] Handling call
0709 13:15:54.083841 (+ 67130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:54.302621 (+218780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.142031 (+839410us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002bfa54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:55.142501 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448135040}
I20260709 13:15:55.165934  8835 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:55.166500  8835 pending_rounds.cc:85] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 1
I20260709 13:15:55.166707 10259 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:55.168180  8843 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:55.167824 10259 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.166772 10304 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:55.166796  8835 pending_rounds.cc:107] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:55.172791  8835 raft_consensus.cc:2889] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.168838  9463 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:55.173921  9463 pending_rounds.cc:85] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 3
I20260709 13:15:55.176182  9463 pending_rounds.cc:107] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:15:55.178620  9463 raft_consensus.cc:2889] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:55.180150  8838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1037) took 1604 ms (client timeout 2015 ms). Trace:
I20260709 13:15:55.172281 10449 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:55.181206  8838 rpcz_store.cc:269] 0709 13:15:53.575555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.593390 (+ 17835us) service_pool.cc:224] Handling call
0709 13:15:55.179664 (+1586274us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540039dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:55.179945 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618991872}
I20260709 13:15:55.189772 10454 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:55.191327 10454 consensus_queue.cc:1243] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:15:55.211251 10241 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.212500 10241 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.221751 10449 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.223295 10241 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.224434 10449 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:55.225095 10449 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:55.211344 10259 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:55.212630  9464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 141) took 1464 ms (client timeout 1635 ms). Trace:
I20260709 13:15:55.227078 10449 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:55.226595  9464 rpcz_store.cc:269] 0709 13:15:53.748550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.753016 (+  4466us) service_pool.cc:224] Handling call
0709 13:15:55.212104 (+1459088us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400650254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:55.212378 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2420384512}
I20260709 13:15:55.231709  9463 pending_rounds.cc:85] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 2
I20260709 13:15:55.232316  9463 pending_rounds.cc:107] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:15:55.232991  9463 raft_consensus.cc:2917] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:15:55.233799  9463 raft_consensus.cc:2889] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:55.238605  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.239182 10363 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:55.242568 10363 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:55.246388 10363 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.240679 10417 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:55.235234 10287 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:55.251433 10449 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.250133 10417 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:55.257112  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.258033 10363 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.258579  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.267282  9464 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:15:55.268291  8760 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:55.268903  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1033) took 1259 ms (client timeout 1639 ms). Trace:
I20260709 13:15:55.266563 10417 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:55.269418  8760 rpcz_store.cc:269] 0709 13:15:54.009952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.016533 (+  6581us) service_pool.cc:224] Handling call
0709 13:15:55.258158 (+1241625us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b5800002d98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:15:55.268770 (+ 10612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49852160}
I20260709 13:15:55.270141 10417 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.274230  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:55.274821 10362 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:15:55.266521  8837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1045) took 1669 ms (client timeout 2020 ms). Trace:
I20260709 13:15:55.275477 10362 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:15:55.275593  8837 rpcz_store.cc:269] 0709 13:15:53.597406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.612183 (+ 14777us) service_pool.cc:224] Handling call
0709 13:15:55.266040 (+1653857us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54001e5d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:55.266302 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546773888}
I20260709 13:15:55.258067 10287 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.285876  8760 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:55.290030 10362 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.292362 10362 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.298630 10428 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:55.299219 10428 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:55.315016 10435 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.856s	user 0.003s	sys 0.000s
W20260709 13:15:55.315183  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.301108 10276 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.308009 10259 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:55.321314  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.326931 10300 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:55.326781  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:55.327762 10300 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.328253 10274 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.328799 10290 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.330093 10300 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:55.331043  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.343103 10300 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:55.300611 10428 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.345185  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.343950 10300 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.372514  8915 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:55.375128 10418 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.375661 10428 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.375942 10418 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.379637  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.383447  9462 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:15:55.384665  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.384958 10366 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:55.385968 10300 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.385851 10366 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.389115  9464 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEARNER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:55.375128  8766 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:15:55.391834 10479 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:15:55.372514  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.393240 10454 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.393826 10454 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.394304 10454 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.393826  8761 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.389575  8914 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:55.397359 10188 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 13:15:55.408021 10450 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.720s	user 0.005s	sys 0.000s
I20260709 13:15:55.408427  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.409524  8842 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:55.410547  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.411216  9466 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:55.407251  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:55.401754 10418 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:55.421231  8911 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:55.421707  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.422595  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.427500  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:55.437115 10366 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:55.441826 10287 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.441732  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.443127  8768 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:55.444176 10188 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:55.444761 10188 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:55.445307  8917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1311) took 1248 ms (client timeout 1656 ms). Trace:
I20260709 13:15:55.445983 10188 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.447041 10290 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.447963 10366 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:55.448612 10307 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:15:55.449735  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.445840  8917 rpcz_store.cc:269] 0709 13:15:54.196697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.196845 (+   148us) service_pool.cc:224] Handling call
0709 13:15:55.425475 (+1228630us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540031ae54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:55.445087 (+ 19612us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866695936}
I20260709 13:15:55.458563  8840 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:55.458846  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.460464  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.461350  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 983) took 1296 ms. Trace:
I20260709 13:15:55.462416  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:55.463462 10274 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.464397 10274 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:55.464524 10259 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:55.464956 10274 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:55.465307 10259 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.466229 10274 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.467197 10433 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:55.467595 10433 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:55.470166  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.470813  8842 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:55.462319 10345 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:55.489661  8917 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:55.461772  8762 rpcz_store.cc:276] 0709 13:15:54.164964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.571022 (+406058us) service_pool.cc:224] Handling call
0709 13:15:54.598463 (+ 27441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.598652 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:54.598903 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:15:55.264518 (+665615us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b180024d000. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a 00007fce6fda4a2a
0709 13:15:55.400567 (+136049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:55.415242 (+ 14675us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:55.431360 (+ 16118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:55.456401 (+ 25041us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:55.461171 (+  4770us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17555,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":286,"raft.queue_time_us":2921,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":19200,"spinlock_wait_cycles":33523200,"thread_start_us":69138,"threads_started":1,"wal-append.queue_time_us":828697}
I20260709 13:15:55.468502 10433 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:55.496359 10481 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.055s	user 0.003s	sys 0.001s
I20260709 13:15:55.496598 10433 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.457002 10300 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:55.503456  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.503334 10300 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:55.473812 10418 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:55.508693  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:55.509274  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.475611  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.516717  8764 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:55.517349  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:15:55.520068  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.522442  8760 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.525811 10307 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:55.526275 10306 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:55.526635 10307 consensus_queue.cc:1243] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:15:55.527303  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.527948  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.527211 10306 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:55.530942 10306 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:55.507597 10300 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.508376 10418 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:55.538370  8768 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:55.512375  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.545302  8762 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.537873 10418 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:55.559371  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.562556  8766 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:55.562969  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.562480  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.573745  8765 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.544893 10287 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:55.540032 10306 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.577153  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:55.581965  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.583124  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.584030  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1304) took 1393 ms. Trace:
I20260709 13:15:55.578755  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.585114  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.588138  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.563215 10276 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:55.595695  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.596624  8842 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:15:55.586562  8909 rpcz_store.cc:276] 0709 13:15:54.190373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.190657 (+   284us) service_pool.cc:224] Handling call
0709 13:15:55.574279 (+1383622us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540026d754. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:55.583830 (+  9551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764593920}
I20260709 13:15:55.603375  8764 raft_consensus.cc:2410] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:55.611001  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.614212  8916 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: [1.3-4.4]
I20260709 13:15:55.614861  8910 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:55.611124  8767 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:55.616216  8836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1044) took 2025 ms (client timeout 1816 ms). Trace:
W20260709 13:15:55.620806  8836 rpcz_store.cc:269] 0709 13:15:53.591168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.615302 (+ 24134us) service_pool.cc:224] Handling call
0709 13:15:55.615814 (+2000512us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54004119d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:55.616032 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312665984}
I20260709 13:15:55.613243  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.611228  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:55.624735  8912 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.616235  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.610586 10426 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:15:55.610724  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.625206  8764 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:55.609438  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.638875  8761 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:55.640457  8761 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:55.641497 10407 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:55.643187  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.634657  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.614984 10279 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:15:55.658902  8761 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:15:55.661049  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.661984  8769 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:55.664099  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.664849  8768 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.668054 10300 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.669353  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.673256  8838 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:55.676095  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:55.677258  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.677541  8768 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:55.647532  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:55.683364  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:55.689370  8917 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:55.690510  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.650524 10306 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.694242  8766 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:55.691362  8768 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:55.698860  8762 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:55.701584  8843 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:55.715310  8765 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
W20260709 13:15:55.716504  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.721042  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:55.678781  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 65631.5us
I20260709 13:15:55.716974 10362 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:55.742368  8843 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:55.744396 10445 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:15:55.746307  8913 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:15:55.747645 10296 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.748200 10296 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.750391 10296 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:55.751276  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45267.5us
I20260709 13:15:55.742885  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.765046 10276 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.767305  8769 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:55.765498 10300 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.767107  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:55.774027  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 146031us
I20260709 13:15:55.776607  8769 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:55.778379  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.779511  8767 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:55.781396  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 126445us
I20260709 13:15:55.775055 10454 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.783739  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.742147 10362 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:15:55.771984 10417 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.003s
I20260709 13:15:55.790208  8844 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:55.791884  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:55.793242 10360 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:55.793843 10360 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.795987 10360 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:55.797017  8762 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:55.774216 10296 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:55.797828  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.804018  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.818755  8912 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:55.822877  8769 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:55.798643 10362 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.828722  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.811630  8760 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:55.830780 10455 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:55.831925 10486 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:15:55.798158 10296 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:55.834586  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 91787.6us
I20260709 13:15:55.835947  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:55.838235 10487 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:15:55.838637 10407 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.840607  8764 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:55.841148  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.842100  8768 raft_consensus.cc:2410] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:55.841981  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.842715  8764 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:55.843318 10408 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:55.844944  8763 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:55.845664 10300 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:55.846499  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:55.846829  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 60472us
I20260709 13:15:55.847649  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.851235 10300 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:55.854835  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.856295  8765 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:55.863678  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:55.864650  9464 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:55.865453  8663 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 3, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.867121  9461 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:55.868609  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.869189 10366 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:15:55.869516  8762 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:55.871363  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 92) took 11248 ms. Trace:
I20260709 13:15:55.871865  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:55.873268  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48082.4us
I20260709 13:15:55.874313  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:55.875226 10400 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:15:55.868088  8663 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 2 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:55.875631 10400 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:55.876714 10400 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.877496 10445 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:55.877987 10400 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:55.878139 10445 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:55.879254 10445 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.881960 10454 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:55.873334  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 49572.4us
I20260709 13:15:55.883255  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:55.884349  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:15:55.884703  9466 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:55.885120  9466 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:55.885823 10259 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.888476 10259 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.809302 10360 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:55.889601  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 61401.8us
W20260709 13:15:55.893517  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57634.1us
I20260709 13:15:55.886092  9466 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:55.899617  9466 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:55.841189  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.901957 10360 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.912595  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.913520  8763 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:55.916071 10259 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:55.911876 10366 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:15:55.916929 10259 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:55.836699 10296 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.914899  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:55.927924  8767 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:55.927670  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:55.928473  8766 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:55.871786  8665 rpcz_store.cc:276] 0709 13:15:44.623684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:44.624585 (+   901us) service_pool.cc:224] Handling call
0709 13:15:46.170439 (+1545854us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:55.871125 (+9700686us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:52.840331 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:52.985275 (+144944us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:52.985311 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:15:52.985332 (+    21us) tablet.cc:662] Decoding operations
0709 13:15:52.985946 (+   614us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:52.986009 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:52.986040 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:15:52.986456 (+   416us) tablet.cc:701] Row locks acquired
0709 13:15:52.986471 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:15:52.986624 (+   153us) write_op.cc:270] Start()
0709 13:15:52.986735 (+   111us) write_op.cc:276] Timestamp: P: 1783602952986576 usec, L: 0
0709 13:15:52.986756 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:15:52.987398 (+   642us) log.cc:844] Serialized 1735 byte log entry
0709 13:15:53.409870 (+422472us) op_driver.cc:464] REPLICATION: finished
0709 13:15:53.438319 (+ 28449us) write_op.cc:301] APPLY: starting
0709 13:15:53.438455 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:53.438667 (+   212us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:53.438865 (+   198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:53.439533 (+   668us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:53.439777 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:15:53.439843 (+    66us) write_op.cc:312] APPLY: finished
0709 13:15:53.440198 (+   355us) log.cc:844] Serialized 40 byte log entry
0709 13:15:53.440498 (+   300us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.440631 (+   133us) write_op.cc:454] Released schema lock
0709 13:15:53.440692 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:53.453497 (+ 12805us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:53.453654 (+   157us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1022131,"reported_tablets":10,"spinlock_wait_cycles":832286976,"child_traces":[["op",{"apply.queue_time_us":28167,"apply.run_cpu_time_us":3044,"apply.run_wall_time_us":15152,"num_ops":4,"prepare.queue_time_us":186270,"prepare.run_cpu_time_us":27530,"prepare.run_wall_time_us":286778,"raft.queue_time_us":118678,"raft.run_cpu_time_us":12485,"raft.run_wall_time_us":27130,"replication_time_us":422972,"thread_start_us":369776,"threads_started":4,"wal-append.queue_time_us":198604,"wal-append.run_cpu_time_us":23499,"wal-append.run_wall_time_us":1253866}]]}
I20260709 13:15:55.932189  8768 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:15:55.936311 10276 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:55.939424  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:55.941201 10296 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:15:55.941285  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58133.1us
I20260709 13:15:55.945242  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:55.954926  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46340.8us
I20260709 13:15:55.956801 10259 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:55.960300  9464 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:15:55.969007 10400 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:55.877537  8663 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:55.975630  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.981700 10418 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:55.983906  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.984270 10418 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:55.985253  8836 raft_consensus.cc:2368] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 6.
I20260709 13:15:55.989593 10307 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:55.990290  8762 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:55.998739  8764 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:56.018193  8768 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
W20260709 13:15:56.019702  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 74530.4us
I20260709 13:15:56.019286  9466 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:15:56.021203  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65287.9us
I20260709 13:15:56.022243  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:56.045351  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.047712 10339 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:56.048031  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.048987 10279 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.049733 10279 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:56.049952 10455 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:56.051038 10279 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.052788 10290 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:15:56.048305 10339 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:55.993655 10307 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:56.056222  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.057483  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.065132 10360 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:56.066463  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:56.067297  9466 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.017324 10417 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:15:56.069561  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 126319us
I20260709 13:15:56.068065 10339 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:56.080839  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.091301  9466 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:15:56.055352 10287 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:15:56.058400 10276 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:15:56.075860 10188 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:56.103359  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47257.8us
W20260709 13:15:56.127300  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.128612  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.083536 10360 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.092682 10454 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:15:56.127349  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 48686.2us
W20260709 13:15:56.139873  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.140312  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 147797us
W20260709 13:15:56.143981  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 259686us
W20260709 13:15:56.145578  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 64832.2us
I20260709 13:15:56.147218  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:55.976392  8663 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:15:56.167918  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.172049  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.153492 10426 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:15:56.196744  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 118177us
I20260709 13:15:56.197324  9466 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:15:56.172600 10362 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:56.230924  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.234251  8761 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:15:56.199026  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51873us
W20260709 13:15:56.203665  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.194183 10408 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:56.276412 10296 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.276543  8882 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.277210 10296 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.277750 10515 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:56.278306 10515 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:56.280588 10296 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:56.281234  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.281337  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:56.283021  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 124945us
W20260709 13:15:56.272830 10507 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:15:56.202669 10426 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:56.307188  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109417us
I20260709 13:15:56.220018 10276 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:15:56.300807 10296 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.279254 10515 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.289561 10366 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:15:56.319794  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:56.315411  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.239146 10451 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:15:56.313424 10455 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:56.321519 10296 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:56.325493 10445 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:15:56.328249 10276 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:15:56.328356  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.281931 10408 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:15:56.291762 10345 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:15:56.347200  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65942.9us
I20260709 13:15:56.331668 10451 consensus_queue.cc:1243] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:15:56.359772  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59019.7us
I20260709 13:15:56.269377  8663 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:15:56.346493 10362 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:56.341241 10276 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:56.372134  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60667.4us
I20260709 13:15:56.382357  9466 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:15:56.376696  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.353746 10506 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:15:56.386159  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 237622us
I20260709 13:15:56.358003 10455 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:56.381371  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.354584 10360 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.384027 10499 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:15:56.393386 10498 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:15:56.387965 10407 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
W20260709 13:15:56.394375 10514 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:15:56.393429 10276 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:56.395390 10512 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:15:56.389259 10506 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:56.416481  9464 pending_rounds.cc:85] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 5
I20260709 13:15:56.416922  9464 pending_rounds.cc:107] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:56.417181  9464 raft_consensus.cc:2889] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:56.417348 10506 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.385624 10428 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.395664 10455 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.396689  9825 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.397003 10287 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.394313 10360 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.429467  9825 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:56.391734  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:15:56.402040  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73756.1us
I20260709 13:15:56.408955 10296 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.412209 10523 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.418674 10506 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:56.420709  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52022.7us
W20260709 13:15:56.437852  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 46799.6us
I20260709 13:15:56.438203  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.438549  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:56.388737 10426 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.448027  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:56.457031 10525 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.436439 10287 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:56.444216 10276 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.457983 10522 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:56.458729 10522 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:56.458523 10287 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.461167 10345 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.461683 10345 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:56.443882 10428 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:15:56.462649 10428 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:15:56.463419 10521 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 13:15:56.463691 10428 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.462062 10345 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.456565  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:56.467043  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.464062  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.445076  9825 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.471093  8735 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:56.477253 10362 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.477425  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.477872 10362 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:56.478394 10362 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.479202 10414 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.479609  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.480027 10414 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.480681 10414 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:56.481122 10259 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.488356  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.492007  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:56.494143  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:56.464876 10241 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:15:56.492769  8840 raft_consensus.cc:2376] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4. Re-sending same reply.
I20260709 13:15:56.501011  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:56.501618  8844 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:56.503160  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:56.473289 10523 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.422899 10307 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.504587  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:56.506863  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:56.510358  8841 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:56.515826  8735 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.517889 10307 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:56.521839  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:56.522637 10360 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:56.443966  8663 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.524178  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:56.525354  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:56.525084  8663 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 3, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.526226  8838 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:56.526993  8663 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 2, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 2 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:56.529140  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:56.530754 10519 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:56.531293 10519 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:56.522706  8835 raft_consensus.cc:2376] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4. Re-sending same reply.
I20260709 13:15:56.534010 10241 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:56.534425 10241 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:56.514431 10300 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.536576 10300 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.473440 10274 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:15:56.538131 10274 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:56.538486 10274 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:56.538898 10300 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:56.539479  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:56.539407 10274 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.540831  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:56.542100  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:56.542641 10454 raft_consensus.cc:1064] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
W20260709 13:15:56.543092 10454 raft_consensus.cc:1068] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Unable to promote non-voter 3b34c95a175945b88b17f07fbc650abf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:56.460268 10522 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.530857 10339 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.540742 10274 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.503772 10504 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
W20260709 13:15:56.514635  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 175136us
W20260709 13:15:56.682139  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.718271  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 230019us
W20260709 13:15:56.653995  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.589764  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 195750us
W20260709 13:15:56.629757  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 106234us
I20260709 13:15:56.568724 10360 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.733510 10360 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:56.734193 10536 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:15:56.736263  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.737810 10414 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:56.740252 10451 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.741201 10525 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:15:56.741904 10360 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:56.742213  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:56.744763  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.745095 10532 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.745674  8835 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:56.676549 10523 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.617848 10433 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.121s	user 0.019s	sys 0.004s
W20260709 13:15:56.678313 10188 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.008s
W20260709 13:15:56.752766  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.747504 10414 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:56.628638  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:56.567966 10345 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.757012  9825 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.759034  9466 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:15:56.794936  9466 pending_rounds.cc:85] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 5
I20260709 13:15:56.795235  9466 pending_rounds.cc:107] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:15:56.795643  9466 raft_consensus.cc:2889] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:15:56.658013  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 144899us
I20260709 13:15:56.797133  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:56.633284 10259 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.660418  8844 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:15:56.766970  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.653090 10408 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.802117  8840 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:56.676302 10531 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:56.794219  9825 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
W20260709 13:15:56.824662  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 82536.5us
I20260709 13:15:56.825531  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.777557 10455 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.566540  8663 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:15:56.832114  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58208.3us
I20260709 13:15:56.838593  8735 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:56.792999 10188 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.841339  9825 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:56.762405 10451 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.791610 10454 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:56.848470  8735 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:56.850349  8909 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:56.806136 10360 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.774674 10532 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.830212 10433 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:56.830727 10543 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:56.847497 10531 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:56.846673 10300 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.843010 10276 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:56.799762 10523 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.885624  8913 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:56.895088  8912 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:15:56.890250  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:56.829681 10408 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.844725 10362 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.909983  8909 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:56.918627 10541 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:56.919193 10541 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.919566 10541 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:56.920336 10528 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.199s	user 0.000s	sys 0.002s
I20260709 13:15:56.921010  8918 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:56.923360 10259 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:15:56.851604 10455 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.876487 10339 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:56.931999  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 106553us
I20260709 13:15:56.908658 10360 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.940259  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:56.908969 10544 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:56.871869 10454 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.962762  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:56.941200  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.969209  8840 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:56.967185  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:56.971869  8913 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:56.871537 10414 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.877866 10543 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.972735  8909 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:15:56.973973 10539 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:15:56.974085 10296 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:56.938560 10287 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:15:56.976184 10455 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:56.967185  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:56.977545  8918 raft_consensus.cc:2410] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:56.977634 10451 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:56.979103  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:56.979645 10546 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:15:56.935549 10276 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:56.981254 10524 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.452s	user 0.002s	sys 0.000s
W20260709 13:15:56.982595 10538 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:56.982998 10276 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:56.983114 10454 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:56.983866 10511 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:56.964238 10241 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.984464 10511 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:56.984967 10241 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:56.979332 10408 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:56.971740  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:56.889995 10300 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:56.945394 10360 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:57.005286  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 156891us
W20260709 13:15:57.013101  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62774.3us
W20260709 13:15:57.017659  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.985882 10362 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:57.032171  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.026005  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:57.034852  8841 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:15:57.041900  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 73794.7us
I20260709 13:15:57.010459 10360 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.044214  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:57.085311  8909 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:15:57.011682 10433 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:57.085590  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.083726  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.013151 10296 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:57.084406  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 138966us
I20260709 13:15:57.104769  8913 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:57.093200  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.107236  8917 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:57.048657 10188 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.110370  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.159960  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:56.970350 10544 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.092690 10345 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.177330  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.178305  8917 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:15:57.179942  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 214236us
W20260709 13:15:57.182067  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83229.2us
W20260709 13:15:57.158167  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 114058us
I20260709 13:15:57.183314  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:57.184257  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:57.195722  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.196153  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:57.197027  8909 raft_consensus.cc:2410] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:15:57.202800  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 159869us
I20260709 13:15:57.210687  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:57.210700  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:57.211958  8912 raft_consensus.cc:2410] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:57.225926  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.169817 10188 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.199002  8911 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.013211 10531 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.242101  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.214900 10366 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:57.231719 10532 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.258126  8915 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:57.258225  8909 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.259347  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:57.260069  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 75919.5us
I20260709 13:15:57.264389  8912 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:15:57.276302 10540 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:15:57.277026  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:57.281347 10557 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:57.281560 10559 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:57.282063 10559 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:57.283452 10572 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:15:57.285184  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45784.3us
I20260709 13:15:57.282014 10557 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.304581  8912 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:57.284323 10188 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:57.263339 10345 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:57.261669 10523 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:57.284828 10307 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.000s
I20260709 13:15:57.311925  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.292904 10511 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.320451 10573 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.321013 10573 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:57.321381 10573 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:57.310896 10506 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.871s	user 0.009s	sys 0.003s
I20260709 13:15:57.278151 10551 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:57.261945 10366 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.326815  9466 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:15:57.338138  9466 pending_rounds.cc:85] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 5
I20260709 13:15:57.338701  9466 pending_rounds.cc:107] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:15:57.339049  9466 raft_consensus.cc:2889] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.335790  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.341084  8917 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:57.331120  8912 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:57.343402  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:57.308400 10559 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.311681 10548 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.353010  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:57.355960  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.332231 10296 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:57.371527  8911 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:57.377852 10558 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.354511 10551 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.380287 10551 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.332592 10345 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:15:57.374176 10274 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.756s	user 0.015s	sys 0.004s
W20260709 13:15:57.399714  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46876.4us
I20260709 13:15:57.373124 10567 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.405941 10576 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:57.406584 10567 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.406733 10576 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.361147 10296 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.410297 10300 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:57.433236 10300 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.377854 10574 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.431532  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:57.433844 10300 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.437470  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.438156  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.446671  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:57.447247  8909 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:57.447547  9468 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:15:57.442135 10576 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.448892  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:57.403013 10307 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:57.440908  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:57.409396 10515 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:57.441357 10345 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.439518 10543 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:57.458376  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 181439us
I20260709 13:15:57.454792  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.434723 10296 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.463191  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:57.472829  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:57.460306 10287 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.460845 10544 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.374306 10548 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.403493 10519 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.463918  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.502658 10523 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:57.521651 10523 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.522109 10523 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:57.460116 10307 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.529480  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.517372 10544 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.517885 10567 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.472999 10558 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:15:57.505234 10576 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:15:57.551877 10541 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 13:15:57.552459 10541 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.552971 10517 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:15:57.553653 10517 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.554167 10517 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:57.554303 10366 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.556836 10307 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.457703 10574 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.564077 10580 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:57.513999 10287 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.563097 10290 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.573372 10519 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.569141 10557 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.617400 10583 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.656136  8767 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:57.569702 10544 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.661998  8762 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:15:57.651425  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.665076  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:57.673779  8768 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:15:57.673943  8761 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.676265  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.582238 10290 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.679647  8767 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:57.572934 10580 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.686655  8764 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:57.688941  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:57.689742  8768 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.666009 10541 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.670904 10454 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.735831 10454 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:57.740315 10360 consensus_meta.cc:287] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.647s	user 0.004s	sys 0.008s
I20260709 13:15:57.742337  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:57.743059 10454 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.745927 10455 raft_consensus.cc:1064] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
W20260709 13:15:57.746464 10455 raft_consensus.cc:1068] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Unable to promote non-voter 3b34c95a175945b88b17f07fbc650abf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:57.694504 10558 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.695295  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.707587 10544 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.709443 10566 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:57.711319 10559 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.765656 10559 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.767875 10559 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.715389 10574 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.768672  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:57.748950 10360 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.770215  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:57.771478 10527 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.234s	user 0.000s	sys 0.009s
I20260709 13:15:57.771727 10360 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:57.716651 10407 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:57.717495 10290 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:57.717705  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.773866  8918 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:57.773485 10407 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.718744 10287 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:57.720674 10537 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.858s	user 0.008s	sys 0.000s
I20260709 13:15:57.723330 10414 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:57.724346 10241 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.739s	user 0.013s	sys 0.006s
I20260709 13:15:57.727980  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1099) took 1197 ms. Trace:
I20260709 13:15:57.734725 10580 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:57.653995 10583 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.669618  8760 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:15:57.789096  8760 pending_rounds.cc:85] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 3
I20260709 13:15:57.789456  8760 pending_rounds.cc:107] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:15:57.789711  8760 raft_consensus.cc:2889] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.790382 10583 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:57.791244  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.791095  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:57.791714  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.792037  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.792454  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:57.716470 10550 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.622s	user 0.002s	sys 0.000s
I20260709 13:15:57.774787  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1097) took 1244 ms. Trace:
I20260709 13:15:57.806778 10554 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:57.807066  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1088) took 1324 ms. Trace:
I20260709 13:15:57.807372 10554 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:15:57.807508  8837 rpcz_store.cc:276] 0709 13:15:56.483071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.483356 (+   285us) service_pool.cc:224] Handling call
0709 13:15:56.498894 (+ 15538us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.751685 (+252791us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:56.792318 (+ 40633us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.029166 (+236848us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.047744 (+ 18578us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.047933 (+   189us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:57.047984 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.048076 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.585594 (+537518us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b180034ca80. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f
0709 13:15:57.654046 (+ 68452us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b48001d01d8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:15:57.715704 (+ 61658us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:57.806833 (+ 91129us) raft_consensus.cc:1685] finished
0709 13:15:57.806852 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.806982 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88614,"prepare.queue_time_us":31269,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":235922,"raft.run_cpu_time_us":7787,"raft.run_wall_time_us":734104,"spinlock_wait_cycles":305148416,"thread_start_us":363943,"threads_started":3,"wal-append.queue_time_us":177778}
I20260709 13:15:57.809863  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1094) took 1280 ms. Trace:
I20260709 13:15:57.809998  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:57.810634  8837 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:15:57.810348  8835 rpcz_store.cc:276] 0709 13:15:56.529692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.842798 (+313106us) service_pool.cc:224] Handling call
0709 13:15:56.892308 (+ 49510us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:56.923955 (+ 31647us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:57.007879 (+ 83924us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.809338 (+801459us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.809540 (+   202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.809583 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:57.809628 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.809705 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.809811 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":365177,"prepare.queue_time_us":56062,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3355,"thread_start_us":404014,"threads_started":1}
I20260709 13:15:57.811735  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:57.812271  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:57.779389  8841 rpcz_store.cc:276] 0709 13:15:56.531020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.039472 (+508452us) service_pool.cc:224] Handling call
0709 13:15:57.104028 (+ 64556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.381477 (+277449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.381512 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.381560 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:57.381612 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.727675 (+346063us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b540039d5d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:57.727737 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.727906 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637506816}
I20260709 13:15:57.812831  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:57.771420  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.819041  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.821830  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:57.798210 10562 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:57.825377 10562 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.818703  8839 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:15:57.827131  8839 pending_rounds.cc:85] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 1
I20260709 13:15:57.801223 10563 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:57.801285  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:57.827385  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:57.827637 10563 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.827960 10562 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:57.814045  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:57.801875 10511 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.828792  8835 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:15:57.803177 10506 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.814222  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 630981us
I20260709 13:15:57.827399  8839 pending_rounds.cc:107] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:15:57.829617  8839 raft_consensus.cc:2889] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:15:57.793484  8838 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:57.814640  8760 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:15:57.812263 10549 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.727s	user 0.001s	sys 0.001s
I20260709 13:15:57.815546  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.806329  8836 rpcz_store.cc:276] 0709 13:15:56.530497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.008109 (+477612us) service_pool.cc:224] Handling call
0709 13:15:57.009579 (+  1470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.009795 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:57.034157 (+ 24362us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.773751 (+739594us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b180034ce40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:15:57.774206 (+   455us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.774388 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.774442 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:57.774495 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.774582 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.774722 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5119,"prepare.queue_time_us":30345,"prepare.run_cpu_time_us":4863,"prepare.run_wall_time_us":44286,"raft.queue_time_us":720081,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":198,"spinlock_wait_cycles":113513856,"thread_start_us":64791,"threads_started":1,"wal-append.queue_time_us":155640}
I20260709 13:15:57.814815 10566 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.826550  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:57.826853  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:57.793573 10433 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:57.730721 10296 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.829878  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:57.817602  8761 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:57.814405 10274 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:15:57.813539  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.790274 10418 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:57.814352  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:57.799201  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.749465 10455 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:57.829135 10511 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.849541  8917 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.837966 10506 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.855428  9462 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:57.859583  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:57.863019  9468 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.853410  8764 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:57.842707 10548 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:57.865931  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.871652  8767 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:57.852662 10407 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:57.872700  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:57.873548  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43782.1us
I20260709 13:15:57.808574 10554 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.862994 10583 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:57.780184 10558 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.860394 10418 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:57.883582  8768 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:57.880317  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.867087 10287 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:57.873950  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:57.910498  8844 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:15:57.894017  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.904623  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:57.939206  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.777138 10573 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.892251 10562 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:57.913162  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:57.878738 10274 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.918061  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1098) took 1387 ms. Trace:
I20260709 13:15:57.941783  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1091) took 1413 ms. Trace:
I20260709 13:15:57.946305  8768 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:57.911691 10541 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:57.911695  9434 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.028s	sys 0.041s
I20260709 13:15:57.867671 10455 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.916690 10554 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:57.912284 10433 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:57.956225  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:57.914072 10587 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.962136  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:58.026156  8917 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:57.939126 10408 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.918792 10515 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:58.013975  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:57.949678  8842 rpcz_store.cc:276] 0709 13:15:56.528720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.606423 (+ 77703us) service_pool.cc:224] Handling call
0709 13:15:56.658576 (+ 52153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:56.698167 (+ 39591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:56.698199 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:56.705188 (+  6989us) log.cc:844] Serialized 26 byte log entry
0709 13:15:56.861007 (+155819us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:56.861045 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:56.861126 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:57.811430 (+950304us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:57.919786 (+108356us) raft_consensus.cc:1685] finished
0709 13:15:57.919815 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.941713 (+ 21898us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17954,"raft.queue_time_us":26039,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":22085,"spinlock_wait_cycles":335417216,"thread_start_us":86031,"threads_started":1,"wal-append.queue_time_us":207245}
I20260709 13:15:57.911532 10505 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:15:58.015136  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:57.949442  8840 rpcz_store.cc:276] 0709 13:15:56.530757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.008353 (+477596us) service_pool.cc:224] Handling call
0709 13:15:57.023369 (+ 15016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.023596 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:57.457943 (+434347us) log.cc:844] Serialized 14 byte log entry
0709 13:15:57.917737 (+459794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.917792 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:57.917829 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.917886 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:57.918006 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23297,"prepare.queue_time_us":70024,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":20937,"raft.queue_time_us":12676,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":23213,"thread_start_us":817937,"threads_started":2}
W20260709 13:15:57.953763 10570 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.009s	sys 0.037s
I20260709 13:15:58.027675  8760 raft_consensus.cc:2410] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:58.021996  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65821.1us
I20260709 13:15:57.941833 10287 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.957994 10563 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:57.912746 10583 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.071195  8768 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:57.938655 10241 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:15:58.071318  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:57.942121 10551 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:15:57.958725 10274 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:58.078018 10570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.009s	sys 0.038s
I20260709 13:15:58.081214 10515 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:57.946256 10552 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 13:15:58.082609 10505 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:58.083105 10428 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:58.022644 10407 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.090385 10511 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.091269  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:57.958695 10541 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:58.079581 10523 consensus_meta.cc:287] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.005s
I20260709 13:15:58.073024 10414 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:15:58.082101 10582 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:15:58.110558 10558 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:58.016197  9434 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.028s	sys 0.041s
I20260709 13:15:58.117308  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.122731  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:58.124068  8914 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:58.029454 10433 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:57.962574 10542 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.141s
I20260709 13:15:58.103899 10408 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.015132 10418 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.142401  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.116482 10505 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:58.154798  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.031852 10587 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.103643 10563 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.128571 10580 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:58.162886  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:58.166560  8840 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:15:58.140403 10345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.003s	sys 0.012s
I20260709 13:15:58.145809 10573 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.168090  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.176785  8913 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:15:58.146075  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 769388us
I20260709 13:15:58.129846 10407 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.169399  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:58.139742 10523 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.179854  8764 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:58.183348  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:58.245869  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:58.244076  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.257592  8761 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:58.259822  8762 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:15:58.170769 10504 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:15:58.181957  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:58.178974 10345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.003s	sys 0.012s
I20260709 13:15:58.262941  8837 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.249739 10455 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:58.261469 10519 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.642s	user 0.011s	sys 0.000s
W20260709 13:15:58.263948 10586 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
W20260709 13:15:58.301470 10517 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.004s
I20260709 13:15:58.245769 10531 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.254778  8765 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.033s	sys 0.085s
W20260709 13:15:58.358793  8765 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.033s	sys 0.085s
I20260709 13:15:58.243716 10506 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:15:58.264897 10598 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 13:15:58.263501 10601 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:15:58.179944 10580 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:58.339845  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.178666 10563 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.302491  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:58.264117  9465 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:15:58.256417 10566 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:58.345252  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.346823  8761 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:58.300709  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 417858us
W20260709 13:15:58.347437  8763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.010s
W20260709 13:15:58.398701  8763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.012s	sys 0.010s
I20260709 13:15:58.261339 10296 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.373843  8910 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:58.377096  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:58.364575  8760 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.364759 10543 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.384765 10605 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:15:58.398371  8732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.554s (SENT) [suppressed 16 similar messages]
W20260709 13:15:58.407163  8732 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.656s (SENT)
I20260709 13:15:58.409176  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.410081  8764 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:58.411154  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.411900  8764 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:15:58.422443 10296 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.423003 10296 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.425376  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.425681 10296 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.426340  8761 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:58.427474  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.427582 10563 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.432204  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.438452  8761 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:58.300348 10505 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.396111 10287 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:58.453074 10573 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.453447 10408 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:58.435597  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:58.453634 10573 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.454360 10583 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:58.455343 10566 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.455909 10573 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.455974 10566 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:58.433164  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.365056 10517 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.443722  8837 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:15:58.445580 10593 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
W20260709 13:15:58.437144  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0479950409999219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:15:58.471833  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0133391649999339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
I20260709 13:15:58.446022 10523 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.372305 10531 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:58.447256 10599 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:15:58.404441 10274 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.447315 10587 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.463196 10566 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.434329 10543 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:58.485548  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.469416  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:58.425981 10580 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.487886  8837 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:58.492278 10511 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.493248 10606 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:15:58.482154 10519 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.498289  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.499117  8761 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
W20260709 13:15:58.466370  9468 consensus_meta.cc:287] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.004s
W20260709 13:15:58.452368 10586 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.080s	user 0.000s	sys 0.002s
I20260709 13:15:58.469134 10433 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.495951  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.501035  8767 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:58.500202  9468 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:58.473935  8764 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:58.492852 10511 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.488139 10274 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:58.488933 10407 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:58.472209 10610 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:15:58.532407  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.544101  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:58.548671  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.497418  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:58.553256  8764 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:58.557075  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.532153 10580 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.552502  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.567596  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.500788 10519 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.667618  8837 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:15:58.569672  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.552354 10306 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:58.672840  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 103271us
I20260709 13:15:58.674722  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.689863  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 279) took 1877 ms. Trace:
I20260709 13:15:58.701555  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.723834  9466 rpcz_store.cc:276] 0709 13:15:56.812046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.812279 (+   233us) service_pool.cc:224] Handling call
0709 13:15:56.813078 (+   799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.339596 (+526518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.689565 (+1349969us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b5400503cd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:58.689769 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1180651904}
I20260709 13:15:58.680536  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.680768  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.548417 10274 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.689234  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:58.733716 10522 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.560s	user 0.016s	sys 0.007s
W20260709 13:15:58.734143 10522 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.568s	user 0.016s	sys 0.007s
I20260709 13:15:58.734735  8843 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:15:58.729314  8762 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
W20260709 13:15:58.656948 10188 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.013s
I20260709 13:15:58.742733  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1027) took 1091 ms. Trace:
W20260709 13:15:58.745077 10188 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.013s
I20260709 13:15:58.750145 10517 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:15:58.750797 10609 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.009s
I20260709 13:15:58.751036  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.743145  8763 rpcz_store.cc:276] 0709 13:15:57.651050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.651241 (+   191us) service_pool.cc:224] Handling call
0709 13:15:57.663583 (+ 12342us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:15:57.674977 (+ 11394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.675007 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:15:57.688581 (+ 13574us) log.cc:844] Serialized 78 byte log entry
0709 13:15:58.399071 (+710490us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:58.731781 (+332710us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.741739 (+  9958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.742173 (+   434us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.742387 (+   214us) raft_consensus.cc:1685] finished
0709 13:15:58.742454 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.742674 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8157,"raft.queue_time_us":74358,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"thread_start_us":969802,"threads_started":2,"wal-append.queue_time_us":700432}
I20260709 13:15:58.752349  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.752995  8767 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:58.753412 10511 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.573164 10580 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.749311 10522 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:58.755786 10580 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.722738 10583 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.739979 10614 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.754240  8767 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:58.756820  8763 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.680968 10607 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:58.763931  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 62515.7us
I20260709 13:15:58.680786 10573 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:58.766961  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.744616 10605 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.765314 10522 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.769069  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.680420 10306 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.770416  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.770850 10522 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.771284 10306 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:58.771636  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.772541  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:58.775336  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:58.744541 10542 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.780700 10570 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:15:58.781456  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.757483 10614 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.784842  8732 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.785778 10604 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.786121 10614 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.786464 10604 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.787883  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.790377  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.791139  8763 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:58.755784 10543 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.778169  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.799496  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.809142  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:58.811604  8763 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.792897 10605 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.779871 10603 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.812197  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.793222 10573 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.817287  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:58.831996  9468 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:15:58.793171 10607 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:58.825832 10605 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:58.826865  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.829392 10274 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:58.816666 10580 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.801903 10604 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.810688 10587 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:15:58.833920  8840 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:15:58.841979  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.843006  8840 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:58.805608 10542 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:58.817472 10531 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:58.836473 10580 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.843604 10519 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:58.864995  8763 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:58.870016  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.870939  8763 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.887833  8763 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:58.890595  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.894451  8763 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:15:58.900120  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.889038 10580 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:58.903998 10616 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:15:58.906801  8842 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:58.901948 10300 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:58.918452  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:15:58.924438  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 112313us
I20260709 13:15:58.926154  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.928764  8842 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:15:58.928798  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:15:58.925486 10554 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.906s	user 0.013s	sys 0.000s
I20260709 13:15:58.932327  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:58.923300  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:58.922420  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.964098  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.934613  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.965063  8842 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:58.973497  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:58.976320  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:58.977717  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.979856  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:58.981180  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:58.930979 10607 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:58.974627  8842 raft_consensus.cc:2410] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:58.935722 10306 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:15:58.994658  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62409.5us
I20260709 13:15:58.993475 10562 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:58.995738 10519 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:58.948843  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:15:59.051154  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.067418  8768 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.001586 10274 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:15:59.002684 10554 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:58.996160 10625 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:59.022540 10619 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:15:59.060818  9464 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:15:59.022044 10519 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.137485 10519 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.141634 10620 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:15:59.020521  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:59.182461  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 162071us
I20260709 13:15:59.183216  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:15:59.122107  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 142344us
I20260709 13:15:59.060343  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.022193  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.022374 10306 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:15:59.023162 10612 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:15:59.205067 10306 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.203308 10566 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.716s	user 0.005s	sys 0.005s
I20260709 13:15:59.205801 10566 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.207896 10566 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:15:59.074923  9434 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 2.188s (SENT)
I20260709 13:15:59.197492 10506 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
W20260709 13:15:59.209378  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 144521us
I20260709 13:15:59.186487 10554 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:15:59.194363 10548 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.213508 10548 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:59.197265 10614 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:15:59.188482 10543 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:59.195371  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.216424  8835 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:59.200444  8768 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.208593  9460 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.217694  9464 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:15:59.218784 10548 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:15:59.221642 10580 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.223206  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.224185  8835 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:59.197614  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1026) took 1546 ms. Trace:
I20260709 13:15:59.225188 10515 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:59.225908 10515 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.227311  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1024) took 1605 ms. Trace:
I20260709 13:15:59.228418 10515 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:59.202133 10522 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:59.227682  8766 rpcz_store.cc:276] 0709 13:15:57.621718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.651978 (+ 30260us) service_pool.cc:224] Handling call
0709 13:15:57.664846 (+ 12868us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.090862 (+426016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.090901 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:58.106056 (+ 15155us) log.cc:844] Serialized 52 byte log entry
0709 13:15:58.517493 (+411437us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.749203 (+231710us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.779462 (+ 30259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.779536 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.225060 (+445524us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b180024ce20. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:15:59.227018 (+  1958us) raft_consensus.cc:1685] finished
0709 13:15:59.227121 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.227259 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268856,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":72753,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":28835456,"thread_start_us":1026823,"threads_started":3,"wal-append.queue_time_us":641542}
I20260709 13:15:59.229130 10515 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:59.229336 10522 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:59.211688  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 281) took 1390 ms. Trace:
I20260709 13:15:59.211920 10506 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:15:59.229728 10515 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.229912 10522 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.230316 10506 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.232161 10515 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:59.232441 10506 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.229944  9463 rpcz_store.cc:276] 0709 13:15:57.821739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.838705 (+ 16966us) service_pool.cc:224] Handling call
0709 13:15:57.872690 (+ 33985us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.890203 (+ 17513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.894384 (+  4181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:57.907692 (+ 13308us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:57.912672 (+  4980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.919663 (+  6991us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.211010 (+1291347us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b54005f0350. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:59.211625 (+   615us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20647680}
I20260709 13:15:59.212777  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:59.134418 10570 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.189123  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.189036  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1096) took 2651 ms. Trace:
I20260709 13:15:59.212808 10454 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.212493 10562 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:15:59.240927  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:59.240000  8839 rpcz_store.cc:276] 0709 13:15:56.530222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.859197 (+328975us) service_pool.cc:224] Handling call
0709 13:15:56.879568 (+ 20371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.843756 (+964188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.181352 (+1337596us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b54000ad554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:59.181557 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2158779776}
I20260709 13:15:59.229717 10428 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.225455  8769 rpcz_store.cc:276] 0709 13:15:57.650737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.654339 (+  3602us) service_pool.cc:224] Handling call
0709 13:15:57.668359 (+ 14020us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.144992 (+476633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.145035 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:58.261060 (+116025us) log.cc:844] Serialized 52 byte log entry
0709 13:15:58.725074 (+464014us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.907915 (+182841us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.908143 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.908205 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.197357 (+289152us) raft_consensus.cc:1685] finished
0709 13:15:59.197376 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.197534 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15285,"prepare.queue_time_us":60794,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":67155,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":3067,"thread_start_us":945693,"threads_started":3,"wal-append.queue_time_us":501852}
W20260709 13:15:59.253398  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 70255.2us
I20260709 13:15:59.255401  8842 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:15:59.232699 10522 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.224205 10580 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.260455  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.261644  8839 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:15:59.262729  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.266496  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.252640 10554 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:15:59.267907  8838 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:15:59.268903  8842 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:59.252241 10428 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:59.271343  8839 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:15:59.271340  8842 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:59.268795 10554 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.273701 10554 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:15:59.273635  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.274883  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:59.276924  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.247742 10519 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.280007  8839 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:15:59.281472  8844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1312) took 1488 ms (client timeout 1867 ms). Trace:
I20260709 13:15:59.250017 10570 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:15:59.283560  8844 rpcz_store.cc:269] 0709 13:15:57.798840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.800980 (+  2140us) service_pool.cc:224] Handling call
0709 13:15:59.281309 (+1480329us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b54002f21d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:59.281416 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99423488}
I20260709 13:15:59.285326 10570 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.287887  8839 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:59.274551 10188 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:15:59.271792 10287 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:15:59.265740 10306 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.289259  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.293220 10614 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:59.294485  9464 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:15:59.258399 10454 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.303994 10519 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.304054 10454 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:59.305917 10614 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:59.306483 10614 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:59.307739 10614 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.289505 10506 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:15:59.279520  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.340072 10614 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.308796 10623 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.476s	user 0.004s	sys 0.006s
W20260709 13:15:59.333729 10618 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.519s	user 0.002s	sys 0.006s
W20260709 13:15:59.346207 10624 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.484s	user 0.014s	sys 0.004s
W20260709 13:15:59.349200  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:15:59.338040  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 125) took 1849 ms. Trace:
I20260709 13:15:59.350381  8915 rpcz_store.cc:276] 0709 13:15:57.488816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.820302 (+331486us) service_pool.cc:224] Handling call
0709 13:15:57.820681 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.077169 (+256488us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:58.077411 (+   242us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.834076 (+756665us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b1800059bc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a 00007fce6fda4a2a
0709 13:15:58.970934 (+136858us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.971011 (+    77us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:58.971070 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.337670 (+366600us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54001d3654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:59.337759 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.337941 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22076,"prepare.queue_time_us":140,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":22617,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":20535,"spinlock_wait_cycles":507820800,"thread_start_us":101073,"threads_started":1,"wal-append.queue_time_us":947027}
I20260709 13:15:59.353191  8835 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:15:59.353950  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1103) took 1024 ms. Trace:
I20260709 13:15:59.354434  8835 rpcz_store.cc:276] 0709 13:15:58.338802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.258887 (+920085us) service_pool.cc:224] Handling call
0709 13:15:59.353864 (+ 94977us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.311125 10454 raft_consensus.cc:1064] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:59.318873 10306 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:59.320197  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1087) took 2837 ms. Trace:
W20260709 13:15:59.331630  8916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 126) took 1815 ms (client timeout 1870 ms). Trace:
I20260709 13:15:59.301977 10287 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:15:59.382557  8916 rpcz_store.cc:269] 0709 13:15:57.516142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.520660 (+  4518us) service_pool.cc:224] Handling call
0709 13:15:59.331257 (+1810597us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540026d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:59.331530 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2924628736}
I20260709 13:15:59.381620  8843 rpcz_store.cc:276] 0709 13:15:56.482784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.491750 (+  8966us) service_pool.cc:224] Handling call
0709 13:15:56.503264 (+ 11514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.735181 (+2231917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.319866 (+584685us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b5400415d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:59.320118 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5131553664}
W20260709 13:15:59.385104  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 119573us
I20260709 13:15:59.389757  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:59.390166  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.404982  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.407752  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.407985  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.408613  8915 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:15:59.410506  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.411162  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.412034  8916 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:59.422386  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.423389  8910 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:59.424491  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:59.384390 10454 raft_consensus.cc:1068] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Unable to promote non-voter 3b34c95a175945b88b17f07fbc650abf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:59.429536  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.430526  8915 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.430138  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.432926  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:59.387379  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48265.8us
I20260709 13:15:59.446208  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.450505  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.451217  8915 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:59.455721  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:59.390792 10554 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.456991  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.446530  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.389144 10563 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:15:59.475113  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.472599  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.473515  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.358953 10428 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:59.491220  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 104443us
I20260709 13:15:59.461855 10610 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.499505  8843 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:15:59.454857  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.506176  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:59.508965  8911 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.510735  8916 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.514739  8911 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:15:59.517508  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.518391  8843 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:15:59.519552  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:15:59.510797  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.513792 10642 raft_consensus.cc:1064] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:15:59.453501 10548 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.554760  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.555994  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.556952  8767 raft_consensus.cc:2410] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:15:59.557132 10644 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:15:59.557883  8836 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:15:59.560552  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.563284  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:15:59.538156 10626 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:15:59.564127  8918 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.565230  8843 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.568933  8843 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:15:59.541340  9463 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:15:59.575470  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:59.555994 10505 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.586723  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.586434  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:59.495234 10287 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.590546  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:15:59.589871  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 122540us
W20260709 13:15:59.560491 10642 raft_consensus.cc:1068] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Unable to promote non-voter 3b34c95a175945b88b17f07fbc650abf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:15:59.539026 10610 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:15:59.599349  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 138657us
I20260709 13:15:59.581679 10643 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:59.584245 10407 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:15:59.601315  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.625574  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.627787  8916 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:15:59.629858  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.630033  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:15:59.636389  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.627765  8911 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:59.641783  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.627429 10407 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.643306  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.645129 10407 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:59.645871  8916 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.650061 10408 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.650630 10408 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.650965 10408 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.653153  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.654068  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.654148  8914 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:15:59.655126 10407 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.655728 10407 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.656172 10407 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:15:59.656948 10645 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:15:59.658713 10559 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:59.659433  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1330) took 1184 ms. Trace:
I20260709 13:15:59.659832  8838 rpcz_store.cc:276] 0709 13:15:58.475127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.270706 (+795579us) service_pool.cc:224] Handling call
0709 13:15:59.281969 (+ 11263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.293311 (+ 11342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.293339 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.293806 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.422637 (+128831us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.422698 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.422800 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.659210 (+236410us) raft_consensus.cc:1685] finished
0709 13:15:59.659234 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.659372 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1359,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":128368,"threads_started":1,"wal-append.queue_time_us":253826}
I20260709 13:15:59.655544  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.662068  8914 raft_consensus.cc:2410] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:15:59.637099  8918 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:59.662990  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.664503  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.665223  8914 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:59.663094  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.666989  8918 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:15:59.668217  8918 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:15:59.675782 10548 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.676178 10428 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.676466  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:15:59.677170  9459 raft_consensus.cc:2376] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3. Re-sending same reply.
I20260709 13:15:59.674010 10407 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.681152  8916 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:59.682276 10407 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:59.682523 10542 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.682968 10407 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:59.686169 10408 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.666131  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.692166 10418 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.698652  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109350us
W20260709 13:15:59.699461  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.697862  9825 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:59.695247 10647 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:59.712037  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 165) took 2267 ms. Trace:
I20260709 13:15:59.634840 10642 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:15:59.715816  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.716281  8913 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:15:59.714133  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1124) took 1030 ms. Trace:
W20260709 13:15:59.717134 10650 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:15:59.633438 10515 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:15:59.722294 10408 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:15:59.702911 10543 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:59.712406  9467 rpcz_store.cc:276] 0709 13:15:57.441664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.443071 (+  1407us) service_pool.cc:224] Handling call
0709 13:15:57.458057 (+ 14986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.525640 (+ 67583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.525669 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.531186 (+  5517us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.954284 (+423098us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:15:57.954333 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.694830 (+1740497us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b540012d9d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:15:59.694879 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.694924 (+    45us) raft_consensus.cc:1685] finished
0709 13:15:59.694937 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.709014 (+ 14077us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7294,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":21812,"spinlock_wait_cycles":152611584,"thread_start_us":422647,"threads_started":1,"wal-append.queue_time_us":589775,"wal-append.run_cpu_time_us":3208,"wal-append.run_wall_time_us":1302304}
W20260709 13:15:59.723492 10627 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.808s	user 0.007s	sys 0.007s
I20260709 13:15:59.726919  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1068) took 1231 ms. Trace:
I20260709 13:15:59.728888 10541 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:59.729847  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 119) took 1299 ms. Trace:
I20260709 13:15:59.731947  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:15:59.745702  8761 rpcz_store.cc:276] 0709 13:15:58.430035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.774841 (+344806us) service_pool.cc:224] Handling call
0709 13:15:58.791982 (+ 17141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.792175 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:15:58.820272 (+ 28097us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.729576 (+909304us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.729640 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:15:59.729669 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.729715 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.729800 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":821762,"prepare.queue_time_us":29105,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":25,"raft.queue_time_us":812201,"thread_start_us":107541,"threads_started":1,"wal-append.queue_time_us":324730}
I20260709 13:15:59.734046  8839 rpcz_store.cc:276] 0709 13:15:58.683774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.288573 (+604799us) service_pool.cc:224] Handling call
0709 13:15:59.290244 (+  1671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:59.290378 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:59.427659 (+137281us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.713784 (+286125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.713845 (+    61us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:59.713890 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.713953 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.714079 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":212404,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":19479,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":418771,"threads_started":2}
W20260709 13:15:59.733405  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 74603.4us
I20260709 13:15:59.626667 10643 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.752918  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:59.753273  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.753650  8769 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.753834  8766 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:59.745503  8762 rpcz_store.cc:276] 0709 13:15:58.495393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.780955 (+285562us) service_pool.cc:224] Handling call
0709 13:15:58.795713 (+ 14758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.795908 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:58.826727 (+ 30819us) log.cc:844] Serialized 14 byte log entry
0709 13:15:58.914551 (+ 87824us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.726200 (+811649us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b1800391000. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:15:59.726420 (+   220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:59.726499 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:59.726566 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.726661 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.726840 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":842725,"prepare.queue_time_us":33015,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":78,"raft.queue_time_us":814414,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":3411,"spinlock_wait_cycles":25604608,"thread_start_us":86361,"threads_started":1,"wal-append.queue_time_us":195626}
I20260709 13:15:59.755662  9465 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:15:59.756074  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.757242  8764 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:15:59.757674  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:59.759285 10287 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:59.761008 10559 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:59.761428  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.762784  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.762636  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.763401  8762 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:59.763650  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1028) took 2111 ms. Trace:
I20260709 13:15:59.764791  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.765184  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:15:59.764015  8765 rpcz_store.cc:276] 0709 13:15:57.652316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.652465 (+   149us) service_pool.cc:224] Handling call
0709 13:15:57.664584 (+ 12119us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:15:58.359367 (+694783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.359415 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:15:58.379025 (+ 19610us) log.cc:844] Serialized 52 byte log entry
0709 13:15:58.765901 (+386876us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:15:58.819626 (+ 53725us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.040940 (+221314us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.308056 (+267116us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:15:59.763051 (+454995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.763200 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.763326 (+   126us) raft_consensus.cc:1685] finished
0709 13:15:59.763342 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.763496 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":742226,"prepare.queue_time_us":69093,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":78,"raft.queue_time_us":802946,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":266,"spinlock_wait_cycles":9067776,"thread_start_us":1222242,"threads_started":3,"wal-append.queue_time_us":406035}
I20260709 13:15:59.765909  8760 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.766333  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.767765  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:59.768000  8760 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.764325  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.769506  8762 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:59.770210  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:15:59.772447 10580 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.773373  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.773327 10580 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.776116 10580 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:59.777129 10604 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.777724 10604 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.778411 10604 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:15:59.780308  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.781131 10523 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:59.782375 10523 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:59.766397  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:15:59.790335  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.793358  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.794288  8839 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:59.783948 10523 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.796705  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.796975  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.797468  8836 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:15:59.800217  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129394us
I20260709 13:15:59.804777  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.805516  8761 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.763664  8767 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:15:59.809299  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.814392  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.815786  8836 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:15:59.747893 10607 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.776746 10580 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.818173  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:15:59.819834  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124389us
I20260709 13:15:59.827454 10610 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.814973 10408 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:15:59.828891 10428 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:59.829449 10428 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.829720  8911 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:15:59.830955 10418 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.831609 10428 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.831539 10418 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.832123 10555 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.832535 10555 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:59.841239  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:59.842136 10555 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.843365 10555 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.833127  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.844327  8764 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:15:59.844692  9464 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.834082 10607 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.847209 10607 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.816954 10554 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:15:59.834679  8840 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:59.849159  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 110) took 1080 ms. Trace:
I20260709 13:15:59.849392 10551 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:15:59.849650  8840 rpcz_store.cc:276] 0709 13:15:58.776813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.868705 (+ 91892us) service_pool.cc:224] Handling call
0709 13:15:59.848929 (+980224us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540021cd54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:15:59.849081 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199504640}
I20260709 13:15:59.850720 10551 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:59.851112 10551 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:15:59.851163  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.835130 10580 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.837205  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.838037  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:59.839898  8734 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:59.786927 10543 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.840652  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:15:59.870319  8839 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:15:59.804854 10454 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:59.858470  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:15:59.873417 10610 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.873785 10610 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:15:59.874156 10610 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.877065 10664 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:59.876528 10543 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:59.869532  8734 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:15:59.878609  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.861711  8769 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:15:59.852126 10551 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.893707  8765 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:15:59.894233  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.894362 10362 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:59.894474  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.894718 10665 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:59.894932  9462 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:15:59.895022 10362 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:15:59.895606 10407 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:59.896482 10362 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.897475 10551 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.898239 10664 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:59.899168 10664 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:15:59.899605 10610 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:15:59.894265 10408 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:15:59.891844  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:15:59.905738  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.892205  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.909798  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.913060  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:15:59.914198  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.914711 10607 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.915169 10562 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.915611 10562 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.915944 10562 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.916726 10414 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:15:59.917299 10414 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.917730 10414 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:59.920775  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:15:59.921536  9465 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:15:59.923090 10551 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.923666  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:15:59.914327 10418 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:59.868683 10505 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.828698 10643 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:15:59.913592 10543 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.928314  9462 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:15:59.933382 10614 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.004s
I20260709 13:15:59.939240  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:15:59.928521 10603 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:15:59.935524 10643 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:59.944460  8769 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:15:59.923617 10551 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:15:59.936674 10543 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:00.011986  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1074) took 1478 ms. Trace:
I20260709 13:15:59.939451  9464 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:16:00.012446  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:00.013780  8761 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.012420  8763 rpcz_store.cc:276] 0709 13:15:58.533851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.895429 (+361578us) service_pool.cc:224] Handling call
0709 13:15:58.902429 (+  7000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.902666 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:15:58.904392 (+  1726us) log.cc:844] Serialized 14 byte log entry
0709 13:15:59.952562 (+1048170us) log.cc:844] Serialized 14 byte log entry
0709 13:16:00.011587 (+ 59025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:00.011643 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:00.011687 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.011760 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.011904 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":690807,"prepare.queue_time_us":3849,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":690989,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":1920,"thread_start_us":356538,"threads_started":2,"wal-append.queue_time_us":236635}
W20260709 13:15:59.945091  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 174928us
I20260709 13:15:59.942302 10603 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.022471  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:00.036495  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:00.043499  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:15:59.945644 10643 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:15:59.999900  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:00.043937  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:00.011989 10551 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.015334 10543 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.051971  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.052469 10614 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.055135  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 268824us
I20260709 13:16:00.091336  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:00.038272 10428 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.077401 10580 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.078275 10610 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:00.081434  8838 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:00.127661  8837 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:16:00.128739  8837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1327) took 1734 ms (client timeout 1871 ms). Trace:
W20260709 13:16:00.088510  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 175544us
W20260709 13:16:00.187804  8837 rpcz_store.cc:269] 0709 13:15:58.394552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.749036 (+354484us) service_pool.cc:224] Handling call
0709 13:16:00.036254 (+1287218us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:00.128651 (+ 92397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12880128}
W20260709 13:16:00.093657  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 71279us
I20260709 13:16:00.091740  8761 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:00.062897 10638 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.096189  8882 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:00.193377  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 97304.4us
W20260709 13:16:00.097002  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45102.4us
I20260709 13:16:00.063428  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:00.101368 10418 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.090704 10562 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.099792 10523 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.102402 10636 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:00.102747 10287 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.104982 10428 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.106680 10640 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.089115  8835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40098
I20260709 13:16:00.096781 10614 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.085701 10603 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.117949 10643 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.098294  9465 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:00.105998 10604 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:00.091197  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 191818us
I20260709 13:16:00.082737  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:00.119280 10551 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.198884 10523 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.195900 10676 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.195247  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:00.196064  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 383157us
W20260709 13:16:00.196597  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 152767us
I20260709 13:16:00.194052  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:00.196334 10418 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:00.213536  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 130960us
I20260709 13:16:00.174170  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1118) took 1492 ms. Trace:
W20260709 13:16:00.250152  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 54945us
I20260709 13:16:00.304011  9432 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.250402  8735 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:00.290874  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:00.305435  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55116.5us
I20260709 13:16:00.287732  8838 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:00.249943  8844 rpcz_store.cc:276] 0709 13:15:58.681655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.284565 (+602910us) service_pool.cc:224] Handling call
0709 13:15:59.284882 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:59.285265 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:59.285292 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.285872 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.173422 (+887550us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b180034d500. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1
0709 13:16:00.173611 (+   189us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:00.173649 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.173732 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:00.173775 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:00.173787 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:00.174012 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1828,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8747,"spinlock_wait_cycles":5953280,"thread_start_us":13730,"threads_started":1,"wal-append.queue_time_us":95217}
I20260709 13:16:00.311261  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:00.312615  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 118640us
I20260709 13:16:00.291198 10664 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:00.313426 10504 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.209163 10287 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:00.253451 10418 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.214305 10570 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.313259 10683 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:00.248999  8835 raft_consensus.cc:606] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 13:16:00.212227 10640 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.249091 10643 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.318602  8735 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:00.215946 10362 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.314965  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.287672 10610 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.304616 10523 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:00.215222  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 157891us
I20260709 13:16:00.315346 10607 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.197904 10638 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.317137 10517 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.310346 10671 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.248970 10642 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:16:00.318848 10504 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.249383 10414 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.318985 10682 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.337041 10640 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.358359  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.304996 10669 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:00.326460 10683 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:00.353194 10362 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:00.410825  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 95944.5us
W20260709 13:16:00.413034  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.333228  8835 raft_consensus.cc:614] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:00.422640  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109909us
I20260709 13:16:00.432152  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:00.369786 10188 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.356490 10580 raft_consensus.cc:2764] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:16:00.360663 10506 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:00.356055 10610 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:00.429656  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71392.1us
I20260709 13:16:00.457737  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:00.371111 10428 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.433732  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.418931 10504 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:00.450075  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 142518us
I20260709 13:16:00.433225 10362 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.411240 10517 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:00.426609 10607 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.464944  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.410948 10671 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.466203  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:00.430586 10683 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.435392 10676 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:00.468767  9825 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.436395 10642 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:00.470610  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129493us
I20260709 13:16:00.433348 10679 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.447999 10506 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:00.463069 10673 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:16:00.479300  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:00.463686 10678 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:16:00.460256 10610 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.480047 10517 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.461440 10562 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:00.484757 10677 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.275s	user 0.000s	sys 0.002s
I20260709 13:16:00.480729 10671 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.493151 10551 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.485850  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.481719 10614 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.480640 10188 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.508627 10551 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:00.512365 10685 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:16:00.486687 10607 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.520198 10671 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.521991 10418 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.522549 10671 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.522810 10607 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.524729 10686 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:00.456785 10287 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.526048 10688 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:00.493636 10604 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.529321 10604 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.529778 10604 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.530205 10604 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.531247 10454 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.535171 10689 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.536151 10188 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.536670 10188 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:00.539551 10675 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.332s	user 0.000s	sys 0.000s
I20260709 13:16:00.528589 10688 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.542264  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:00.470088 10428 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 13:16:00.542903  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110835us
I20260709 13:16:00.541277  9463 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:00.483736 10676 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:00.546653  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.524498 10418 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:00.561837  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 97050.8us
I20260709 13:16:00.562650  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.500983 10672 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:16:00.546844 10688 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:00.576162 10688 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.577003 10694 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:00.577430 10694 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:00.578528 10694 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.579773 10694 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:00.556851 10684 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:16:00.567255  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 88032.8us
I20260709 13:16:00.498289 10679 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.512444 10551 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.570355 10692 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:00.555846 10580 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:00.583721 10188 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.584329 10580 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.585470 10551 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.585851 10188 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:00.586716 10580 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:00.568885 10414 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.572765 10689 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.556010 10506 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.588270 10506 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:00.588795  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:00.589661 10638 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.589783 10686 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.578694 10604 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.587435 10692 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:00.590346 10686 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:00.592185 10686 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.520197 10543 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:00.595790  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49229.3us
W20260709 13:16:00.600343  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:00.603755  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 118006us
W20260709 13:16:00.599010  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 132894us
W20260709 13:16:00.606268  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.605494  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.607303  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:00.607973  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.609373  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:00.606978  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61495us
I20260709 13:16:00.610437  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.603183 10428 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.613034  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.614351  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.614811  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:00.615633  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.617272  8768 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.617493  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.616140 10428 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:00.644093 10428 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.613145 10607 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:00.644297 10688 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.645078 10607 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.622414  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.602447 10671 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:00.649255  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:00.650607  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.651126  8762 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:00.651935  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.652624  8767 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:00.634994  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:00.654951  8764 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.659687  8768 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:00.623306  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.645485 10607 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:00.663021  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47052us
I20260709 13:16:00.664005 10614 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:00.664556 10614 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:00.665423 10614 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.666088 10428 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.622414  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.669556 10428 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:00.669993  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46776.8us
I20260709 13:16:00.643606 10504 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.674360  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:00.675007  8762 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:00.615425 10638 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:00.675715  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 66423.6us
I20260709 13:16:00.675876  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:00.644490 10414 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:00.622212 10691 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.679802  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:00.611147  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.611032 10188 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:16:00.635257  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:00.627961 10580 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.701722 10580 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:00.706482  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:00.698002  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:00.708196  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.640337 10517 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.679513 10638 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.693740 10691 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.727046  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:00.728744  8764 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:00.729024  8838 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:00.731671  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:00.740537  8843 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:00.684384 10414 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.679186 10669 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:00.640024 10523 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.680909 10408 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:16:00.699613 10696 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:00.745579  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 122216us
I20260709 13:16:00.639699 10603 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.748991  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:00.766029  8837 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.756001  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:00.766577  8762 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:00.766980  8843 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:00.756330  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:00.756968  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:00.757652  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:00.639045 10640 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.760423  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:00.761080  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:00.762074  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.769284  8839 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 1.
I20260709 13:16:00.739707 10638 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.743103 10691 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.780114  8763 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:00.772909  8841 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:00.714046 10698 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.715070  8760 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:00.744345 10414 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.743284 10700 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:00.742249 10702 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.744529 10551 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:00.794961 10686 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:00.761636 10696 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:00.742249 10580 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:00.803923  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 68729.1us
I20260709 13:16:00.804951  8843 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:00.746138 10642 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:00.613034 10676 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.821357  8837 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:00.822963 10686 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:00.824393 10580 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.826318 10686 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:00.827096 10688 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:00.828148 10552 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:00.783999 10698 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:00.799957 10551 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:00.810060  8835 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:00.832932  8837 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:00.807309 10696 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.873557  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:00.889418  8837 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:00.814742 10604 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.861159 10709 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:00.829845 10543 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:00.915459  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 140078us
I20260709 13:16:00.859987 10698 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.828675 10552 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.859752 10694 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:00.773566 10607 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.870272 10551 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.860117 10692 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:00.964924  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:00.917430 10504 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.938050  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:00.943811  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.946398  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.947407  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.973747  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.934640 10580 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.954435  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:00.956317  8837 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:00.945367  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.908839 10428 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:00.869760  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 256629us
I20260709 13:16:00.958422  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:00.960315  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.861289 10640 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:00.973814  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:00.993335  8917 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:00.971632  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.932427 10610 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.972839  8916 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:00.975057  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.950474  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:00.808108 10702 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:00.943682 10704 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:00.996896  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:00.976042  8912 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:00.986779  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.987699  8914 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:00.958010 10604 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.957406 10709 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:00.994014  8910 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:16:00.974421  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:00.975116  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:00.949033  8732 leader_election.cc:336] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.539s (SENT)
I20260709 13:16:00.970320 10706 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.994603  8766 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:00.997661  8913 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.019467  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:00.996974  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 188537us
I20260709 13:16:01.001441  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:00.958496 10694 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:01.021239  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 281541us
I20260709 13:16:01.022508  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:01.024309  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:01.025919  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:01.029515  8916 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:00.988473 10715 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:01.034462  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:01.058178  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:01.013633  9460 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:00.975224 10692 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:01.062121  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 113260us
I20260709 13:16:01.007324 10705 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:01.085896  8732 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.554s (SENT)
I20260709 13:16:01.088848  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:00.989744 10580 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.033635 10408 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:00.995162 10428 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.056130 10517 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:01.096571  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:01.103158  8910 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.058360 10695 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:01.058238 10711 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:16:01.032852 10523 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:01.007604 10604 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.007237 10712 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:16:01.094888 10642 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:01.100605 10640 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:01.123618  8715 auto_rebalancer.cc:893] Removing replace marker failed: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:01.150998  8715 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:16:01.125543 10603 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:01.153467 10603 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:01.155663  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 131439us
I20260709 13:16:01.155963  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:01.151455  8715 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:01.110008  8835 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:16:01.170403  8835 pending_rounds.cc:85] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 1
I20260709 13:16:01.175730 10723 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:01.176949 10714 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:16:01.178128 10716 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:16:01.179972 10702 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.181010 10728 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.183218 10728 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.183944 10722 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:01.184540 10722 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.058492 10704 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.187095 10726 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:01.187315 10708 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:16:01.061297 10715 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.188812 10704 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.190289 10715 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:01.190456 10725 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:01.096673 10705 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.193549 10705 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.194716  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.054723 10706 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.198567  8910 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:01.188328 10726 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:01.143263 10642 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:01.142176 10523 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.198364 10607 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.156342 10712 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:01.128296 10695 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.197468 10414 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.219173  8842 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:01.077219 10719 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:16:01.145501 10408 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:16:01.161589 10709 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.220237  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:01.232640  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:01.680455  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 594546us
I20260709 13:16:01.427129  8913 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:01.642644  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:01.474846 10570 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:01.701890  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.704196  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.687927  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:01.706240  8918 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:01.689975  8732 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.595s (SENT)
I20260709 13:16:01.393831  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:01.707043  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:01.707626  8914 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:01.472991 10638 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.003s
I20260709 13:16:01.182154 10640 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:01.684466 10692 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.687971  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:01.470019  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:01.472455 10703 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.681s	user 0.000s	sys 0.001s
I20260709 13:16:01.689860  8841 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:16:01.399155 10713 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:01.362898 10454 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.004s
W20260709 13:16:01.390410  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 311667us
I20260709 13:16:01.394310  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:01.349200 10643 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.994s	user 0.006s	sys 0.007s
I20260709 13:16:01.653486 10693 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:01.679466 10695 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:01.708544 10570 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.566895  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:01.173563  8835 pending_rounds.cc:107] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:01.209430 10642 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:01.740653  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50708.6us
I20260709 13:16:01.750599  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.709200  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.346894 10559 consensus_queue.cc:1243] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 1.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:01.781958 10667 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.782230  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.783588  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:01.784336  8794 heartbeater.cc:646] Failed to heartbeat to 127.7.122.126:41961 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.122.126:41961 timed out after 15.000s (SENT)
I20260709 13:16:01.761137 10702 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:01.785244 10734 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:16:01.786849  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1155) took 1008 ms. Trace:
W20260709 13:16:01.787142  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1106) took 1174 ms (client timeout 1530 ms). Trace:
I20260709 13:16:01.787282  8836 rpcz_store.cc:276] 0709 13:16:00.778090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.778218 (+   128us) service_pool.cc:224] Handling call
0709 13:16:00.778572 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.779454 (+   882us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.779482 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.791475 (+ 11993us) log.cc:844] Serialized 26 byte log entry
0709 13:16:01.145519 (+354044us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:01.145656 (+   137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.145897 (+   241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.786629 (+640732us) raft_consensus.cc:1685] finished
0709 13:16:01.786653 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.786789 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":373,"raft.queue_time_us":24054,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6886,"thread_start_us":284300,"threads_started":1,"wal-append.queue_time_us":540994}
I20260709 13:16:01.784801  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.789863  8838 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:01.789364 10640 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.790680  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.791250  8838 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:01.785538  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.792116 10636 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:01.793381 10636 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:01.797374  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.798516 10694 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:01.755796 10454 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.007s	sys 0.006s
W20260709 13:16:01.799924  8763 rpcz_store.cc:269] 0709 13:16:00.613527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.615412 (+  1885us) service_pool.cc:224] Handling call
0709 13:16:01.786937 (+1171525us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540025b554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:01.787070 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373923584}
I20260709 13:16:01.800413  8836 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:01.204201 10726 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.694789 10722 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:01.462787 10362 consensus_meta.cc:287] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.984s	user 0.008s	sys 0.004s
I20260709 13:16:01.482268 10705 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:01.714304 10638 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.765923 10728 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:01.766398 10698 consensus_meta.cc:287] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.000s
W20260709 13:16:01.803264 10696 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.887s	user 0.012s	sys 0.000s
I20260709 13:16:01.758145 10743 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:01.398422 10604 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.228391 10727 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:01.839555  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 74595.6us
W20260709 13:16:01.841578  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:01.780514  8732 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.707s (SENT)
I20260709 13:16:01.469101 10548 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:01.782423 10667 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:01.227092 10683 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.002s
I20260709 13:16:01.390184 10723 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:01.440587 10551 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.806692  8836 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:01.809051  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54286 (request call id 343) took 1212 ms. Trace:
I20260709 13:16:01.864900  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:01.810079 10747 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 13:16:01.810899 10706 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.813205 10705 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:01.769471 10691 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.973s	user 0.009s	sys 0.002s
I20260709 13:16:01.777213  8835 raft_consensus.cc:2889] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:01.821720  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.826784  8841 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:01.874500  8838 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:01.875540  8841 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:01.828593 10735 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:01.823369 10698 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.836495  9460 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:01.843573  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:01.843698  8918 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
W20260709 13:16:01.809219 10745 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:16:01.866544  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:01.867836  8810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.037s	sys 0.030s
I20260709 13:16:01.836886 10743 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:01.870612  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:01.832638 10570 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.758378 10713 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.872473 10718 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:01.890439  8810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.037s	sys 0.031s
W20260709 13:16:01.869975  8809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.040s	sys 0.118s
W20260709 13:16:01.906486  8809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.041s	sys 0.118s
I20260709 13:16:01.837589 10696 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.817090 10362 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.904343 10679 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:01.899699  8841 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:01.887997  8838 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:01.901623 10408 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:01.868780 10727 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:01.929468  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 149004us
W20260709 13:16:01.929838  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 59299.9us
I20260709 13:16:01.862620 10548 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.889536 10706 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:01.933615  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:01.940685  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:01.941645  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:01.941919  8762 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:01.936120  8763 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:01.933144  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 252508us
I20260709 13:16:01.867341 10683 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:01.892505 10735 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.950635  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:01.951263  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:01.948660  8767 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:01.952572  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:01.953145  8768 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:01.948846  8765 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [3.5-5.6]
W20260709 13:16:01.951385  9431 leader_election.cc:336] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.870s (SENT)
I20260709 13:16:01.934391 10543 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:01.928293  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1163) took 1103 ms. Trace:
I20260709 13:16:01.957844  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:01.936542  9465 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:01.941269 10728 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.881971 10691 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.949532 10695 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.968755  8768 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:01.946473  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:01.968243  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.965691  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.972105  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:01.955996 10722 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:01.973047  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1160) took 1148 ms. Trace:
I20260709 13:16:01.977561  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.977434  8839 rpcz_store.cc:276] 0709 13:16:00.824119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.857213 (+ 33094us) service_pool.cc:224] Handling call
0709 13:16:00.858315 (+  1102us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:01.081644 (+223329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.081672 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:01.130113 (+ 48441us) log.cc:844] Serialized 52 byte log entry
0709 13:16:01.686792 (+556679us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:01.686840 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.687008 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.972809 (+285801us) raft_consensus.cc:1685] finished
0709 13:16:01.972829 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.972984 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1146,"raft.queue_time_us":50215,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":46434,"thread_start_us":718137,"threads_started":2,"wal-append.queue_time_us":529963}
I20260709 13:16:01.961037 10743 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.980392 10743 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:01.980633  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:01.982151  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:01.974089  8838 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:01.960312  8835 rpcz_store.cc:276] 0709 13:16:00.824983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.995165 (+170182us) service_pool.cc:224] Handling call
0709 13:16:01.061259 (+ 66094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:01.927834 (+866575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.928213 (+   379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.975656  8836 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:01.976390 10744 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:01.960646 10698 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:01.961084 10548 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.983330  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:01.985015  8732 leader_election.cc:336] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.903s (SENT)
I20260709 13:16:01.981451  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1151) took 1224 ms. Trace:
I20260709 13:16:01.996416  8768 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:01.990669  8761 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:01.996297  8840 rpcz_store.cc:276] 0709 13:16:00.756904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.757015 (+   111us) service_pool.cc:224] Handling call
0709 13:16:01.980471 (+1223456us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:01.981392 (+   921us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504064}
I20260709 13:16:01.950109 10306 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:01.976925  9462 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:01.961210 10713 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.968813  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:01.992192  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:01.933853 10757 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:16:01.996253  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:01.992254  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:01.957011 10667 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.015705 10667 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.018285  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:01.956739 10723 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.025245 10642 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.971767 10638 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.966181 10727 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:01.976824 10570 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:02.001127  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:01.965409 10750 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.972599 10728 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.039793 10683 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:02.041378 10728 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.007753 10748 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.042140 10748 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:02.008028  8732 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.920s (SENT)
I20260709 13:16:02.008473 10696 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:02.008558 10706 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.010283 10735 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:02.011466 10740 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:02.014691  9462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 300) took 1057 ms. Trace:
I20260709 13:16:02.061625  9462 rpcz_store.cc:276] 0709 13:16:00.957581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.960308 (+  2727us) service_pool.cc:224] Handling call
0709 13:16:00.993896 (+ 33588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.010986 (+1017090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.014284 (+  3298us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b5400503cd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:02.014581 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2232996096}
I20260709 13:16:02.020207  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.063145  8763 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:02.064352  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.065207  8763 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:02.065811  9465 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:02.066016  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.066339 10696 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:02.022047  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:01.865485  9463 rpcz_store.cc:276] 0709 13:16:00.596224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.598509 (+  2285us) service_pool.cc:224] Handling call
0709 13:16:00.639890 (+ 41381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.759906 (+120016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.759971 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.769586 (+  9615us) log.cc:844] Serialized 26 byte log entry
0709 13:16:00.926837 (+157251us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:00.933990 (+  7153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:00.945807 (+ 11817us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:01.795533 (+849726us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b540057d620. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd0fdbe 00007fce6fd1a930 00007fce6fd1a8d8 00007fce6fd1a858 00007fce6fd1a813 00007fce6fd19a9c 00007fce75c05626 00007fce75bffdd8 00007fce6fd567cb 00007fce6fd592c0
0709 13:16:01.802071 (+  6538us) raft_consensus.cc:1685] finished
0709 13:16:01.802096 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:01.808910 (+  6814us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154362,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":32763136,"thread_start_us":247368,"threads_started":2,"wal-append.queue_time_us":207119}
I20260709 13:16:02.067456 10667 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:02.067657  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:02.067893 10667 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.068827 10667 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.070031 10667 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.022298 10691 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.027911  8762 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:01.989236 10695 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:16:01.972021 10554 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:16:02.030676  8768 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:01.988380 10722 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.039201 10551 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:01.995473 10362 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.043725  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:02.044796  8841 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:02.043746 10418 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:02.050814 10552 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.054978 10669 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:02.056659 10414 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:02.058885  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:02.053143  8809 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:02.066588 10676 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:01.955051 10636 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.071010  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1107) took 1457 ms. Trace:
I20260709 13:16:02.068820  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:02.109777  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101770us
W20260709 13:16:02.118067  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 49322.2us
I20260709 13:16:02.108528  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.110312  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1158) took 1286 ms. Trace:
I20260709 13:16:02.118537  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:02.118227  8732 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.996s (SENT)
I20260709 13:16:02.117750  8769 rpcz_store.cc:276] 0709 13:16:00.613877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.614016 (+   139us) service_pool.cc:224] Handling call
0709 13:16:00.646293 (+ 32277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:01.025346 (+379053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.025376 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:01.079213 (+ 53837us) log.cc:844] Serialized 26 byte log entry
0709 13:16:01.181200 (+101987us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:01.181238 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.181308 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.070779 (+889471us) raft_consensus.cc:1685] finished
0709 13:16:02.070801 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.070936 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3133,"raft.queue_time_us":98953,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":19617,"thread_start_us":384014,"threads_started":2,"wal-append.queue_time_us":739429}
I20260709 13:16:02.121666  8762 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:02.109822  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.122931  8768 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.070526  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:02.112816  8918 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.113837  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:02.114204  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.115147  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.115842  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.125730  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.126427  8912 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:02.127135  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.119021  8843 rpcz_store.cc:276] 0709 13:16:00.823507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.827276 (+  3769us) service_pool.cc:224] Handling call
0709 13:16:00.827606 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:00.829497 (+  1891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:00.829545 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:00.829979 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:01.514598 (+684619us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:01.514661 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:01.514763 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.110000 (+595237us) raft_consensus.cc:1685] finished
0709 13:16:02.110031 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.110231 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1558,"raft.queue_time_us":6271,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6576,"thread_start_us":463321,"threads_started":1,"wal-append.queue_time_us":924065}
I20260709 13:16:02.129072  8918 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:02.131300  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:02.131441  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 78444.1us
I20260709 13:16:02.132293  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:02.132843  8836 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:02.135578  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:02.137473  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.138902  9465 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:02.110662 10691 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.141127  8763 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:02.141630  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.142539  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:02.117044 10669 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.142349  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.125191 10362 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.150890  8918 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:02.058786 10750 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.122149 10418 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:02.152209 10705 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.124661 10739 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:02.150452  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.130121 10642 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:02.158305  8910 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:02.158504  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:02.135818 10414 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.164674  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.173018  8762 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:02.171581  8918 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:02.175299  8768 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:02.176141  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.176753  8768 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:02.154682 10551 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.178158  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:02.180658  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:02.147691 10552 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:16:02.144831 10638 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:02.186091  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:02.189525  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.190146  8762 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:02.169561 10418 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.161372 10741 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:16:02.161921 10362 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.170168 10554 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:02.191847 10741 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:02.172659 10739 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:02.198344  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:02.187393  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:02.192180 10705 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.210763  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.198925 10751 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:02.210119 10705 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.195698 10741 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.187162 10551 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.212641 10751 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:02.217875 10636 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:02.223325 10428 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:02.224237  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:02.225077  9463 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:02.224833  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:02.225401 10722 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:02.201848 10757 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:02.228988  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:02.209550 10695 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.213145 10705 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.215891 10748 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:02.237530  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.226701  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:02.232404  9465 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:02.238265  8762 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:02.228116 10757 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.191859 10669 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.232577  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:02.233559 10751 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.244114  9462 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:02.244848 10751 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:02.239952 10362 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.226125 10739 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.246207  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.248003  8917 raft_consensus.cc:2410] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 13:16:02.247988 10699 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.510s	user 0.004s	sys 0.000s
I20260709 13:16:02.249493  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.241844 10757 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.254599 10748 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:02.257826 10748 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.258252 10748 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:02.260273  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:02.264752 10695 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:02.267658  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.259719 10712 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.261354 10669 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.274554  8916 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:02.242019 10741 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:02.278133  8761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1113) took 1660 ms (client timeout 1748 ms). Trace:
W20260709 13:16:02.281901  8761 rpcz_store.cc:269] 0709 13:16:00.617501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.675624 (+ 58123us) service_pool.cc:224] Handling call
0709 13:16:02.277903 (+1602279us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540025c454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:02.278065 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3014209408}
I20260709 13:16:02.283214  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.283993  8761 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:02.286352  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1103) took 1674 ms. Trace:
I20260709 13:16:02.286852  8766 rpcz_store.cc:276] 0709 13:16:00.612179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.612323 (+   144us) service_pool.cc:224] Handling call
0709 13:16:02.286116 (+1673793us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b5400338954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:02.286281 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":761314816}
I20260709 13:16:02.288105  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.277293  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.289700  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.290560  8762 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:02.294873  8761 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:02.296715  8761 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:02.294764  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.302165  8766 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:02.281905 10750 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:02.268694 10712 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:02.325623 10769 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:02.326082  8762 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:02.314761 10741 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.329465  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:02.386900 10726 consensus_meta.cc:287] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 13:16:02.401870 10723 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.398855  9465 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:02.418437  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:02.422190  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:02.423092 10669 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.424332  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:02.431681  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:02.445809  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:02.421416 10693 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.411175 10726 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.423642 10667 raft_consensus.cc:2764] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:02.461803 10695 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.461763  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:02.458473 10603 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.489660 10750 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.478832  9460 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:02.492905 10772 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:02.492362 10603 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.492658 10750 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.460721 10428 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.493635 10428 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.494964 10750 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.461097 10676 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:02.442227 10407 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.497099  8761 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:02.462061 10727 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.496958  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48150.9us
I20260709 13:16:02.461629 10718 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:02.464848 10693 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:02.496001 10775 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:02.503787  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:02.505656  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.506565 10719 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:16:02.510883 10725 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:02.511281 10725 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.495956 10603 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.500258 10667 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:02.501240 10407 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:02.505219 10669 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:16:02.516714 10407 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.490394 10705 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.527877  8766 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:02.488948 10695 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.519601 10428 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.504257 10727 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.515115 10676 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:02.536566 10695 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.537673 10727 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.538605 10543 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.557860 10543 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:02.557915 10726 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.560559  8766 pending_rounds.cc:85] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 2
I20260709 13:16:02.560920  8766 pending_rounds.cc:107] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:16:02.561220  8766 raft_consensus.cc:2917] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:16:02.561782  8766 raft_consensus.cc:2889] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:02.563133 10757 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.564345  9462 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:02.566133 10705 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.566320  8762 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:02.566630 10757 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.564352  8764 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:02.585187  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.586347  8764 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:02.587005  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 69717.9us
I20260709 13:16:02.587884  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:02.594065  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:02.555289 10676 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.552415 10739 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.569505 10748 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:02.613646  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:02.614454  8842 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:02.615126  8764 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:02.582235 10726 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.617791  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.622181  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.623241  8762 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:02.595831 10555 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:02.603039 10428 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.607679 10739 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.624471 10667 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.643880  8764 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:02.625029 10726 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:02.662528  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 80968us
I20260709 13:16:02.670006  8838 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:02.676227  8840 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.665479  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.642342 10428 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.679903  8762 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:02.685344 10748 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:02.694108  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:02.657832 10643 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:02.696336  8768 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:02.697840  8768 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:02.700479  8768 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:02.706885 10785 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:02.707427 10785 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:02.708294 10785 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.709529 10785 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:02.659202 10780 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.732623  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:02.733470  8762 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:02.713739 10783 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:02.741809  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:02.743731  8844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1146) took 1988 ms (client timeout 1695 ms). Trace:
W20260709 13:16:02.744089  8844 rpcz_store.cc:269] 0709 13:16:00.755352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.755489 (+   137us) service_pool.cc:224] Handling call
0709 13:16:02.741630 (+1986141us) spinlock_profiling.cc:243] Waited 919 us on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:02.743666 (+  2036us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113280}
W20260709 13:16:02.757905  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.681906 10543 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.665910 10676 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.772042 10739 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.772696  8762 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:02.775564 10719 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:02.776140 10719 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.770501 10701 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:02.794564  8760 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:02.812011  8884 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.695s (SENT)
I20260709 13:16:02.790767 10780 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.761061 10667 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:02.823431  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.836406  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.779142 10407 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:02.837671  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.839337  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:02.845351  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.848223  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.851112  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.836246 10610 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.865204  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1111) took 1930 ms. Trace:
W20260709 13:16:02.857672 10789 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:16:02.850596 10643 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:02.850823 10736 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:02.858004 10306 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:02.860245 10727 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.865790  8909 rpcz_store.cc:276] 0709 13:16:00.934572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.934945 (+   373us) service_pool.cc:224] Handling call
0709 13:16:00.944249 (+  9304us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:01.559347 (+615098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:01.564046 (+  4699us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:01.577990 (+ 13944us) log.cc:844] Serialized 52 byte log entry
0709 13:16:01.882154 (+304164us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:01.882202 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.860937 (+978735us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540041ffd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:02.860999 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.861044 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:02.861057 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.865117 (+  4060us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3329,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"spinlock_wait_cycles":1232105728,"thread_start_us":230307,"threads_started":1,"wal-append.queue_time_us":331261}
I20260709 13:16:02.874969  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:02.882727  8836 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:16:02.834592 10780 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:02.846872 10719 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:02.883888  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.893638  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:02.873217 10552 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.874971 10736 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.901732  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:02.877441 10306 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:02.874477 10726 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:02.896136 10751 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:02.881565 10727 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:02.883718 10643 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:02.953795  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.987741  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.898128 10552 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.153695  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 254811us
I20260709 13:16:02.883345 10610 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
W20260709 13:16:03.170190  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 322693us
I20260709 13:16:02.904299 10736 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:03.177742  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 284192us
I20260709 13:16:02.906492 10750 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:02.909826 10751 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.210685  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:03.151587 10727 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.153345 10362 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.198560  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.168996 10552 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.165657 10695 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:16:03.216737 10767 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:16:03.193799 10669 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.193300 10719 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:03.245674 10795 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.339s	user 0.000s	sys 0.000s
W20260709 13:16:03.249348 10796 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
W20260709 13:16:03.195113  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 232991us
I20260709 13:16:03.218372 10751 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.199236 10750 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.240525 10306 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.261560 10643 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.266191 10723 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:03.292572 10723 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.294008  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1121) took 1341 ms. Trace:
I20260709 13:16:03.294445  8769 rpcz_store.cc:276] 0709 13:16:01.952781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.121583 (+168802us) service_pool.cc:224] Handling call
0709 13:16:02.155818 (+ 34235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.160049 (+  4231us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:02.195771 (+ 35722us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.265557 (+ 69786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.265618 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:02.265662 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.293055 (+1027393us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b180024ce80. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419
0709 13:16:03.293756 (+   701us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b54000bb8d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:03.293804 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.293944 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8028,"prepare.queue_time_us":24969,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":520,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":1267,"spinlock_wait_cycles":26005504,"thread_start_us":82826,"threads_started":2,"wal-append.queue_time_us":130835}
W20260709 13:16:03.257016 10801 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
I20260709 13:16:03.238665 10580 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:03.258378 10719 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.242427 10781 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.268198  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:03.217310 10726 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:16:03.301160 10781 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.301648  9462 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEARNER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:03.301954 10726 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:03.302394 10726 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:03.303411 10781 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:03.303292 10726 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.304616 10726 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.239383 10695 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.267311 10780 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:03.288496 10807 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:03.243866 10669 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:03.229208 10748 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:03.273674 10750 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.230665 10362 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.326833  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:03.287810 10687 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:03.339270 10719 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:03.362270 10785 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.005s
I20260709 13:16:03.367622 10695 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.369903  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:03.371083  8836 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.371177  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:03.373920 10543 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:03.374796 10693 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260709 13:16:03.375362 10693 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.378597  8844 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 13:16:03.380017  8836 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:16:03.385068  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.386147 10807 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:03.387568 10807 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.389923  9467 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:03.380483  8844 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:03.400326  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.401969  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:03.402861  8764 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.403752  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:03.403796  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:03.330549 10669 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.404925  8762 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:03.405027  8844 raft_consensus.cc:2410] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:03.407588  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.409937  8767 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:03.415616  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:03.404249 10543 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:03.422360 10543 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:03.422827 10543 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.425688  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:03.356192 10723 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.441345  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:03.444536  8764 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:03.412987 10781 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:03.420418  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:03.450498  8760 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:03.404760 10672 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:03.454022 10813 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:03.454413 10813 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:03.455204 10813 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.456499 10813 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:03.458003 10723 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:03.461704 10693 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.463001  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1117) took 1511 ms. Trace:
I20260709 13:16:03.463399  8763 rpcz_store.cc:276] 0709 13:16:01.951610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.066994 (+115384us) service_pool.cc:224] Handling call
0709 13:16:02.067291 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.144794 (+ 77503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.462761 (+1317967us) spinlock_profiling.cc:243] Waited 73.6 ms on lock 0x7b5400339354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:03.462943 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169394432}
I20260709 13:16:03.466267 10725 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.467579 10725 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.470814 10551 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.406173 10704 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:03.476616 10736 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.478873 10736 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.478715 10750 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.481364 10750 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.485348  8835 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:03.417681 10682 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.007s	sys 0.019s
I20260709 13:16:03.456248 10727 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:03.492167 10682 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.007s	sys 0.019s
I20260709 13:16:03.502271  8838 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:03.513996 10718 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:03.514578 10718 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:03.515868 10718 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:03.519666  8735 connection.cc:256] RPC call timeout handler was delayed by -1.3797122390001277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260709 13:16:03.531944  9431 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.565s (SENT) [suppressed 41 similar messages]
I20260709 13:16:03.516564 10712 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:03.569684  8910 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:03.553470 10718 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.576262  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:03.509758 10552 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.591357 10543 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.593168  8844 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:03.586898  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1078) took 1495 ms. Trace:
I20260709 13:16:03.596928  8838 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:03.595408  8761 rpcz_store.cc:276] 0709 13:16:02.091693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.499708 (+408015us) service_pool.cc:224] Handling call
0709 13:16:02.499953 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.500082 (+   129us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:02.597583 (+ 97501us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.815404 (+217821us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.368809 (+553405us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b180024c880. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:03.376022 (+  7213us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b180024c880. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:03.586437 (+210415us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:03.586504 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:03.586561 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.586640 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.586818 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97164,"prepare.queue_time_us":99407,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":2686,"raft.queue_time_us":6792,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":8587,"spinlock_wait_cycles":17399552,"thread_start_us":417418,"threads_started":2,"wal-append.queue_time_us":283749}
W20260709 13:16:03.600324  8841 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 124) took 1632 ms (client timeout 1653 ms). Trace:
W20260709 13:16:03.600765  8841 rpcz_store.cc:269] 0709 13:16:01.968179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.977313 (+  9134us) service_pool.cc:224] Handling call
0709 13:16:03.600051 (+1622738us) spinlock_profiling.cc:243] Waited 65.9 ms on lock 0x7b54003a5f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:03.600253 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151635840}
W20260709 13:16:03.604296 10815 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:16:03.610098  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1379) took 1449 ms. Trace:
I20260709 13:16:03.627942  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:03.848711  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.901074  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.683163  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.756150  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.905793  9431 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.799s (SENT)
W20260709 13:16:03.907218  9431 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.805s (SENT)
I20260709 13:16:03.834060  8768 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.628693  8914 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:03.654103  8910 rpcz_store.cc:276] 0709 13:16:02.160392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.307735 (+1147343us) service_pool.cc:224] Handling call
0709 13:16:03.311884 (+  4149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.570364 (+258480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.609844 (+ 39480us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54002b0f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:03.610044 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592119040}
I20260709 13:16:03.911409  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.895913  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1175) took 1287 ms. Trace:
I20260709 13:16:03.605496 10727 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.921142  8843 rpcz_store.cc:276] 0709 13:16:02.608615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.608799 (+   184us) service_pool.cc:224] Handling call
0709 13:16:02.609198 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.681781 (+ 72583us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:02.713244 (+ 31463us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.786220 (+ 72976us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.786273 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:02.786313 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.895681 (+1109368us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b540006bb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:03.895727 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.895860 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47891,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":1607,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":166366080,"thread_start_us":70965,"threads_started":1,"wal-append.queue_time_us":124860}
I20260709 13:16:03.704051  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.668979  9432 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:03.702998 10690 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:03.605149  8839 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:03.897934  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:03.610352 10554 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:03.632941  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.897948  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:03.907305  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.703534  8915 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:16:03.934167  8915 pending_rounds.cc:85] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 6
I20260709 13:16:03.701660  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 136) took 1587 ms. Trace:
W20260709 13:16:03.609952 10787 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.902s	user 0.000s	sys 0.003s
I20260709 13:16:03.937006  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1080) took 1844 ms. Trace:
I20260709 13:16:03.912772 10682 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.918125  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:03.701608  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.834194 10552 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:03.923100  8910 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:03.942376  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:03.943835  8910 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:03.943760  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:03.620244  8665 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:03.946146  8914 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:03.933238 10701 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:03.627543  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:03.667752 10664 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:03.896495 10778 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.950145 10778 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.950968  8912 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:03.940093 10784 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:03.859356 10671 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:03.931809  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.953621  8918 raft_consensus.cc:2410] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:16:03.617540  8916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 135) took 1504 ms (client timeout 1805 ms). Trace:
W20260709 13:16:03.953982  8916 rpcz_store.cc:269] 0709 13:16:02.113452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.113589 (+   137us) service_pool.cc:224] Handling call
0709 13:16:03.617366 (+1503777us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540031a954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:03.617473 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316950912}
I20260709 13:16:03.612274 10407 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:03.615967  8663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 216) took 16896 ms (client timeout 15000 ms). Trace:
W20260709 13:16:03.934468  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.962119  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.934623  8917 rpcz_store.cc:276] 0709 13:16:02.113736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.118306 (+  4570us) service_pool.cc:224] Handling call
0709 13:16:03.701406 (+1583100us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540026d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:03.701582 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294020480}
I20260709 13:16:03.934481  8915 pending_rounds.cc:107] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:16:03.964123  8915 raft_consensus.cc:2889] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.897459 10543 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.937361  8766 rpcz_store.cc:276] 0709 13:16:02.092456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.548819 (+456363us) service_pool.cc:224] Handling call
0709 13:16:02.560365 (+ 11546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:02.562923 (+  2558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.562964 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:02.563494 (+   530us) log.cc:844] Serialized 52 byte log entry
0709 13:16:02.661509 (+ 98015us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:02.661577 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.661672 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.609383 (+947711us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:03.936724 (+327341us) raft_consensus.cc:1685] finished
0709 13:16:03.936743 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.936952 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":65054080,"thread_start_us":97605,"threads_started":1,"wal-append.queue_time_us":143517}
I20260709 13:16:03.912153 10704 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.913892  8732 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.503s (SENT)
I20260709 13:16:03.610807 10751 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.946451  8665 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 2 to 4, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:03.925465  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 256608us
I20260709 13:16:03.969854  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.970177  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:03.970746  8909 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:03.938674 10554 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:03.938849 10743 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:03.948552 10669 consensus_meta.cc:287] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.532s	user 0.001s	sys 0.009s
W20260709 13:16:03.967298  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56166.3us
I20260709 13:16:03.967549  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.971339  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:03.971915 10705 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:03.969672  8665 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:03.969696 10704 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:03.974936 10817 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:16:03.976485 10751 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:03.965987 10665 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.981299 10786 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:03.982729  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1174) took 1375 ms. Trace:
W20260709 13:16:03.983415 10828 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:03.970129 10642 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:16:03.951799 10784 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:03.938527 10690 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.944010 10682 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:03.995373  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:03.989499 10669 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:04.004545  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.992774 10722 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:03.993757  8665 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:04.018884  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:03.961612 10664 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.021498  8839 rpcz_store.cc:276] 0709 13:16:02.607240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.607404 (+   164us) service_pool.cc:224] Handling call
0709 13:16:03.604958 (+997554us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.932700 (+327742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.982537 (+ 49837us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54003a5f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:03.982676 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293577984}
I20260709 13:16:03.987578 10743 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:03.994865 10823 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:03.987203 10725 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.997649 10757 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:16:04.027957 10704 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:04.029446  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.030270 10362 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:04.031339  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.031683 10407 raft_consensus.cc:3055] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:04.032207 10819 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:04.038064  8665 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:03.966434 10671 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.040961  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.023562 10784 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:04.020603 10665 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:03.995949  8911 raft_consensus.cc:2410] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:04.115527  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.046993  8913 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:04.110883  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1178) took 1323 ms. Trace:
I20260709 13:16:04.113868  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:04.143666  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.089067  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.149003  8909 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:04.143350  8842 rpcz_store.cc:276] 0709 13:16:02.787199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.256018 (+468819us) service_pool.cc:224] Handling call
0709 13:16:03.256313 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.256507 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:03.260775 (+  4268us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.417256 (+156481us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.618920 (+201664us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b180034d140. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:04.110096 (+491176us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b180034d140. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:04.110350 (+   254us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:04.110429 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:04.110493 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.110583 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.110796 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":695711,"prepare.queue_time_us":14296,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":706246,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":19172,"spinlock_wait_cycles":8837248,"thread_start_us":146301,"threads_started":1,"wal-append.queue_time_us":245747}
I20260709 13:16:04.135897  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:04.151749  8917 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:04.065415 10682 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.137943  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.156836  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.135070 10407 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:04.160450  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.158565  8769 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.158463  8910 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:16:04.161243  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 167941us
I20260709 13:16:04.162030  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:04.162521  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.163846  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:04.164562  8910 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:04.164779  8909 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:04.140170  8665 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 4 to 5, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.170404  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:04.171175  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 261891us
I20260709 13:16:04.173765  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.174432  8763 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.174862  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.175500  8767 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.176236  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:04.176740  8732 leader_election.cc:336] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.728s (SENT)
I20260709 13:16:04.176882  8761 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.148725 10362 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:04.177248  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.181775 10704 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:04.181469 10362 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.154296 10603 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:04.183127 10603 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:04.183959  8732 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.832s (SENT)
I20260709 13:16:04.184541  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.185971  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.186828  8766 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.188211  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.195053  8836 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:04.172039  8665 catalog_manager.cc:5697] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.142904 10819 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.143882 10725 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.202909  9467 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:04.206547  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 92816.2us
I20260709 13:16:04.218338  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.207581  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1179) took 1397 ms. Trace:
I20260709 13:16:04.218981  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.213825  8844 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.219636  8765 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.219113  8840 rpcz_store.cc:276] 0709 13:16:02.810466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.320257 (+509791us) service_pool.cc:224] Handling call
0709 13:16:03.320637 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.320930 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:03.330287 (+  9357us) log.cc:844] Serialized 14 byte log entry
0709 13:16:04.145175 (+814888us) log.cc:844] Serialized 14 byte log entry
0709 13:16:04.207214 (+ 62039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:04.207273 (+    59us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:04.207320 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.207415 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:04.207524 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":674736,"prepare.queue_time_us":14918,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":98,"raft.queue_time_us":616807,"spinlock_wait_cycles":7903616,"thread_start_us":201176,"threads_started":1,"wal-append.queue_time_us":242237}
I20260709 13:16:04.221977  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:04.223879  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 77656.1us
I20260709 13:16:04.189697 10809 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.196228 10682 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:04.210421  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:04.166525 10705 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:04.144881 10743 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.198457 10727 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:16:04.249007  8763 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:04.218338  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.205538 10704 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.252470  8769 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:04.254732  8761 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:04.283126 10362 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:04.248503 10809 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.263644  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.309150  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:04.231114 10407 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.202468 10555 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:16:04.268167  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 143) took 2148 ms. Trace:
W20260709 13:16:04.269290  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.986s (SENT)
W20260709 13:16:04.246469 10718 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.003s
I20260709 13:16:04.313269 10555 consensus_queue.cc:1243] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:04.313467  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.314018 10555 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:04.314258 10809 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.314420 10555 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:04.279687  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61422.1us
I20260709 13:16:04.315644 10819 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:04.315351 10555 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.318042  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.275038 10669 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.271710  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:04.321535  9467 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.322135  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.322417  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.323101  9461 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:04.323998  8909 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:04.324402 10407 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.314306  9463 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:04.325311 10835 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:16:04.325515 10725 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.328001  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.329231  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.330128  8913 raft_consensus.cc:2410] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:04.330906  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.331702  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.332355  8909 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:04.270428  8760 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.285162  8911 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:04.196944 10784 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.310166 10665 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.287990  8765 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:04.276913 10743 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:04.290494 10832 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:16:04.269469 10836 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:04.282840 10562 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:04.300806  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 109715us
I20260709 13:16:04.300402  8767 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:04.277056 10428 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:04.229915  8665 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 2 to 4, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.280128 10690 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.282667 10735 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:04.256102  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83568.6us
I20260709 13:16:04.261579  8766 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
W20260709 13:16:04.360409  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.360803  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:04.361408  8766 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:04.217337 10679 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.253567 10306 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.281169  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.302012  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:04.320071  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.369015  8912 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:04.320490  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.311113  8915 rpcz_store.cc:276] 0709 13:16:02.120069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.171945 (+ 51876us) service_pool.cc:224] Handling call
0709 13:16:03.703173 (+1531228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.964578 (+261405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:04.267962 (+303384us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540026d250. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:04.268107 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3520794496}
I20260709 13:16:04.370818  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.372298  9467 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:04.331748  8913 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:04.373800  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.376240  8914 raft_consensus.cc:2410] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:04.377970  8913 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:16:04.335597  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.335685  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.336475  8769 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:04.336956  8809 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:04.338418  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:04.316740 10555 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.350823 10836 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.393147 10836 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.393241 10778 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:03.966184  8663 rpcz_store.cc:269] 0709 13:15:46.719428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:46.719715 (+   287us) service_pool.cc:224] Handling call
0709 13:15:47.400749 (+681034us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:03.615873 (+16215124us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.409139 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.433661 (+ 24522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.433713 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:15:57.433732 (+    19us) tablet.cc:662] Decoding operations
0709 13:15:57.438122 (+  4390us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.438238 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.438276 (+    38us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:15:57.439398 (+  1122us) tablet.cc:701] Row locks acquired
0709 13:15:57.439466 (+    68us) write_op.cc:260] PREPARE: finished
0709 13:15:57.439669 (+   203us) write_op.cc:270] Start()
0709 13:15:57.439855 (+   186us) write_op.cc:276] Timestamp: P: 1783602957439594 usec, L: 0
0709 13:15:57.439906 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.440768 (+   862us) log.cc:844] Serialized 3661 byte log entry
0709 13:15:58.773615 (+1332847us) op_driver.cc:464] REPLICATION: finished
0709 13:15:59.141325 (+367710us) write_op.cc:301] APPLY: starting
0709 13:15:59.141441 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:59.141769 (+   328us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:59.141915 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:59.143467 (+  1552us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:59.143885 (+   418us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:15:59.144479 (+   594us) write_op.cc:312] APPLY: finished
0709 13:15:59.200839 (+ 56360us) log.cc:844] Serialized 70 byte log entry
0709 13:15:59.201073 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:59.201191 (+   118us) write_op.cc:454] Released schema lock
0709 13:15:59.201264 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:59.201660 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:59.201704 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":155499,"reported_tablets":17,"spinlock_wait_cycles":612810240,"child_traces":[["op",{"apply.queue_time_us":367361,"apply.run_cpu_time_us":3947,"apply.run_wall_time_us":60318,"num_ops":9,"prepare.queue_time_us":402671,"prepare.run_cpu_time_us":34692,"prepare.run_wall_time_us":605890,"raft.queue_time_us":270476,"raft.run_cpu_time_us":13575,"raft.run_wall_time_us":157508,"replication_time_us":1333402,"thread_start_us":934992,"threads_started":4,"wal-append.queue_time_us":723895,"wal-append.run_cpu_time_us":21559,"wal-append.run_wall_time_us":2023039}]]}
I20260709 13:16:04.393870 10690 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.351075 10757 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:16:04.394505 10690 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.395465 10757 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:04.395824 10757 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:04.341902  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.396572 10690 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.249040 10682 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:04.348606  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:04.349735  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.350013  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.352468  8768 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:16:04.339371 10809 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.353121  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:04.410166 10428 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.410691 10428 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.411957 10664 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.413025 10807 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.413513 10807 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.415174 10841 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.415731 10841 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:16:04.416334 10807 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:04.417276  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 95438.5us
I20260709 13:16:04.417974 10718 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.418258 10543 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.418503 10718 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:04.419535  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 82699.9us
I20260709 13:16:04.420648 10718 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.420529  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:04.422478  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.424603  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.429726  8838 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:04.361419  8732 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.871s (SENT)
W20260709 13:16:04.431689  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70301.2us
I20260709 13:16:04.358099  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:04.434969  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.365064  8916 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:16:04.435680  8763 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:04.343721 10784 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.374971 10727 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.389029  8915 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.389649  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:04.368852 10735 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.341861  8917 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:16:04.401520  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 63160.1us
I20260709 13:16:04.403940 10669 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.440600  8766 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:04.401271 10749 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.407543  8765 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:04.408501  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:04.417994  8807 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:04.425648 10682 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.456971  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:04.435024  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 77004.7us
I20260709 13:16:04.358218  8665 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:04.352850  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.437918  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.435730  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:04.420446 10418 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:04.404975  8882 connection.cc:256] RPC call timeout handler was delayed by -1.0486533090002013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 13:16:04.477444  8882 connection.cc:256] RPC call timeout handler was delayed by -1.0252533090001634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:16:04.454138  8654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45699.8us
I20260709 13:16:04.450299  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:04.455536  8732 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.051s (SENT)
I20260709 13:16:04.412746 10428 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:04.407477 10778 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:04.396703 10757 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.520939  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.523099  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.524519  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.516534  8767 raft_consensus.cc:2368] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
I20260709 13:16:04.457628  9466 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:16:04.526536  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 108638us
I20260709 13:16:04.527400  8665 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.478775  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:04.506593  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 51084us
I20260709 13:16:04.479935  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.520040  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.458935  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:04.530049  8766 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:04.429538 10718 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.525298  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.531433  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:04.478718  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:04.521840  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 86208.4us
I20260709 13:16:04.532683  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:04.527941  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:04.529354  8732 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.105s (SENT)
I20260709 13:16:04.534094  8665 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:04.531996  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:04.508849  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.442350 10726 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:04.449875 10727 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.445057 10690 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:04.508327 10750 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:04.556205  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.539348  8665 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:04.540853 10751 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:04.540809 10722 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:04.440949 10725 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:16:04.542598  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.541272  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:04.543113  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 64480.2us
W20260709 13:16:04.538755  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 79910.7us
I20260709 13:16:04.566972  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:04.567200  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.567670  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.520097 10418 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.539525  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:04.449550 10669 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:04.543692 10844 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:16:04.537319  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.529359 10428 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.572177  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:04.544837 10552 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:04.476652 10749 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.589051  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.557999 10690 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.544184  9461 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:16:04.493315 10554 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.556655 10750 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:04.540326 10718 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.592074  8769 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.586716 10723 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.573760 10418 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:04.587299 10751 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.571583 10726 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.574328 10665 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:04.528715 10778 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.602718 10725 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:04.590634  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 134106us
I20260709 13:16:04.573583 10543 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:04.594060  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.580052 10722 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:04.608403  8765 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:04.615742  9460 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.617889 10554 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:04.576949  8665 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:04.606297  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.597780 10690 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:04.624285  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 107066us
I20260709 13:16:04.603528 10750 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.625272 10562 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:04.573316 10701 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.629135  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:04.630079  9431 leader_election.cc:336] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.162s (SENT)
I20260709 13:16:04.632145  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.661551  8765 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:04.637465 10722 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.638904  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:04.670033  8762 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.641227  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.670934  8768 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:04.641852 10669 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.642735  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.650693  8665 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 3 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:04.655665  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.591302  9463 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:04.665208  8769 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:04.628490 10679 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:04.626482 10723 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.627763 10841 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:04.684623  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.684929  8761 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.687422  8769 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:04.706324  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.645377 10665 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:04.690759  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 212036us
I20260709 13:16:04.709293  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.709970  8836 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:04.691152  8764 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.711697  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:04.693259  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:04.695807  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.696539  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.713217  8844 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.713886  8841 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:04.669538 10428 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.714289  8842 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:04.712786  8764 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:04.720057  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:04.718380  8768 raft_consensus.cc:2410] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 7 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:04.721606  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.624392 10727 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.713551  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:04.697014  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 49118.9us
I20260709 13:16:04.659749 10838 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:16:04.726985  8769 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
I20260709 13:16:04.731714  8769 pending_rounds.cc:85] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 1
I20260709 13:16:04.705382 10543 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.689244 10701 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:04.732038  8769 pending_rounds.cc:107] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:04.736158  8769 raft_consensus.cc:2889] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:04.680977 10362 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:04.672719 10819 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:16:04.746259  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:04.750556  8765 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:04.751439  8761 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:04.753612  8762 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
W20260709 13:16:04.733831  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 194372us
I20260709 13:16:04.720549 10669 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.727808  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.708367 10665 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:04.708410 10679 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.735414 10838 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:16:04.766911  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 137869us
W20260709 13:16:04.767436  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.768177  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:04.770895  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.771530  8838 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:16:04.757328  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:04.733027 10735 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.779726  8844 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:16:04.780503  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 134486us
I20260709 13:16:04.715005 10751 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.806372 10819 consensus_queue.cc:1243] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:04.718951 10726 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:04.807789  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 72558.2us
I20260709 13:16:04.740976 10543 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.784011 10552 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.837147 10865 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:04.837618 10865 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:04.838416 10865 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:04.839633 10407 consensus_meta.cc:287] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.002s
I20260709 13:16:04.839702 10865 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.840354  8918 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:04.764277 10669 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.804708 10693 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:04.841120 10867 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:04.828552 10861 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:04.840716  8760 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:04.825752 10362 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:04.812907 10852 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:16:04.851466 10749 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.851593 10552 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.851864 10679 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.811959 10862 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:04.854602  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:04.828527 10701 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:04.847177  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.830906 10743 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.856994  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:04.842836 10718 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:04.773162 10723 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.818222  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:04.802407 10705 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:16:04.857602 10407 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:04.864379  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 292255us
I20260709 13:16:04.816990 10543 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:04.855321 10555 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.852439 10778 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:04.979360  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 122492us
W20260709 13:16:04.980890  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 182798us
I20260709 13:16:04.859179 10867 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:04.916687 10851 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 13:16:04.979090  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124581us
I20260709 13:16:04.982151  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.961102 10749 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:04.985325  8732 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.810431 10428 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.809968 10857 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.181s
I20260709 13:16:04.977887 10872 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:04.987685  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:05.006042  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:04.989965  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:04.922024 10836 raft_consensus.cc:2764] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:04.990832 10859 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:04.986760 10868 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:04.991611 10850 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 13:16:05.081808  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:05.082508  9464 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.086289 10603 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:05.087363  9462 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:16:04.961129 10693 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:04.981786 10852 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:05.094007 10852 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.094507 10852 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.063990 10867 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.095563 10867 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.097734 10690 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:04.922418 10362 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:05.099097 10362 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.099301 10669 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:05.003734  9431 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.659s (SENT)
I20260709 13:16:05.023144 10671 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:05.027732 10786 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.102484 10786 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.102934 10786 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:04.985209 10862 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:04.989466 10749 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.028695  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:04.996284 10543 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:04.981510 10743 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:05.032128  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.112278  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83661.4us
W20260709 13:16:05.112520  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.034198 10784 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.001s
I20260709 13:16:05.035256  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:05.114612  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 79450.6us
I20260709 13:16:05.035802 10838 raft_consensus.cc:2764] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:05.038453 10665 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.129429 10665 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.131340 10862 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.133136  8909 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:05.133628 10749 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.050586 10872 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.050944 10418 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.052318 10842 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:04.858498 10870 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.128s
W20260709 13:16:05.100466  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 96766us
W20260709 13:16:05.100529  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 112657us
I20260709 13:16:05.075847 10778 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:05.126657 10868 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.141830  8882 leader_election.cc:400] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
W20260709 13:16:05.153963  8732 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.226s (SENT)
I20260709 13:16:05.154410  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:05.154424  9431 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.833s (SENT)
I20260709 13:16:05.155198  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:05.155905  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:05.144538  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 372300us
I20260709 13:16:05.157495  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:05.155190  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:05.157060  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:05.168428  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:05.169482  9431 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.565s (SENT)
I20260709 13:16:05.168510  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:05.177980 10863 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:05.178457 10863 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.178774 10863 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.184019 10640 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:05.185312 10693 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.185987 10872 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:05.186745 10757 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.109861 10735 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.192545 10690 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.167361 10778 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.193549 10743 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:05.277531  8765 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.010s
W20260709 13:16:05.278129  8765 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.010s
I20260709 13:16:05.139219 10418 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:05.283159  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 114814us
I20260709 13:16:05.288442  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:05.288954 10842 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:05.284852 10555 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:05.289321 10860 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:05.289538 10555 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.289877 10860 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.290585  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.290812 10860 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.291455  8836 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:05.292331  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:05.286051  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 119361us
I20260709 13:16:05.293190  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:05.283861  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 115429us
W20260709 13:16:05.294178  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.294404  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:05.294714  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.295485  8844 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:05.295439  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.296448  8842 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.289942 10555 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.297715  8842 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:05.298782  8732 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.774s (SENT)
I20260709 13:16:05.299186  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:05.294251  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.308444  8840 raft_consensus.cc:2368] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:05.309540  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.310745  8839 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.194451 10504 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.311782  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.312408  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:05.313323  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.315819  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.317327  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.317773  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:05.318027  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.194310 10838 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.318727  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.195843 10669 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.335204  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.336009  8840 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.320039  8843 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:05.337498  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.320914  8914 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:05.338135  8763 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:05.334156  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:05.286224 10750 consensus_meta.cc:287] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 13:16:05.279326 10543 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:05.322392  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.339043  8913 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:05.322713  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:05.319331  9431 leader_election.cc:336] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.653s (SENT)
I20260709 13:16:05.320101  8837 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.326886  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:05.284819 10879 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.329643  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.330715  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.330363  8842 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.353812  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.289352 10640 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.289350 10842 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:05.361500  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.362099  8836 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:05.364243  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.342777  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.344720  8916 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:05.332772  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.331817  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.371786  8836 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.351560  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:05.341768  8838 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.354794  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.356230  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.380641  8766 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:05.358551  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.358840  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.383723  8842 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.359637  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.310880 10868 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:05.390081  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.394222  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.394821  8839 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.395473  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.396142  8761 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:05.409019  8842 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:05.355243 10306 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:16:05.340723 10725 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.415375  8844 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.318877 10880 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:05.194036 10778 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.361102 10603 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:05.357357  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:05.395473  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.318163 10407 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:16:05.397274 10859 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:05.429993 10362 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.432145 10852 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.437157 10554 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:05.438422  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.341238 10869 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 13:16:05.440704  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.472777  8838 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:05.441762  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.360508 10543 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:05.334472 10870 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:16:05.387357  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:05.492820 10888 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:05.427663  8837 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
W20260709 13:16:05.462575  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.144s (SENT)
I20260709 13:16:05.498526  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:05.443773  8763 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.463987  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.500623  8836 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:05.393357 10640 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.442874 10877 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:05.439635  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.471140  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.476981  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:05.504931  8769 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.504072  8842 raft_consensus.cc:2376] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3. Re-sending same reply.
I20260709 13:16:05.479149  8912 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:05.410037 10865 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:16:05.481920  8917 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:05.354272 10750 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.388280 10669 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.468540  8839 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.426554 10838 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:16:05.478866  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.526309  8843 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:16:05.507207  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.447180 10725 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.506107  8768 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.444023 10603 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:05.522677  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.501891 10671 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:05.564306  8840 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
W20260709 13:16:05.567699  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.535068  8911 raft_consensus.cc:2368] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7.
I20260709 13:16:05.570482  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.535399 10603 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.572685  8840 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.535877 10306 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:05.502308 10554 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.553746 10640 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:05.551672 10879 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:05.574338 10878 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:05.551709 10750 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:05.529436 10669 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.580384 10870 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.517254 10877 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.544111 10725 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.602016 10786 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.603688 10863 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.604329 10786 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.605232 10669 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:05.606501 10362 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:05.608419 10877 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:05.578846 10543 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.608934 10554 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:05.746182  9465 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:05.698412  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.622612 10555 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.700033  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:05.734577  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 271844us
I20260709 13:16:05.699654  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.755280  8836 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.700793  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.756656  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.758214  8840 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.758005 10555 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.713804  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:05.727182  8915 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:05.759847  8912 raft_consensus.cc:606] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:05.760456  8912 raft_consensus.cc:614] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.761093  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:05.703125  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.763602  8842 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.761962  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.763593  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.698412  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:05.744056  9464 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.009s
I20260709 13:16:05.714129  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.701819  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.714131  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.784710  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.785980  8910 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.786517  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:05.787796  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.787786  9464 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
W20260709 13:16:05.789290  9464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 313) took 1511 ms (client timeout 1889 ms). Trace:
I20260709 13:16:05.612848 10852 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:05.789974  9464 rpcz_store.cc:269] 0709 13:16:04.278370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.282497 (+  4127us) service_pool.cc:224] Handling call
0709 13:16:05.081610 (+799113us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:05.789157 (+707547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13700992}
I20260709 13:16:05.621532 10872 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.792740 10872 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:05.793385  8836 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.791884  8841 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.782193  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.800920  8842 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.801667  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.614086 10664 raft_consensus.cc:1064] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:16:05.805171  8912 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:05.794248 10872 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.813570  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.613385 10853 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:05.824404 10853 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.816876  8842 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:05.821460  8914 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:05.825959 10853 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.826861  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.825870  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.828215  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.599725 10870 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.823580  8843 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.829840 10863 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.830193  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.831207  8843 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:05.831593  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.832522  8843 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.835727  8914 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:05.835042 10870 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.828953  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.825902  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.838433 10872 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.838585  8843 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.832902  8839 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:05.846462  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.827328 10853 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.850253  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.851889  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:05.852239  8909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1424) took 1524 ms (client timeout 1829 ms). Trace:
I20260709 13:16:05.852965  8917 raft_consensus.cc:2368] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:16:05.854395  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.855767  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.848505  8840 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.860153  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.852496 10897 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:16:05.862902  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:05.863746  8840 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.875013  8836 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:05.877560  8768 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.878228  8766 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:05.879565  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:05.883036  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.885627  8840 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:05.889218 10870 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.891090  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:05.891711 10870 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:05.852746  8909 rpcz_store.cc:269] 0709 13:16:04.327541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.333000 (+  5459us) service_pool.cc:224] Handling call
0709 13:16:05.851870 (+1518870us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54000389d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:05.852070 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669027584}
I20260709 13:16:05.892282  9464 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:05.883101  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:05.886091  9459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 197) took 1450 ms. Trace:
I20260709 13:16:05.899748  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:05.904523 10743 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.905210 10743 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.886459 10664 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.907356  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.908460  8911 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:05.909315  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.909833  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.910804  8911 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:05.911556  8909 raft_consensus.cc:1217] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-5.4]   Dedup: 2.2->[3.3-5.4]
I20260709 13:16:05.911899 10749 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.912184  8909 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [2.2-5.4]
I20260709 13:16:05.913053  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:05.917347  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:05.918871  8765 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:05.925105  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.925117  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.920205  8909 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:16:05.927752 10690 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.927971 10841 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:05.928524 10690 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.934172 10690 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:05.934540  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:05.934835 10665 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.934973 10690 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.935616 10665 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.936393 10690 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.937083  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:05.939188 10690 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.940685  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.941781  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.942476 10870 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.942828  8836 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
W20260709 13:16:05.943421 10889 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 13:16:05.931636  8764 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.945079  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.945966  8909 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 1.
I20260709 13:16:05.946002  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:05.946902  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.947521  8912 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:05.947746  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 64952.3us
I20260709 13:16:05.948261  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.937310 10643 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:05.948742  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.949116 10643 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.949664 10643 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:05.950244  8768 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.952309  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:05.930121  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:05.952877  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:05.953249  9463 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:05.949836 10750 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:05.954069  8732 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.503s (SENT)
I20260709 13:16:05.954164 10750 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:05.955629 10750 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:05.956688 10665 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:05.900166  9459 rpcz_store.cc:276] 0709 13:16:04.430318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.440998 (+ 10680us) service_pool.cc:224] Handling call
0709 13:16:05.878989 (+1437991us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:05.880807 (+  1818us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16136960}
I20260709 13:16:05.957719  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:05.958758 10886 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.455s	user 0.002s	sys 0.004s
I20260709 13:16:05.959775 10897 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:05.962461 10900 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:16:05.963022  9463 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:05.953344  8763 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:05.932642  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:05.906962 10743 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:05.964828  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.989653 10718 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:05.990190 10718 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:05.991680 10718 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:05.992218  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:05.968382 10898 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:16:05.967744  8768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:05.971115  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:05.981930  8842 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.986690  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.000370  8836 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:05.988344  8912 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:05.981930  9431 leader_election.cc:336] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.701s (SENT)
I20260709 13:16:05.973656  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:05.936513  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:05.972486  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.009652 10718 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.010335  8918 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:06.009713  8767 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:05.981410  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:06.012151  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.018425  8765 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:06.014966  8843 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
W20260709 13:16:06.020406  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.020792  8763 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:06.021262  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:06.026343  8768 raft_consensus.cc:606] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.027165  8768 raft_consensus.cc:614] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.981360 10743 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.034037  8766 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:05.976604  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.036310  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.011765  9464 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:06.045037  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.043593  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.040010  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.044497 10786 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.052748  8909 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
W20260709 13:16:06.054843  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 73564.6us
I20260709 13:16:06.037431  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:05.982105 10603 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.064827  8839 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
W20260709 13:16:06.066946  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.062585  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:06.073915  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 68064.8us
I20260709 13:16:06.075753  8916 pending_rounds.cc:85] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 5
I20260709 13:16:06.084479  8769 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:06.085417  8912 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:06.062093  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:06.090611  9434 leader_election.cc:336] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.653s (SENT)
I20260709 13:16:06.091156 10839 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:06.092042  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 100042us
I20260709 13:16:06.093149 10859 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.094692  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.095678  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:06.097599  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 115721us
I20260709 13:16:06.097258  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.082885  8916 pending_rounds.cc:107] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 5.6
W20260709 13:16:06.115258  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.110970  8916 raft_consensus.cc:2889] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.117329  8918 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:06.107298  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.120767  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.123512  8913 raft_consensus.cc:2410] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.120971  8767 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:06.127367  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.130044  8912 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:06.130997  8840 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:06.131214  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.133625 10757 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:06.134699 10757 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:06.137218  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 77389.2us
I20260709 13:16:06.115267 10859 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:06.138985 10859 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.140377  8765 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:06.141827  8764 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:06.144075  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 96099.9us
W20260709 13:16:06.145886  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.132783  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.145149  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:06.125928  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 189676us
I20260709 13:16:06.150622  8763 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:06.118968 10725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.002s	sys 0.011s
I20260709 13:16:06.151142  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:06.155927  8909 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:06.162446  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:06.161633  8732 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.560s (SENT)
I20260709 13:16:06.165926  9461 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:06.173794 10750 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.175998 10407 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.176535 10407 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.176968 10407 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.177225  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.175922  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.182466  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.182794 10839 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:06.184156  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 75996.6us
I20260709 13:16:06.185195  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.185736 10872 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:06.186467 10872 consensus_queue.cc:1243] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:06.186753  8840 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:06.186988 10872 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:06.187958 10603 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:06.188931 10665 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:06.188719 10407 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.189540 10665 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:06.189775 10906 log.cc:927] Time spent T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:16:06.190622 10665 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.183153  8915 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:06.192612  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.194430  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:06.195166  9463 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.195792 10643 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.164458  9465 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:06.198736 10701 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:06.199709  9467 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEARNER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:16:06.186887  8735 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.511s (SENT)
I20260709 13:16:06.200624  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.201283  8915 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
W20260709 13:16:06.154927 10725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.003s	sys 0.011s
W20260709 13:16:06.207435  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.209137  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:06.209131  8732 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.638s (SENT)
I20260709 13:16:06.209954  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.214043  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.218930  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:06.208046 10664 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:06.205377 10407 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:06.221131  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.225665 10807 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.226047  8760 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:06.226511  8760 pending_rounds.cc:85] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 2
I20260709 13:16:06.226890  8760 pending_rounds.cc:107] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:06.227198  8760 raft_consensus.cc:2889] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.222618 10897 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:06.228140  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:06.229089  8839 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.230189 10897 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.221922 10749 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:16:06.237386  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.238278  8914 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:06.239223  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.242815 10757 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:06.222257 10664 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.244390 10664 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:06.245177 10869 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:06.245894 10869 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.247658  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:06.248363 10869 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:06.254737 10722 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:06.255239 10722 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:06.256274 10722 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.257349  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.257810 10722 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.258227  8760 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
W20260709 13:16:06.256839  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.226580 10807 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:06.261943  8914 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:06.263136  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.262760 10807 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.264371  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.232542 10897 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:06.265563  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:06.265856  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65449.1us
W20260709 13:16:06.266582  8732 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.653s (SENT)
I20260709 13:16:06.266718 10839 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.267366  8884 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.268465 10743 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.271632 10778 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.272730  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.273042 10869 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.273823  8884 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.273598 10869 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.274914 10727 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:06.275849 10893 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.670s	user 0.003s	sys 0.000s
I20260709 13:16:06.276263 10869 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:06.276521 10543 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:06.277042 10543 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:06.278401  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.278270 10543 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.279631  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.280618  8915 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:06.281817  8914 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.282881  8767 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:06.281773  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.280542  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1413) took 1981 ms. Trace:
I20260709 13:16:06.268528  9461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 202) took 1264 ms. Trace:
I20260709 13:16:06.289273 10603 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.286116  8910 rpcz_store.cc:276] 0709 13:16:04.298764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.299875 (+  1111us) service_pool.cc:224] Handling call
0709 13:16:04.300247 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.786578 (+1486331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.280198 (+493620us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540036fbd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:06.280464 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3415341952}
I20260709 13:16:06.291571 10852 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.256482  9464 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:06.293540  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 106679us
I20260709 13:16:06.297420  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.297451 10853 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:06.298645  8910 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.292059 10852 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.300194 10852 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.302179 10842 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.303653 10842 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.289305  9461 rpcz_store.cc:276] 0709 13:16:05.004185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.005396 (+  1211us) service_pool.cc:224] Handling call
0709 13:16:05.015595 (+ 10199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.182576 (+1166981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.267548 (+ 84972us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5400650a20. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd11dc0 00007fce6fd9da02 00007fce6fd99dd6 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:16:06.268178 (+   630us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400650254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:06.268449 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583773696}
I20260709 13:16:06.305737 10743 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.306530 10743 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:06.309914  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:06.311038  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:06.311931 10736 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:06.312433 10917 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:06.313102 10917 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.313778  8809 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:06.314714  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.316252 10917 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:06.318014 10750 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.318552 10750 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:06.319527 10750 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.320261  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.321132 10603 raft_consensus.cc:2764] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:06.299611  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.322577 10863 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:06.323026 10863 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:06.323994 10863 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:06.325732  8735 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.560s (SENT)
I20260709 13:16:06.326186  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.327128 10836 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:06.327334  8735 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.653s (SENT)
I20260709 13:16:06.327690  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.267776 10839 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:06.329030  9461 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:06.307958 10743 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.327770  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.342136  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:06.352046  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 152529us
I20260709 13:16:06.360544  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.364195  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.375573  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.375665  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.376482  8914 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:06.383353  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.383625  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.384065  8915 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:06.386216  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.348359 10853 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.344960 10836 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.360889 10643 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:06.402704  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.323022 10603 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
W20260709 13:16:06.405706  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.409358  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82036us
I20260709 13:16:06.410943  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.412796  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:06.419009  8915 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:06.383873 10863 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.421109  8767 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:06.421489  8767 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:06.415038  8910 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:06.387989 10690 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:06.420912  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.404628  8917 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:06.436305  8914 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:06.423523  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.424225 10868 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:16:06.477823  8761 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.397534 10725 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:06.433053  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.441277  8915 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:06.389635 10870 consensus_queue.cc:1175] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "773340b2958e4af5b2010b902b9e9c04" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:16:06.368285  8911 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:06.457963 10859 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.465001 10642 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:06.465921 10671 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:06.402031  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.400457 10872 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:16:06.499289  8765 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 4: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:06.469945 10543 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.471937  8912 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:06.473831 10727 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:06.482074  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 168404us
I20260709 13:16:06.480688  8762 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:06.503255  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:06.485239  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.487214  8839 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:06.492527  8918 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:06.494684  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:06.467697  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.486115 10736 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:06.512624  8732 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.795s (SENT)
W20260709 13:16:06.514863  8735 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.795s (SENT)
I20260709 13:16:06.515419  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:06.527232  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.486531  9463 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:06.493878 10642 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:06.535919  8909 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:06.536170  8918 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:06.537429  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.544760  8917 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.514372 10671 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.549909  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.551015  8912 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.554095  8915 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:06.549127  8767 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.557165  8915 pending_rounds.cc:85] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:16:06.557549  8915 pending_rounds.cc:107] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:06.557839  8915 raft_consensus.cc:2889] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.533056  8760 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:06.543146 10701 raft_consensus.cc:2764] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:06.560186  8918 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:06.571975 10853 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:06.573172 10868 consensus_queue.cc:1243] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:06.573585 10690 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:06.573804  8767 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:06.574051 10725 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:06.574784  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.585314  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82386.6us
I20260709 13:16:06.594170 10852 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.600075  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1366) took 1309 ms. Trace:
W20260709 13:16:06.627797  8735 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.816s (SENT)
I20260709 13:16:06.555729 10872 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:06.600250  8766 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:06.601560 10859 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:06.603279  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:06.603880 10841 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.592763 10736 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.607944 10869 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.652760  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.619289 10842 raft_consensus.cc:2764] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:06.628265  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.628010  8841 rpcz_store.cc:276] 0709 13:16:05.291081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.312753 (+ 21672us) service_pool.cc:224] Handling call
0709 13:16:05.313026 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:05.802897 (+489871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.578273 (+775376us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54001fd6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:06.599978 (+ 21705us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1100177792}
I20260709 13:16:06.623301 10853 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.610284 10664 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:06.665659  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 353781us
I20260709 13:16:06.653537 10869 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:06.678753  8766 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:06.688783  8913 raft_consensus.cc:2368] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9.
I20260709 13:16:06.662603 10853 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.693689  8768 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:06.694387  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:06.670038 10603 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:06.686420 10727 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:06.700511  8916 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:06.707039  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:06.706894  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 331286us
I20260709 13:16:06.709411  8912 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:16:06.701922  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 49280.7us
W20260709 13:16:06.712380  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 84622.3us
I20260709 13:16:06.715643  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:06.729269  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 123517us
W20260709 13:16:06.731735  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.732751  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:06.712152 10786 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.735824  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.735762  8839 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:06.738492  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.711601 10852 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:06.718739 10603 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.745061  8807 leader_election.cc:400] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:16:06.745519  8807 leader_election.cc:403] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:06.745868  8762 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.748546  8842 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.743657  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:06.729336 10690 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.750243  8768 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:06.750799  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:06.756839  8735 leader_election.cc:336] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 2.046s (SENT)
I20260709 13:16:06.757874  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.764046 10727 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.764467 10671 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.766782 10671 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:06.768663 10926 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:06.770772 10926 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.770767 10869 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.772792 10869 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.773674 10926 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:06.773850 10642 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.775116 10642 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:06.776712 10836 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:06.777186 10836 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:06.778124 10836 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.730404 10725 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.779435 10836 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:06.781136  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48770.8us
W20260709 13:16:06.782274  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 138) took 2385 ms (client timeout 1653 ms). Trace:
W20260709 13:16:06.782737  8835 rpcz_store.cc:269] 0709 13:16:04.396517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.405711 (+  9194us) service_pool.cc:224] Handling call
0709 13:16:06.781840 (+2376129us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54003a5f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:06.782067 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5103509248}
I20260709 13:16:06.783421  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:06.739879 10743 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:06.785693 10925 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:16:06.788580  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:06.789508  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.719326 10701 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:06.794730 10807 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:06.794911 10554 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:06.795849 10842 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:06.796480 10842 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:06.797014 10842 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:06.798234 10932 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.798934 10932 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.799346 10932 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:06.801343  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50337.2us
W20260709 13:16:06.801755 10921 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:16:06.802089  8735 leader_election.cc:336] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 2.200s (SENT)
I20260709 13:16:06.802570  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:06.805197  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64870.3us
W20260709 13:16:06.806175  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.806222  8767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "405e426995614183bb2a212fc38e04b0"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:06.807415  8767 raft_consensus.cc:606] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:06.807842  8767 raft_consensus.cc:614] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.811168 10931 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:06.812587  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.805068  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:06.818328 10786 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:06.828588 10749 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:06.850117 10664 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:06.870363  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 153291us
I20260709 13:16:06.856747 10750 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:06.854761 10859 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:06.878366  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 69793.3us
I20260709 13:16:06.880750 10786 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:06.881753  8768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4128699de59a470a9275f001cbd35515"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:06.882385  8768 raft_consensus.cc:606] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.882752  8768 raft_consensus.cc:614] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.867903 10743 consensus_queue.cc:1243] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:06.880378  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:06.865022 10839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60040 (request call id 73) took 3229 ms. Trace:
I20260709 13:16:06.887161  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.886133 10665 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.892778 10784 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:06.900224  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 138274us
I20260709 13:16:06.891412 10852 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.892885 10665 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.889564 10941 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:06.910120  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.893716  9465 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:06.909561  8735 leader_election.cc:336] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 2.343s (SENT)
I20260709 13:16:06.921728  8769 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:06.909687 10870 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:06.934832 10665 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:06.910422 10947 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:16:06.920583  8760 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.922744  8761 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.888411 10543 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:06.889622 10859 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.923061  8768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:06.921626  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.917122 10726 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.932364  8762 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:06.922039  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:06.935406  8769 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:06.949034  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.951669  8768 raft_consensus.cc:606] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:06.952139  8768 raft_consensus.cc:614] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.943727 10749 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:06.916771  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1444) took 1200 ms. Trace:
W20260709 13:16:06.957093  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.958184  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:06.955485  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 80859.4us
I20260709 13:16:06.961102  8839 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:06.961580  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:06.962368  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.904126 10750 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:06.918704 10932 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:06.904126 10690 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:06.977662  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:06.961300  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:06.981313 10954 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.981796 10954 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:06.981987 10750 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:06.973527  8765 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:06.983431  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:06.977721  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.890009 10839 rpcz_store.cc:276] 0709 13:16:03.616126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.616318 (+   192us) service_pool.cc:224] Handling call
0709 13:16:03.965872 (+349554us) log.cc:844] Serialized 494 byte log entry
0709 13:16:04.835515 (+869643us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b5400073b20. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd0fdbe 00007fce6fd1a930 00007fce6fd1a8d8 00007fce6fd1a858 00007fce6fd1a813 00007fce6fd19a9c 00007fce75c05626 00007fce75bffdd8 00007fce6fd567cb 00007fce6fd592c0
0709 13:16:05.029140 (+193625us) spinlock_profiling.cc:243] Waited 7.71 ms on lock 0x7b18001753e0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fdd6d01 00007fce6fd13691 00007fce6fcf3eaa 00007fce6fcfad53 00007fce6fcfacd9 00007fce6fcfac69 00007fce6fcfac31 00007fce6fcf9dfd 000000000038f354 000000000038f199
0709 13:16:05.933016 (+903876us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b4c004f8cc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e066a20 00007fce6e077a29 00007fce6e07813f 00007fce6e03c2ab 00007fce6e069f3c 00007fce6e06a3fe 00007fce6e2f750b 00007fce6fcf6381 00007fce6fcf426b 00007fce6fcfad53 00007fce6fcfacd9
0709 13:16:06.845196 (+912180us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":4716,"mutex_wait_us":24081,"raft.queue_time_us":110641,"raft.run_cpu_time_us":17531,"raft.run_wall_time_us":1693284,"spinlock_wait_cycles":138189440,"thread_start_us":211346,"threads_started":1,"wal-append.queue_time_us":321153,"wal-append.run_cpu_time_us":5969,"wal-append.run_wall_time_us":1524729}
I20260709 13:16:06.990339  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:06.991976  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c79353780ac54a25bd9999800873bbeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:06.986476  8839 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:06.993808  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:06.910511 10841 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 13:16:06.987039 10951 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:16:06.977715 10749 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.982235  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.959677 10701 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:07.003432  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:06.961428 10603 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:06.982234 10954 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:07.012902  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.012605  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 103115us
I20260709 13:16:07.018173  8764 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:07.024515  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.001004 10870 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.005257  8762 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 2. (index mismatch)
I20260709 13:16:07.005795  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:07.022636  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101117us
I20260709 13:16:07.012172  8915 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 2. (term mismatch)
W20260709 13:16:07.011921 10948 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:16:07.033632  8915 pending_rounds.cc:85] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 1
I20260709 13:16:07.033974  8915 pending_rounds.cc:107] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 5.2
I20260709 13:16:07.034273  8915 raft_consensus.cc:2889] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.005177  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:07.001204  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:07.038950  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:07.013430 10859 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.012795 10868 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:07.046728 10868 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:07.047204  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.047374 10853 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:06.999200 10941 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:16:07.035478 10690 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:07.040663 10932 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.040479 10953 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.036454 10750 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:16:07.050604 10932 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.027040 10603 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:16:07.048522  9434 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:07.057005  8735 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 2.414s (SENT)
W20260709 13:16:07.062701  8654 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 61685.5us
I20260709 13:16:07.065017  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.053058 10554 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.066267 10554 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:07.066892  8764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:07.012303 10937 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 13:16:07.074944  8764 raft_consensus.cc:606] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.081522  8764 raft_consensus.cc:614] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:07.015868 10935 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:07.052850 10932 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.079377  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.078377  8839 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:07.063685 10722 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.106397  8884 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.055866 10947 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:07.107409  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 125371us
I20260709 13:16:07.026121 10749 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.068883 10941 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.079689 10554 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.122056  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:07.108712 10935 consensus_queue.cc:1243] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:07.068594 10555 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 13:16:07.134745  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62908.4us
I20260709 13:16:07.135869  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.138458  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.083180 10870 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.112251 10941 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:07.143198 10870 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.143910 10870 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.144074 10941 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.123339 10841 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.155231  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.127941 10786 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.048067 10868 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:07.159654  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 102919us
W20260709 13:16:07.181486  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58434.3us
I20260709 13:16:07.182713  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.123224 10842 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.185634  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.188293  8916 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:07.184578  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.189354  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.141554  9464 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:07.187371  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.190541  8918 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:07.195742  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.195863  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:07.199796  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 207296us
I20260709 13:16:07.160519 10778 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.156131 10664 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:07.211648  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.214529  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.215432  8915 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:07.169332 10786 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.219133  8912 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:16:07.181919 10863 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:07.167892 10940 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.154840 10690 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:16:07.226493  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.227280  8910 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.229303  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:16:07.230960  8918 raft_consensus.cc:606] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Received request to transfer leadership
I20260709 13:16:07.224992 10727 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:16:07.225520 10705 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.236506 10870 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.238991 10870 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:07.239638  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57048.1us
I20260709 13:16:07.240115  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:06.960515  8911 rpcz_store.cc:276] 0709 13:16:05.707826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.911664 (+203838us) service_pool.cc:224] Handling call
0709 13:16:05.912453 (+   789us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:06.010818 (+ 98365us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:06.087940 (+ 77122us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.224924 (+136984us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:06.324812 (+ 99888us) log.cc:844] Serialized 582 byte log entry
0709 13:16:06.359368 (+ 34556us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:06.812359 (+452991us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.888243 (+ 75884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.891660 (+  3417us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:06.898195 (+  6535us) raft_consensus.cc:1685] finished
0709 13:16:06.898217 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:06.908209 (+  9992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66211,"prepare.queue_time_us":122313,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":76904,"raft.run_cpu_time_us":487,"raft.run_wall_time_us":4231,"thread_start_us":119545,"threads_started":2,"wal-append.queue_time_us":170996}
I20260709 13:16:07.168213 10930 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:16:07.245219 10935 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:07.246454 10935 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:07.247687  9463 consensus_meta.cc:287] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.002s
I20260709 13:16:07.248167  9463 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:07.248283 10935 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:07.225904 10932 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.249260 10932 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.195601 10853 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:07.252588 10842 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:07.254281 10955 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.186s	user 0.003s	sys 0.000s
I20260709 13:16:07.254379 10749 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:07.255381  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.261174  8915 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:16:07.265010  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.220556 10947 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.217935 10664 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.263152  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:07.280128  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.224189 10786 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:07.283562  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.256613 10863 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:07.248756 10935 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:07.225461 10836 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:07.301067  8910 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:07.308588 10603 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.309381  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:07.309986  8761 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:07.310987  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:07.311533  8761 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.297636 10946 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:16:07.292277 10953 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.313993 10953 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:07.314368 10953 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.317116 10965 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.317565 10863 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.321591 10603 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:07.325078 10836 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.326444  8735 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.328069 10836 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.328680 10932 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.328848 10603 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.332577 10842 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:07.339566  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.342013  8913 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:16:07.284191 10664 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.334231  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:07.345182  8916 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:07.346640  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.348102  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:07.351552  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 182021us
W20260709 13:16:07.352957  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89465.9us
I20260709 13:16:07.357843  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.335163  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.361083  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.347734 10928 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.348379 10859 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:07.365790  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.371688  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.372368  8916 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:07.258533 10940 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:07.364063 10869 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.591s	user 0.015s	sys 0.000s
I20260709 13:16:07.372691  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.361008 10932 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.356266  9464 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:07.391021  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.369315 10836 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:07.394390  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:07.395829  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 150812us
I20260709 13:16:07.370945 10784 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.397219  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:07.397811  8764 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.398074  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.367057 10928 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:07.401062  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46695.6us
I20260709 13:16:07.371351  8911 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:07.369763 10859 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:07.402412 10928 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.415817  8807 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:07.422276  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 87190.9us
I20260709 13:16:07.405901 10931 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:07.406736 10671 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.407174 10836 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:07.385208 10966 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:07.432749 10967 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.433379 10786 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.434087 10926 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.431479 10872 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.435489  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:07.435587  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:07.442965  8764 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:07.444754  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.432231 10671 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:07.454396  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.445016 10701 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:07.385794 10935 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.444612 10931 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:07.459033  8762 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.462988  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:07.409708 10784 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:07.459702 10642 consensus_meta.cc:287] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.684s	user 0.014s	sys 0.000s
W20260709 13:16:07.475878  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 217694us
I20260709 13:16:07.476945 10749 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:07.477836 10976 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.479158  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:07.480429 10970 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:16:07.481400 10969 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:07.474628 10971 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.482182 10947 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.456709 10671 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.456789 10932 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.485304  8762 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:07.453613 10872 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.496631 10940 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:07.497437  8909 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:07.499966  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68625us
I20260709 13:16:07.503407  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.504091 10722 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.504567  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.504988 10872 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.505786  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.506352 10940 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.507041 10940 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.509038 10926 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:07.501278  8764 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:07.507058  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.511220  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.512204 10976 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:07.515591  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.515714 10976 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.516321  8910 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:07.519270  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.521231  8761 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:07.500689 10749 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:07.513662  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.502471 10932 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.523510 10940 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:07.522661 10642 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.460453 10859 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.509874 10836 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.543417  8764 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:16:07.549932  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.522826 10872 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.534276 10554 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.527272 10603 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.545359 10932 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.565361  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:07.584173  8764 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.502738 10971 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.569854 10786 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:07.578613  9465 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:16:07.585690  9465 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:07.555917 10931 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:07.566278  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52708.3us
I20260709 13:16:07.586697 10971 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:07.587095  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:07.587040  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:07.552888 10642 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:07.581748 10930 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.549852 10953 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.633111  9467 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:07.560936 10603 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.589964  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:07.557583 10954 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.523s	user 0.000s	sys 0.015s
W20260709 13:16:07.595520  8735 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.503s (SENT)
I20260709 13:16:07.637346  8735 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.565975 10982 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:16:07.636523  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:07.637415  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47530.2us
W20260709 13:16:07.641660  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54695us
I20260709 13:16:07.631906  8764 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:07.646184  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 147) took 1260 ms. Trace:
I20260709 13:16:07.651127  8769 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:07.652801  8769 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:07.646802  8763 rpcz_store.cc:276] 0709 13:16:06.376851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.377020 (+   169us) service_pool.cc:224] Handling call
0709 13:16:06.393662 (+ 16642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.478568 (+ 84906us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:06.709127 (+230559us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.916476 (+207349us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b1800431bc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:07.544164 (+627688us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b1800431bc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287
0709 13:16:07.634048 (+ 89884us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.637367 (+  3319us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.637422 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:07.637464 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.637524 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.637642 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25119,"prepare.queue_time_us":369064,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":74,"raft.queue_time_us":18408,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"spinlock_wait_cycles":24665728,"thread_start_us":341876,"threads_started":4,"wal-append.queue_time_us":164417}
I20260709 13:16:07.658381  8769 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:07.636646 10971 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.636466 10603 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:07.670102  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 141776us
W20260709 13:16:07.676050  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 80569.2us
I20260709 13:16:07.676177  8768 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:07.654348 10842 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:07.645491 10954 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.560958 10749 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.669569 10947 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:07.672972 10986 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.709403 10986 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.709951 10986 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:07.712916  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 66649us
I20260709 13:16:07.691110  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:16:07.713757  8918 raft_consensus.cc:606] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Received request to transfer leadership
I20260709 13:16:07.636790 10930 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.715131 10928 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.716523 10930 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:07.697744 10842 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.717378 10928 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:07.717818 10842 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.709362  8768 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:07.695860 10926 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:07.719310  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.719782 10926 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:07.691318 10927 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:07.720031  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:07.720402 10952 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:07.720423 10927 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:07.721027  8768 raft_consensus.cc:2368] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:16:07.721305 10927 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:07.722259  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:07.679340 10971 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.703308 10543 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:07.723778 10950 raft_consensus.cc:2764] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:07.724591 10971 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:07.700764 10953 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.727217 10842 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.706192 10954 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.706641  8837 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.723779 10543 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:07.729945 10543 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:07.699957  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.714625 10554 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:07.731455 10543 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.718117  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:07.732075  8835 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.720940 10664 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.694670 10642 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:07.682438  8735 leader_election.cc:336] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.505s (SENT)
I20260709 13:16:07.735512  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:07.735978  8837 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
W20260709 13:16:07.741839  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 244146us
I20260709 13:16:07.745311  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.750314 10953 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.750835 10953 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:07.752970  8807 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:07.720161 10926 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:07.721009 10952 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:07.763515  9467 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:07.766588  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 89826.8us
I20260709 13:16:07.745165 10869 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:07.771633 10842 consensus_queue.cc:1059] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:07.772789  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:07.783078  9467 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:07.769349 10952 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:07.775511 10954 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.800768  8835 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
W20260709 13:16:07.800719  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46285us
I20260709 13:16:07.802878  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:07.804013  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:07.804394 10995 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:07.804818  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.806102 10929 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:07.807833 10986 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.810266 10705 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:07.810846 10705 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:07.811112 10961 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.529s	user 0.004s	sys 0.000s
W20260709 13:16:07.811829 10993 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:16:07.811951 10705 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.812561  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1406) took 1096 ms. Trace:
W20260709 13:16:07.813606 11000 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:16:07.813066 10953 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.759466 10940 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:16:07.814859 10664 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:07.773108 10603 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.815590  8843 rpcz_store.cc:276] 0709 13:16:06.716208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.726181 (+  9973us) service_pool.cc:224] Handling call
0709 13:16:06.726590 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.863993 (+137403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.864026 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.876727 (+ 12701us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.111271 (+234544us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:07.111309 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.111385 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.751247 (+639862us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:07.812253 (+ 61006us) raft_consensus.cc:1685] finished
0709 13:16:07.812273 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.812495 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16916,"raft.queue_time_us":38029,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":5060864,"thread_start_us":317544,"threads_started":2,"wal-append.queue_time_us":331492}
I20260709 13:16:07.837416  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:07.841883  8768 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:07.839748  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:07.787772 10932 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.845942 10784 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:07.850368  8762 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:07.850813  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:07.852187  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 49403.7us
I20260709 13:16:07.889391 10859 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.890201  8768 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:07.890404  8807 leader_election.cc:400] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9.
I20260709 13:16:07.890038 10543 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:07.891690 10543 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.854115 10995 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:07.776963 10926 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.827118 10954 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.867381 10868 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.869879  8765 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:07.871387  8766 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:07.872191 10603 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.791807 10671 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:07.892807  8768 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:07.874905  8769 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:07.914058  8768 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.915602  8768 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:07.915761  8769 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:07.894438 10998 raft_consensus.cc:3055] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:07.917434 10998 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:07.899092  8843 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 13:16:07.918397  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:07.919034  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.919425  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.900640  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.899685  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.920475  8912 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:07.900960  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.884284 10957 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:07.900135  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.910308  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:07.902556  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:07.923342 10998 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:07.924332  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.919452  8768 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:07.883383  8808 leader_election.cc:400] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:16:07.903195  8911 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:07.925328  8808 leader_election.cc:403] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:07.902199  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.925477  8909 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:07.926055  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:07.926352  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.926627  8911 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:07.927472  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.928066  8911 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:07.928359 10957 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:07.928470  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.903730  8917 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:07.906013  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.904289  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.911202  8765 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:07.897521 10947 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.928759 10957 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:07.927968 10988 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5.
I20260709 13:16:07.929549 10750 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:07.905714  8910 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:07.930630 10736 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.943563  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.903472  8916 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:07.909300  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:07.906935  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.945122  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.933768  8918 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.906665  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.934914  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:07.877485 10932 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.934211  8768 pending_rounds.cc:85] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 3
I20260709 13:16:07.934983  8769 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:07.950644  8768 pending_rounds.cc:107] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:07.938674  8835 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:16:07.938619  8837 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:07.901587  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:07.908100 11001 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
I20260709 13:16:07.951038  8768 raft_consensus.cc:2889] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.944054 10976 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:07.938807 10950 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:16:07.901635 10999 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:07.908674 10954 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.909374 10839 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.902927 10926 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.964381  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.895238 10995 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:07.936376 10957 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:07.967803  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.966840  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:07.969026 10932 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:07.971771  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 203039us
I20260709 13:16:07.893091 10543 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:16:07.959833 10941 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.947819 10946 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:07.981213  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:07.969350 10999 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:07.979029  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.005192  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:08.005548  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:08.011265 10992 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:08.012423  9467 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:16:08.012828  8651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 106305us
I20260709 13:16:07.943370 10947 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.016134 10947 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.968392 10671 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.021565  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:08.021849  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:07.994664 10743 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:08.024204  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.025315  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.028955  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:08.029647  9467 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:07.995675 10986 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:07.995105 10995 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:08.035526  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.036593  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42810
I20260709 13:16:08.003180 10750 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.038702  8909 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:08.039304  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:08.039314  8918 raft_consensus.cc:606] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Received request to transfer leadership
I20260709 13:16:08.042302  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:07.995267 10929 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:16:07.981439 10988 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:16:08.027386 10853 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:07.993268 10839 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.053898  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.057801  8735 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:08.058055  9467 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:08.058593  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.058842  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.054742  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.068562  8761 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:08.000816 10932 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.063663  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.068923  8766 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:08.064653  9465 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:08.042898 10836 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:08.096835  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.042837 10671 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.036254 10736 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:16:08.102131  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.114599  8910 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:08.036026 10927 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.097868 10999 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.117446 10927 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.117738  9464 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:08.069676 10749 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:16:08.118585 10982 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.119240  9463 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:08.119136 10982 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.062069 10952 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.120369 10967 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.120896 10967 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.121727 10952 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.100998  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:08.122548 10727 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.124277 10727 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:08.124879 10998 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:08.125391  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:08.125918  8837 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:08.128381  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:08.122822  9461 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.042117 10642 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:16:08.122848 10853 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:08.065409 10743 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:08.116659 10999 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:08.056077 10664 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:16:08.070340 10863 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.045308 10750 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.128401 10555 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:08.173287 10930 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:08.121740 10982 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.094609 10718 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:08.140010 10690 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:16:08.170888 10928 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:08.197657  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:08.141171  8760 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:08.132436 10954 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:16:08.146147 10927 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:08.202581  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 71858us
I20260709 13:16:08.138790 10671 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.229596  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:08.207580 10743 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:08.214473  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 90580.4us
I20260709 13:16:08.231388  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:08.214818 10930 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:08.202505 10870 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:08.218710 10841 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.241675 10870 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:08.221709  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 99604.8us
I20260709 13:16:08.206725 10749 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:08.224820 10736 consensus_queue.cc:1243] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:08.226501  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:08.209211 10985 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.247748  8917 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.229336  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:08.204066 10555 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.199743 10936 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.216506 10971 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:16:08.243963  8912 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:08.228008 11009 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:16:08.220909 10784 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:08.241983 10841 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:08.284428 11015 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:08.290048 10971 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:08.248785  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:08.230334 10927 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:08.202209 10863 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.257812  8915 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:08.252002 10665 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:08.247141 11023 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:08.254452 10555 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.251926 10664 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.229998 10853 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.301409 10841 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.280210 10985 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:08.252199 10543 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:16:08.307032 11008 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:08.306648 11018 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:16:08.274761 10936 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.296635 10932 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.314729 10985 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.316082  8839 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:16:08.317087  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 67451.4us
I20260709 13:16:08.251844 10749 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.298612 10665 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.295442 10784 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.303154 10954 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:16:08.328120 10941 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:08.305538 10664 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.345589 10671 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.335371 10665 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.353863 11020 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 13:16:08.365077 10784 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.331090 10736 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:16:08.350526 10941 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.349063 10750 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:08.365178 11016 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
W20260709 13:16:08.365502 11012 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:16:08.384588 10863 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.392083  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:08.393469 10664 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.393657  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:08.394932 10870 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.381907 10736 consensus_queue.cc:1243] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:16:08.399780  8914 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:08.400272  8914 pending_rounds.cc:85] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 3
I20260709 13:16:08.400513  8914 pending_rounds.cc:107] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:08.400743  8914 raft_consensus.cc:2889] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.402033  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1149) took 1094 ms. Trace:
I20260709 13:16:08.402441  8767 rpcz_store.cc:276] 0709 13:16:07.307239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.705194 (+397955us) service_pool.cc:224] Handling call
0709 13:16:07.706032 (+   838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.706406 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.706438 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.994491 (+288053us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c00000c88. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:16:08.009118 (+ 14627us) log.cc:844] Serialized 556 byte log entry
0709 13:16:08.135230 (+126112us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:08.135254 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.135346 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.401737 (+266391us) raft_consensus.cc:1685] finished
0709 13:16:08.401756 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.401970 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27874560,"thread_start_us":102571,"threads_started":1,"wal-append.queue_time_us":164516}
I20260709 13:16:08.365077 10749 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.409580  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:08.336004 10927 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.410802 10927 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.412684 10977 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:08.413154 10977 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:08.422438 10977 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.423847 10977 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.425940  8917 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:08.383365 10941 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.408165 10555 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.416124  9461 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:08.386240 10936 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.404399 10957 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.465204  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:08.460474  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:08.482481  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.470714 10936 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:08.482398 10870 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:08.490677 11018 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:08.499410 10859 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.002s
I20260709 13:16:08.486001 10664 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.527702  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 278957us
I20260709 13:16:08.511364 11020 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.529330 11020 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.508901 10870 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:08.514541 11018 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:08.538540 10726 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:08.539000 10726 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:08.502323 10936 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.535715 11020 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.522820 10664 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:08.541765 10931 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.002s	sys 0.012s
I20260709 13:16:08.552553 11025 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.553845 10664 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.545181 10726 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.557199  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:08.555869 10555 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.556752 10870 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.569643  8918 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.558811  8917 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.2-6.2]
I20260709 13:16:08.558815  8909 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:16:08.560247  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.560753  8910 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:08.548539 10995 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.577672  8918 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
W20260709 13:16:08.590242  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.575393 11022 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 13:16:08.582376 10931 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.002s	sys 0.013s
I20260709 13:16:08.598318  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.605584  8918 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:16:08.599675 11028 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.541891 10665 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.608016  8762 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:08.594762 10926 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.001s
I20260709 13:16:08.611842  8844 raft_consensus.cc:2368] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6.
W20260709 13:16:08.608633  8715 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:16:08.612898  8715 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for bac07da6a99849fb8f972372c187ee7b already in progress
I20260709 13:16:08.615274 10807 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:08.615509 10665 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.615909 10807 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:08.613277  8715 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for bac07da6a99849fb8f972372c187ee7b already in progress
I20260709 13:16:08.609095 10957 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.620086 10928 raft_consensus.cc:993] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 3b34c95a175945b88b17f07fbc650abf to start an election
I20260709 13:16:08.643589  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:08.583271 11025 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.648849  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.650202  8843 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:08.653677  8843 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:08.640985 11020 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:08.662060  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.672446  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.672955  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.674722  8843 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.672386  8841 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:08.660550 10957 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:08.638094 10926 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:08.657370 10985 raft_consensus.cc:1081] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Signalling peer 3b34c95a175945b88b17f07fbc650abf to start an election
I20260709 13:16:08.671658  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.585083 11018 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:08.669324 10998 consensus_meta.cc:287] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.006s
I20260709 13:16:08.683035  8837 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:08.647713 10941 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.688987 11020 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.706920  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.715243  8842 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:08.716655 10941 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.717209 10807 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.717586 10995 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.681900 11036 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:08.724009 10928 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:08.725421 11010 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.739s	user 0.000s	sys 0.013s
I20260709 13:16:08.727336 11021 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:08.727804 11021 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:08.690846 11019 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:08.729166 11019 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.729856  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1176) took 1726 ms. Trace:
I20260709 13:16:08.737315  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:08.699301 10927 consensus_queue.cc:1175] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdb96be202c2447586477b2077b7d5bf" responder_term: 4 status { last_received { term: 4 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 4 index: 2 } }
I20260709 13:16:08.730218  8914 rpcz_store.cc:276] 0709 13:16:07.003373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.003503 (+   130us) service_pool.cc:224] Handling call
0709 13:16:07.013271 (+  9768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.401214 (+1387943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.729594 (+328380us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54003af054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:08.729791 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3187782400}
I20260709 13:16:08.742882  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.749228  8841 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:08.705260 10957 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:08.718472 11030 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:16:08.714799 11025 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.771008 10757 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:08.772166 10757 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:08.772538 10757 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:08.773664 10936 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:08.773561 10757 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.777249  8839 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:08.783703  8837 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:08.789389  8841 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:08.790716  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.793746  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.757776 10977 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:08.797176  8843 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:08.798216  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1210) took 1114 ms. Trace:
I20260709 13:16:08.800480  8762 rpcz_store.cc:276] 0709 13:16:07.684278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.906106 (+221828us) service_pool.cc:224] Handling call
0709 13:16:07.906361 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.609460 (+703099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.797932 (+188472us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540037a354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:08.798144 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1613185408}
I20260709 13:16:08.804971  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.748667 11036 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.811537 11020 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.784993 10947 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:08.809870 10957 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.728677 11021 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.801702 10757 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:08.830538  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.830875 10749 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.836035 10749 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.450452  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:08.838235 10749 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.803784 10977 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.849529  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.827489 10982 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:08.852545  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.854305 10839 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.831426 10947 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.858949 10947 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.860886 10982 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.861438 10982 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.865628 10988 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:08.866072 10988 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:08.867187 10982 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.862879 10967 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.866969 10988 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.868191 10988 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:08.872833  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 815044us
I20260709 13:16:08.878499 10952 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:08.881151  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 752789us
I20260709 13:16:08.885449 10836 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:08.843848 11019 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:08.891518  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:08.886886  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:08.899559  8843 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:16:08.900897  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.905119  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.906010  8762 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:08.909142  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.910251  8762 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:08.876560  8735 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:08.922014  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:08.925904  8843 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:08.886198 10836 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:08.908071 10757 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.930711  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.932147  8767 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:08.934151 11025 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.934674 11025 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.936832 11025 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.937865 11025 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:08.938484 11025 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.940901 11025 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:08.897787 10842 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.945396  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.908751 10967 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:08.951882  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.932730  8767 pending_rounds.cc:85] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 2
I20260709 13:16:08.953243  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:08.961153  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:08.959731  8766 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:08.961229  8767 pending_rounds.cc:107] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:08.941424  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:08.962527  8767 raft_consensus.cc:2889] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:08.920620 10940 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.965557  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.964324  8762 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:08.969110  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:08.969332  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.969815  8836 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:16:08.970065  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.970633  8912 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:08.969129  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:08.969822  8914 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:08.974438  8916 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:08.927906 10749 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:08.978420  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1184) took 1074 ms. Trace:
I20260709 13:16:08.981721  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.978791  8915 rpcz_store.cc:276] 0709 13:16:07.903523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.925290 (+ 21767us) service_pool.cc:224] Handling call
0709 13:16:08.255979 (+330689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.298225 (+ 42246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.978232 (+680007us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400319f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:08.978358 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759911680}
I20260709 13:16:08.982357  8768 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:08.982231  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:08.958936  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:08.987795  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:08.960335 10967 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.989737  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.000342  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.993244  8762 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:08.993666  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.005525  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.007678  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:09.000348  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:09.011653  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:09.016455  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.950598 10757 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:08.963836 10842 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.977998  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:08.981426 10872 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.022022  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:08.983028 10952 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:08.987136 10931 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.992506 10932 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.004331 10967 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.038542 10872 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.039369 10952 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:08.976502 10940 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.020458 10998 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:08.945052 10836 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.053946  8762 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:09.049993 11028 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:09.055267 11050 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
W20260709 13:16:09.066355  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.058403  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 171628us
I20260709 13:16:09.058616  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:09.059537  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.072221  8766 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:08.987206 10749 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.060822  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.043819 10842 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.058823 10937 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.077148  8762 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:09.082923  8768 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:09.056286 11020 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:09.067598 10932 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.091233  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.064890 11036 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.092772  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:09.101588  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 225107us
I20260709 13:16:09.094816  8768 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:09.050709 10931 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.065482 10998 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:09.081090 10937 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.120708  8762 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:09.107514  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.112340 11036 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:09.088280 10842 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.120774  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.127558  8768 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:09.138465 10931 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:09.143236  8762 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:09.162403  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 82360.2us
I20260709 13:16:09.162845  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.167404  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.115036 10932 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:09.125666 10937 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.185201  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.186039  8762 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:09.130332 10842 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:09.189465  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.191249  8762 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:09.141975 11060 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:09.194012  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 94180.5us
I20260709 13:16:09.188535 10842 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.208124  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:09.209357  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:09.222054  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:09.141700 11036 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.196587 11060 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.260003  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:09.201762 10839 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:09.204737 11043 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.275007  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 167589us
I20260709 13:16:09.275861  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.229768 11026 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.241155 10725 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.267207 10930 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:09.270529 10841 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:09.245639 11060 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.239785 10757 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:09.242125  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:09.272469 10872 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.201871 10998 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.282378 10930 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:09.281709 11052 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:16:09.278564 10952 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.280633 10725 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.286088 10841 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:09.331126  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.342088  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59530.4us
I20260709 13:16:09.342965  8735 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.282020 11070 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:09.346702  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.350960  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.351477  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1217) took 1322 ms. Trace:
I20260709 13:16:09.338482 10725 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.352030  8760 rpcz_store.cc:276] 0709 13:16:08.029384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.038434 (+  9050us) service_pool.cc:224] Handling call
0709 13:16:08.070202 (+ 31768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.226861 (+156659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.351140 (+1124279us) spinlock_profiling.cc:243] Waited 37.4 ms on lock 0x7b5400199e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:09.351384 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86080896}
I20260709 13:16:09.356352 10977 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:09.361910 11067 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:09.361610  8735 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.365783  8735 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:09.330768 11054 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 13:16:09.373652  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 360940us
I20260709 13:16:09.290665 11071 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.331247 10930 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.280598 11043 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.345958 10841 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.362099 10859 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:09.380219  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.391433  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.331835 10872 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.346263 10952 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:09.366484 10749 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:09.397210  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.398947  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.282186 10932 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:09.391112 11068 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 13:16:09.378554  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.389191 11070 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:09.408633 10988 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.003s
I20260709 13:16:09.437093 11043 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.438002  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1221) took 1407 ms. Trace:
I20260709 13:16:09.439438 11036 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:09.440744 11070 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:09.445462 11062 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 13:16:09.425949 11056 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:16:09.449354  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1223) took 1417 ms. Trace:
W20260709 13:16:09.449584 11075 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:09.424055 10952 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:09.449945  8761 rpcz_store.cc:276] 0709 13:16:08.031595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.069292 (+ 37697us) service_pool.cc:224] Handling call
0709 13:16:08.130387 (+ 61095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.885286 (+754899us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:16:08.885331 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.885950 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.988687 (+102737us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:08.988742 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.988903 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.448985 (+460082us) raft_consensus.cc:1685] finished
0709 13:16:09.449025 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.449260 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":780175,"raft.queue_time_us":790219,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3392,"thread_start_us":102301,"threads_started":1,"wal-append.queue_time_us":202530}
I20260709 13:16:09.438570  8764 rpcz_store.cc:276] 0709 13:16:08.030952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.067611 (+ 36659us) service_pool.cc:224] Handling call
0709 13:16:08.068118 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.867880 (+799762us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:08.957321 (+ 89441us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.101626 (+144305us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.102212 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.102395 (+   183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:09.102447 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.102735 (+   288us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.437815 (+335080us) raft_consensus.cc:1685] finished
0709 13:16:09.437835 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.437944 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":799361,"prepare.queue_time_us":89738,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":871324,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":138,"spinlock_wait_cycles":326528,"thread_start_us":232451,"threads_started":3,"wal-append.queue_time_us":419681}
I20260709 13:16:09.409752 10872 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.441514 11070 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.386499 11071 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.457547 11019 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.458292 10749 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:09.482878  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.499040  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 133349us
I20260709 13:16:09.500481  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1220) took 1470 ms. Trace:
W20260709 13:16:09.502144  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 123704us
I20260709 13:16:09.500980  8765 rpcz_store.cc:276] 0709 13:16:08.030589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.030794 (+   205us) service_pool.cc:224] Handling call
0709 13:16:08.039408 (+  8614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.039609 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:08.056826 (+ 17217us) log.cc:844] Serialized 14 byte log entry
0709 13:16:08.864225 (+807399us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b1800244d20. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:09.034738 (+170513us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.500202 (+465464us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.500258 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:09.500291 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.500341 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.500432 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5382,"prepare.queue_time_us":114913,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":110,"raft.queue_time_us":924189,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":223,"spinlock_wait_cycles":8415488,"thread_start_us":628775,"threads_started":2}
I20260709 13:16:09.482491 10976 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:09.504556  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:09.509192  8915 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:09.511179 10952 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.516484 10839 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:09.517040 10839 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.520040 10937 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.521024 10936 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:09.521528 10936 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.523674 10936 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:09.507156 10869 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.524780  9465 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:09.525098 10869 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.526746 11041 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:09.526610 10952 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:09.527156 11041 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:09.527514 10952 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:09.527925 10952 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:09.507691 11061 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.533010  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:09.529225  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.527220 10869 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.529996  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.536589  8843 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:09.537717  8768 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:09.537883  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.501569 11074 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.506253 10976 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:09.546571  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:09.529438  8735 connection.cc:256] RPC call timeout handler was delayed by -1.1063941479999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
I20260709 13:16:09.486061 11019 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.466646 10725 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.528133 11041 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.543570  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:09.558420  8842 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.544559  8836 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.503654 10749 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.558830  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:09.557497  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.506695 10967 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.549240 11061 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.567392  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.556732 10929 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:09.529006 10952 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.571108  8840 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:09.557825 11051 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:09.563608 10836 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.561424 10869 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:09.575857  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.584681 10869 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.566761  8838 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:09.587545 10869 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.579404 10872 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.566103 11072 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.588368 11072 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.588925 11072 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.574756 10929 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:09.591344 10929 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.592398 10929 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.579463 10937 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.594158 11070 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:09.594642 10940 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.572064 11041 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.599416 10930 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.594445  8837 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:09.583976 10836 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.602970  8840 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:09.612996  8842 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:09.618301  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:09.548885 10842 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:09.625578  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.629470  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:09.639137  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:09.639860  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:09.640257  8909 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:09.642159  8837 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:09.648066  8913 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:09.627557 11036 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.622828 10937 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:09.656325 11019 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:09.643921 10952 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.646445  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:09.683228  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:09.621275 11051 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.649988 10859 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:09.691339  8735 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.781s (SENT)
I20260709 13:16:09.575253 11061 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.650255 11080 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:09.654692 10836 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:09.653350 10727 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:16:09.674250  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:09.698488  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.650756 11043 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:16:09.681389 11036 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:09.705055 10836 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:09.700716 10869 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.706364 10935 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.600942 10976 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.704344 10936 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:09.683373 10937 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.742224 10982 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.742990 10976 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:09.742859 10982 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.743566 10749 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:09.729648 10869 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.746927 10725 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:09.725261 10992 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:09.747357 10869 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.747972 10992 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:09.749249 10992 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.750568 10992 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:09.724448  8761 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:09.731848  8766 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:09.732194  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:09.814534 10937 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:09.724376 10940 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.816061  8837 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:09.731112 10930 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:09.805243  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 194172us
I20260709 13:16:09.836400 10967 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.837978 11072 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.733831 10836 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.740083 10936 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:09.857645  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 213808us
I20260709 13:16:09.710807 11080 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:09.852145 10727 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.857750 10982 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:09.848121 10940 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:09.889348  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.875571 11094 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.898492  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:09.880836 10842 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.873605 11051 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:09.871770 10930 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:16:09.914032  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:09.886958 10982 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.898968 11091 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.877030 10727 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:09.936249  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.967808 10971 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.967950  9460 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b"
dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:54308
I20260709 13:16:09.968103  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:09.970067 10690 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:09.973047  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:09.982414  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53839us
I20260709 13:16:09.900842 10988 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.865206 11036 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:09.904592 10749 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:09.900293 10928 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:16:09.983790  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:09.988106 11057 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:09.989590  9468 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:09.915102 10725 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:16:09.989938 10727 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:09.990200 11079 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:16:09.991750 10940 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:09.992578 11099 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:16:09.992993 11072 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:09.993371 11086 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 13:16:09.995337 11060 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.002s
I20260709 13:16:09.999704  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:09.986212 10988 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.009948  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:09.996397 11019 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.015692  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.002487 11087 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:09.906956 11094 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.026832  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 327) took 1931 ms. Trace:
I20260709 13:16:10.010449 10836 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.010380  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:10.024097 10988 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.028120  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1166) took 1054 ms. Trace:
I20260709 13:16:10.075363 10725 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.028499 11094 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.011999 11029 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:10.079278 10725 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.029238  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1169) took 1050 ms. Trace:
I20260709 13:16:10.080313  8764 rpcz_store.cc:276] 0709 13:16:08.978903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.461018 (+482115us) service_pool.cc:224] Handling call
0709 13:16:09.461412 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.499243 (+ 37831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.499272 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.505244 (+  5972us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.718260 (+213016us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.718315 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.718410 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.028948 (+310538us) raft_consensus.cc:1685] finished
0709 13:16:10.028979 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.029165 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7543,"raft.queue_time_us":41474,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4720,"thread_start_us":168753,"threads_started":1,"wal-append.queue_time_us":303378}
I20260709 13:16:10.081589 10725 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:10.081825 11088 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.234s	user 0.001s	sys 0.002s
I20260709 13:16:09.978653 11091 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.082332  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:10.082917  8764 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.082952  9462 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:10.029770 11080 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:10.014290 11060 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.085795 11060 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.011492 11061 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.018268 11019 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.076308 11021 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:10.088081  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.088524 11019 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.013242 10971 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.088946  9463 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:10.089104  8844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1411) took 2188 ms (client timeout 1781 ms). Trace:
I20260709 13:16:10.011759 10839 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:10.089484  8844 rpcz_store.cc:269] 0709 13:16:07.900599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.900731 (+   132us) service_pool.cc:224] Handling call
0709 13:16:10.084833 (+2184102us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b540039dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:10.089030 (+  4197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1586803584}
W20260709 13:16:10.034494 10841 consensus_meta.cc:287] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.005s
I20260709 13:16:09.975257 10982 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.038007 11018 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.026408 11025 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.090935  8764 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:10.039683 10936 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:10.041440  8835 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:10.098013  8835 pending_rounds.cc:85] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 2
I20260709 13:16:10.041013  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.098286  8835 pending_rounds.cc:107] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:10.098636  8835 raft_consensus.cc:2889] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.017931  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.004194 11057 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:10.050221  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.057183 10726 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.101423  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:10.105943 10999 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:10.107897 10671 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:10.108605 10671 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.109107 11043 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.109654 11043 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.112615  8843 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:10.091354 10841 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.115761 10841 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:10.091569  8841 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:10.116969  8841 pending_rounds.cc:85] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 3
I20260709 13:16:10.117259  8841 pending_rounds.cc:107] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:10.117543  8841 raft_consensus.cc:2889] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.093564  9460 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:16:10.091123 11084 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:16:10.119154  9460 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.120518  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1168) took 1143 ms. Trace:
W20260709 13:16:10.113055  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.113080  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1240) took 1176 ms. Trace:
W20260709 13:16:10.122610  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.019845  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.060387 10929 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.060997 10937 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.062872  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1234) took 1132 ms. Trace:
I20260709 13:16:10.077980  8760 rpcz_store.cc:276] 0709 13:16:08.973392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.353386 (+379994us) service_pool.cc:224] Handling call
0709 13:16:09.353807 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.354207 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.354248 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.354822 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.636370 (+281548us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.644809 (+  8439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.653906 (+  9097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.027775 (+373869us) raft_consensus.cc:1685] finished
0709 13:16:10.027819 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.028028 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56112,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":15942,"thread_start_us":259072,"threads_started":1,"wal-append.queue_time_us":384515}
I20260709 13:16:10.133807  8909 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:10.069727  9467 rpcz_store.cc:276] 0709 13:16:08.095469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.095749 (+   280us) service_pool.cc:224] Handling call
0709 13:16:09.765988 (+1670239us) spinlock_profiling.cc:243] Waited 5.51 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:09.807841 (+ 41853us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.821926 (+ 14085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.821961 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.822451 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.921583 (+ 99132us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:09.921633 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.921706 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.026497 (+104791us) raft_consensus.cc:1685] finished
0709 13:16:10.026517 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.026758 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74069,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":16385,"spinlock_wait_cycles":12665600,"thread_start_us":98693,"threads_started":1,"wal-append.queue_time_us":180251}
I20260709 13:16:10.101643 10940 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:10.102052 11064 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:10.091109 10839 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.103386  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:10.105433  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1147) took 2798 ms. Trace:
W20260709 13:16:10.124572  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 104890us
I20260709 13:16:10.165153  8909 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.167779  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.059576  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.098193  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.169185  8764 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 2.
I20260709 13:16:10.120911  8769 rpcz_store.cc:276] 0709 13:16:08.977111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.454319 (+477208us) service_pool.cc:224] Handling call
0709 13:16:09.454745 (+   426us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.468046 (+ 13301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.468094 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:09.476935 (+  8841us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.739098 (+262163us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:09.739159 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.739230 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.090550 (+351320us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:10.120183 (+ 29633us) raft_consensus.cc:1685] finished
0709 13:16:10.120208 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.120440 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28514,"raft.queue_time_us":13543,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":9832,"spinlock_wait_cycles":120173824,"thread_start_us":234235,"threads_started":1,"wal-append.queue_time_us":376952}
I20260709 13:16:10.170948  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.122819  8768 rpcz_store.cc:276] 0709 13:16:08.937170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.148852 (+211682us) service_pool.cc:224] Handling call
0709 13:16:09.174284 (+ 25432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.538136 (+363852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.112748 (+574612us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54002003d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:10.113018 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835229568}
I20260709 13:16:10.128468  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.172425  8910 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:10.131018  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.136457  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.140070  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.175724  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.176497  8840 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:10.156352  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.132577  8766 rpcz_store.cc:276] 0709 13:16:08.930459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.101776 (+171317us) service_pool.cc:224] Handling call
0709 13:16:09.102469 (+   693us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.809858 (+707389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.062605 (+252747us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b5400378554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:10.062808 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1446594816}
I20260709 13:16:10.141449  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:10.094235 11098 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:16:10.184842  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.167274  8763 rpcz_store.cc:276] 0709 13:16:07.306677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.679267 (+372590us) service_pool.cc:224] Handling call
0709 13:16:07.824516 (+145249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.825054 (+   538us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:07.844282 (+ 19228us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.989455 (+145173us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.989888 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.990017 (+   129us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:07.990531 (+   514us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.990778 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.990866 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.465165 (+474299us) raft_consensus.cc:1685] finished
0709 13:16:08.465193 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.105204 (+1640011us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400299d50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:10.105338 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19173,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":84,"raft.queue_time_us":393,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":4265,"spinlock_wait_cycles":302405504,"thread_start_us":123983,"threads_started":1,"wal-append.queue_time_us":222027,"wal-append.run_cpu_time_us":5057,"wal-append.run_wall_time_us":1378744}
I20260709 13:16:10.186539  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:10.186801  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.187346  8768 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.181665  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.184849  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.189591  8915 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:10.190193  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.191164  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.135443 11018 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.198379  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.199538  8763 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:10.096799 10869 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:10.135201 10718 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.194540  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.207096  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.209017  8912 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:10.197201  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.177318 10976 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.196802  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.194128  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:10.191864  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 185961us
I20260709 13:16:10.210390  8909 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.202452  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.167464 11019 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.209144  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.214092  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.212155  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.188912  9461 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.217835  8910 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:10.165050 11078 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:10.220048  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.220594  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:10.223300  9468 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:10.223546  8763 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.227892  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.229799  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.196470 10725 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.192281  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.165531 10929 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.234426  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:10.236593  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:10.167419 10940 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.166761 10937 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.204236 11108 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.240804  8915 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.221385 10786 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.245256  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:10.254804  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.217658  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.251353  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.244560  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:10.184051 11064 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.252010  8809 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:10.208187 11018 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.253362  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.262277  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.263173 10841 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.262277  8837 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:10.263494 10751 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:16:10.258924 10690 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:10.221083 10869 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:10.270275  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 423717us
I20260709 13:16:10.271083  9460 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.253163  8763 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:10.216960 10757 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:16:10.278180  8844 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:10.280057  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:10.280740  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.281216  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:10.257282 11085 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
I20260709 13:16:10.221596 11019 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.222170 10976 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.292454  8915 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:10.293900  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:10.294453  8762 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:10.295801  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.300251  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:10.240211 10718 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:16:10.298614  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.300982  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.232194 11078 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.302251  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.391803  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:10.402504  8807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.648s (SENT) [suppressed 49 similar messages]
I20260709 13:16:10.412384  8767 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:10.403519  8916 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.413381  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.393429  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:10.394750  8912 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:10.395411  8769 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:10.395773  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101927us
I20260709 13:16:10.397893  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.401809  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.291991 10784 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:10.274253  8760 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 1.
I20260709 13:16:10.284174 10690 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.285501 10977 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:10.405370 10999 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.292227 10967 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.291592 11092 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.259545 11025 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:10.300982  8915 raft_consensus.cc:2368] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6.
I20260709 13:16:10.261307 11029 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
I20260709 13:16:10.492503  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:10.417735  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:10.493350  8915 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:10.434103  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.435540  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.494014  8763 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:10.293427 10786 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.120s
I20260709 13:16:10.437613  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.403326 10839 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:10.440376  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.441195  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.413489  9465 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.395118 11091 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.498831  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.429337 11061 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.515172  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.434783 10690 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.511291  8912 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:10.513655  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 96826.8us
I20260709 13:16:10.515142  9468 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:10.437407 10784 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:10.521404  8763 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.519657  8914 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:10.436471 11036 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.546413 11112 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:16:10.547147  8912 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.2-6.2]
I20260709 13:16:10.547978 10976 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.548939 11061 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.553602  9459 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:16:10.553959 11018 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.493002 10930 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:10.556097  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1174) took 1555 ms. Trace:
I20260709 13:16:10.440511  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:10.598955  8763 rpcz_store.cc:276] 0709 13:16:09.000998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.494683 (+1493685us) service_pool.cc:224] Handling call
0709 13:16:10.512548 (+ 17865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.544968 (+ 32420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.556041 (+ 11073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.558597  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.499643 10839 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.442453 10977 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.567103  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:10.602789  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1182) took 1517 ms. Trace:
I20260709 13:16:10.603050  8764 rpcz_store.cc:276] 0709 13:16:09.085648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.602018 (+1516370us) service_pool.cc:224] Handling call
0709 13:16:10.602318 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.602504 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.602529 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.602572 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:10.602607 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.602662 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.602744 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.569955 11043 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.570628  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1294) took 1042 ms. Trace:
W20260709 13:16:10.570974  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.604353  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.572682 11019 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.582320  9461 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:10.557566 11085 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:10.578424  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1180) took 1534 ms. Trace:
I20260709 13:16:10.579573  8768 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:10.615625  8762 rpcz_store.cc:276] 0709 13:16:09.044462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.577655 (+1533193us) service_pool.cc:224] Handling call
0709 13:16:10.577967 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.578139 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.578161 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.578198 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.578229 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.578277 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.578368 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:10.580026  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.590639 10940 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.445719 10999 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.585502  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.580703 10751 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.597702  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.605214  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.607427 10839 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.572808  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1287) took 1047 ms. Trace:
I20260709 13:16:10.600164  8914 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:10.617133  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1187) took 1443 ms. Trace:
I20260709 13:16:10.629684  8762 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:10.619815  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.623224  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1273) took 1847 ms. Trace:
I20260709 13:16:10.631574  8835 rpcz_store.cc:276] 0709 13:16:08.776153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.776283 (+   130us) service_pool.cc:224] Handling call
0709 13:16:08.776734 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.099288 (+1322554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.622970 (+523682us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400241b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:10.623166 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2906307968}
I20260709 13:16:10.500125 11092 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.624396  8909 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:10.604038  8843 rpcz_store.cc:276] 0709 13:16:09.527924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.537632 (+  9708us) service_pool.cc:224] Handling call
0709 13:16:10.570444 (+1032812us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003a7354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:10.570572 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320355200}
I20260709 13:16:10.541456 10931 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:10.629794  8768 rpcz_store.cc:276] 0709 13:16:09.173837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.616115 (+1442278us) service_pool.cc:224] Handling call
0709 13:16:10.616607 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.616777 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.616801 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.616840 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:10.616904 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.616974 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.617080 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.627857  8838 rpcz_store.cc:276] 0709 13:16:09.525802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.528319 (+  2517us) service_pool.cc:224] Handling call
0709 13:16:09.528620 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.566629 (+ 38009us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:09.673056 (+106427us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.842135 (+169079us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:09.842193 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:09.842243 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.572574 (+730331us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b540039c1d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:10.572629 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.572751 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2133,"raft.queue_time_us":1832,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4724,"spinlock_wait_cycles":86841088,"thread_start_us":168635,"threads_started":1,"wal-append.queue_time_us":230631}
I20260709 13:16:10.640774  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1171) took 1656 ms. Trace:
I20260709 13:16:10.634966  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1190) took 1432 ms. Trace:
I20260709 13:16:10.631507  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1189) took 1431 ms. Trace:
I20260709 13:16:10.638602  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.641444  8765 rpcz_store.cc:276] 0709 13:16:08.984204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.507132 (+522928us) service_pool.cc:224] Handling call
0709 13:16:09.521259 (+ 14127us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.521638 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.521668 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:09.522243 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.715954 (+193711us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.736610 (+ 20656us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.094924 (+358314us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b180042d660. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:10.095102 (+   178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.095170 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.166055 (+ 70885us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:10.640521 (+474466us) raft_consensus.cc:1685] finished
0709 13:16:10.640546 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.640709 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263,"prepare.queue_time_us":19350,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":358656,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":197,"spinlock_wait_cycles":77322880,"thread_start_us":193284,"threads_started":1,"wal-append.queue_time_us":331921}
I20260709 13:16:10.642709  8762 rpcz_store.cc:276] 0709 13:16:09.199861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.622267 (+1422406us) service_pool.cc:224] Handling call
0709 13:16:10.629365 (+  7098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.631233 (+  1868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.631455 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.642957  8835 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:10.643721  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.610730  9462 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:10.643749  8763 rpcz_store.cc:276] 0709 13:16:09.202527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.631894 (+1429367us) service_pool.cc:224] Handling call
0709 13:16:10.634460 (+  2566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.634635 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.634673 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.634713 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.634745 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.634796 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.634903 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.645486  8767 raft_consensus.cc:2410] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:10.620721 10869 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.646703  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.646800  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.647495  8835 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:10.623462  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:10.646768  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.652259  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.653002  8909 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:10.653412  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.654549  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.655165  8835 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:10.655696  9468 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:10.655982  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:10.657985  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 255496us
I20260709 13:16:10.660050  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.607158 10930 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:10.666426  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.671566  8765 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.638536 11105 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.607331 10784 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.673550  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.652484 11043 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:10.676321  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1195) took 1025 ms. Trace:
I20260709 13:16:10.679837  8765 rpcz_store.cc:276] 0709 13:16:09.651327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.651042 (+999715us) service_pool.cc:224] Handling call
0709 13:16:10.668640 (+ 17598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.672223 (+  3583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.676240 (+  4017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.680341  8915 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:10.634102 10751 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.662499  8762 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:10.681298  8912 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:10.678200  8838 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:10.678843  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:10.587745 11036 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.661252 10869 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.667691 11078 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.689188  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.695400  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.670562 11018 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:10.708993  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1194) took 1072 ms. Trace:
I20260709 13:16:10.713826  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.696233  8835 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:10.709518  8763 rpcz_store.cc:276] 0709 13:16:09.636428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.681971 (+1045543us) service_pool.cc:224] Handling call
0709 13:16:10.708459 (+ 26488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.708649 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.708674 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.708723 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:10.708757 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.708811 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.708938 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.721019 10751 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.726187 11057 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.703209 11043 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.730089 11092 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.730990 11043 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.732187  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.732959  8909 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:10.735213  8918 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:10.737476 11071 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.701504 11064 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.694679 10929 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:10.710108 11113 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:16:10.716617  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.761686  8835 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:10.764339  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:10.700729 11078 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.765511 11043 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:16:10.771775 10929 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:10.773519 10954 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:10.773598  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:10.774792  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1289) took 1248 ms. Trace:
I20260709 13:16:10.775198  8836 rpcz_store.cc:276] 0709 13:16:09.526376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.527685 (+  1309us) service_pool.cc:224] Handling call
0709 13:16:09.527978 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.559308 (+ 31330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.774562 (+1215254us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b540028f0d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:10.774732 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37504384}
I20260709 13:16:10.776361  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.777446 10929 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:10.777881 10929 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:10.778693 10929 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.779910 10929 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:10.783699 11114 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:16:10.784209 11043 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.783911  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.786720  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.787568 11087 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:10.788273  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.788115 11087 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:10.788488 10977 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.789055 10947 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:10.789481 10947 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.789824 10947 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.790328 11087 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.791451 10930 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.791802  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.792505  8836 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:10.793090 10999 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.793576  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.794250  8836 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:10.795176  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.795755 10977 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:10.796172 10977 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.796398 10982 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.796502 10977 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.795782  8837 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:16:10.798185 11036 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.799120  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1279) took 1948 ms. Trace:
I20260709 13:16:10.799625 11036 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:10.799503  8841 rpcz_store.cc:276] 0709 13:16:08.850914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.851256 (+   342us) service_pool.cc:224] Handling call
0709 13:16:10.091202 (+1239946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.118220 (+ 27018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.798861 (+680641us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540039dad0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:10.799007 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2719630720}
I20260709 13:16:10.801795  8841 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.804605  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:10.805967  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.795128  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.738171 11061 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:10.808790  8841 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:10.811059  8841 pending_rounds.cc:85] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 2
I20260709 13:16:10.811468  8841 pending_rounds.cc:107] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:10.811888  8841 raft_consensus.cc:2889] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.809187  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.810098  8836 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:10.813488  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:10.701292 10869 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.816320  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.815963  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.824918  8838 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:10.825436  8838 pending_rounds.cc:85] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 2
I20260709 13:16:10.825747  8838 pending_rounds.cc:107] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:10.826052  8838 raft_consensus.cc:2889] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.712805 11018 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.768751  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:10.834462  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1250) took 1094 ms. Trace:
I20260709 13:16:10.838500  8766 rpcz_store.cc:276] 0709 13:16:09.740453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.767372 (+1026919us) service_pool.cc:224] Handling call
0709 13:16:10.834397 (+ 67025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.844698  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:10.814324 10836 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.836424 10967 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.847961  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.857375  8766 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:10.858739  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:10.816547 11021 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.729s	user 0.002s	sys 0.009s
I20260709 13:16:10.828208 11070 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:10.856132  8838 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:10.809360 11078 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.832587 10931 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:10.878324  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.823355 10999 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:10.869230  8843 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:16:10.878448  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:10.879281  8841 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.879722  8766 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.833190 11061 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:10.852969  8911 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:10.882514  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.883224  8836 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:10.884132  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.869858  8839 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:16:10.866302 10751 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.885375  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.885628  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.885475 10751 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.886281  8836 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:10.882521 11061 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.887076 11061 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:10.887133  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:10.887719 10751 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:10.887815  8836 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.893456 10999 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.893954 10999 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.893456  8766 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:16:10.902961  8836 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:10.855086 10786 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:10.909200  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.888322 10751 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:10.914597  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.916133  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.917557  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.918313  8766 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:10.919345  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:10.853377 11087 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:16:10.898299 10976 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.924793  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.864761 11029 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:16:10.861501 10836 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:10.866621 10718 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:16:10.908248 10786 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:10.931434  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.934890  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.921895 10751 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.939039  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:10.977130  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:10.989398  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.001536  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.002319  8835 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 2.
I20260709 13:16:10.974802 10786 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.976672 10841 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:10.983178 10751 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:10.980595 11070 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:10.983388 10725 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:10.925809 11025 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:16:10.978854 11064 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:10.929716 10976 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:11.017776 11116 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:11.026726 10841 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:11.067975 11119 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:11.079241 10725 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:11.112488 11118 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:11.137773 11078 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:11.139822 10690 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.002s
I20260709 13:16:11.139670  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.130223 11018 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.127099 11116 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.145920 10718 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:11.104736 11070 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:11.146996  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 208066us
I20260709 13:16:11.151556 10725 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:11.243571  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.154582 11120 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:11.190979  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.114404 11064 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.129331 10841 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:11.209301  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.208568  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:11.237329  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1192) took 1877 ms. Trace:
I20260709 13:16:11.072464 10931 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:11.246840  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.258517  8838 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:11.147900 11119 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.189918 10690 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.258798  8762 rpcz_store.cc:276] 0709 13:16:09.359566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.652745 (+1293179us) service_pool.cc:224] Handling call
0709 13:16:10.662165 (+  9420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.662378 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:10.828167 (+165789us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.236760 (+408593us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.236849 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:11.236935 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.237037 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.237242 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":325,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7893,"thread_start_us":407794,"threads_started":1,"wal-append.queue_time_us":523752}
I20260709 13:16:11.360363  8762 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:11.361326  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1248) took 1636 ms. Trace:
I20260709 13:16:11.361768  8762 rpcz_store.cc:276] 0709 13:16:09.724822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.359514 (+1634692us) service_pool.cc:224] Handling call
0709 13:16:11.359987 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.360942 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.361247 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.363864  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1249) took 1625 ms. Trace:
W20260709 13:16:11.347894  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 214479us
I20260709 13:16:11.386652  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.199260 11118 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.254743 10869 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.255067 10971 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:11.258966 10718 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:11.356671 10977 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.005s
I20260709 13:16:11.364384  8762 rpcz_store.cc:276] 0709 13:16:09.740070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.362763 (+1622693us) service_pool.cc:224] Handling call
0709 13:16:11.363183 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.363416 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.363457 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.363515 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:11.363561 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.363631 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.363789 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.403409  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 163) took 1307 ms. Trace:
I20260709 13:16:11.403923  8762 rpcz_store.cc:276] 0709 13:16:10.095928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.402338 (+1306410us) service_pool.cc:224] Handling call
0709 13:16:11.402760 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.402976 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.403015 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.403072 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:11.403123 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.403192 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.403338 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:11.406152  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 143765us
I20260709 13:16:11.342252 11108 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:11.323227 11078 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:11.418641  8765 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.021s	sys 0.017s
W20260709 13:16:11.419009  8765 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.021s	sys 0.017s
I20260709 13:16:11.256321 11120 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:11.411794  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 164) took 1315 ms. Trace:
I20260709 13:16:11.412151  8910 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:11.393672 10859 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.441221 10859 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:11.442648  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 165) took 1346 ms. Trace:
I20260709 13:16:11.443379 10859 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:11.429870  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 225) took 1530 ms. Trace:
I20260709 13:16:11.431079  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1449) took 1283 ms. Trace:
I20260709 13:16:11.392366 10784 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:11.439106  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1208) took 1150 ms. Trace:
I20260709 13:16:11.452571  8915 rpcz_store.cc:276] 0709 13:16:10.288286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.498066 (+209780us) service_pool.cc:224] Handling call
0709 13:16:10.637980 (+139914us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.680732 (+ 42752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.438328 (+757596us) spinlock_profiling.cc:243] Waited 42.2 ms on lock 0x7b54000fcb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:11.438894 (+   566us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b54000fcb50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:11.439037 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418148608}
I20260709 13:16:11.443056  8764 rpcz_store.cc:276] 0709 13:16:10.096496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.441866 (+1345370us) service_pool.cc:224] Handling call
0709 13:16:11.442153 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.442304 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.442326 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.442368 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:11.442445 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.442500 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.442595 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:11.450317  8837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.091s	sys 0.199s
W20260709 13:16:11.454411  8837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.091s	sys 0.200s
I20260709 13:16:11.413972 10836 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.455040  8764 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:11.457737  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 167) took 1357 ms. Trace:
I20260709 13:16:11.458230  8764 rpcz_store.cc:276] 0709 13:16:10.099957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.454414 (+1354457us) service_pool.cc:224] Handling call
0709 13:16:11.454823 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.457361 (+  2538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.457656 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.451766  8839 rpcz_store.cc:276] 0709 13:16:10.147471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.291365 (+143894us) service_pool.cc:224] Handling call
0709 13:16:11.430881 (+1139516us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b540039bcd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:11.430995 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044009856}
I20260709 13:16:11.459995  8764 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:11.455597  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1439) took 1314 ms. Trace:
I20260709 13:16:11.461099 11097 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.463799  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1199) took 1343 ms. Trace:
I20260709 13:16:11.464462  8764 rpcz_store.cc:276] 0709 13:16:10.117769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.459192 (+1341423us) service_pool.cc:224] Handling call
0709 13:16:11.459588 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.460543 (+   955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.460807 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.461767  8837 rpcz_store.cc:276] 0709 13:16:10.141361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.798136 (+656775us) service_pool.cc:224] Handling call
0709 13:16:10.798443 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.798650 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:10.930498 (+131848us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.455096 (+524598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.455170 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:11.455246 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.455341 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.455521 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":331983,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":56,"raft.queue_time_us":2015,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":655521,"threads_started":2}
I20260709 13:16:11.407280 10977 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.410153 10971 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.459648  8762 rpcz_store.cc:276] 0709 13:16:10.096243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.405123 (+1308880us) service_pool.cc:224] Handling call
0709 13:16:11.410540 (+  5417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.411441 (+   901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.411479 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.411520 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:11.411556 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.411620 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.411742 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.462193 10726 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:11.465507 11111 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 1.041s	user 0.003s	sys 0.010s
I20260709 13:16:11.503100  8844 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:11.481789  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1253) took 1356 ms. Trace:
I20260709 13:16:11.503760  8762 rpcz_store.cc:276] 0709 13:16:10.125590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.480707 (+1355117us) service_pool.cc:224] Handling call
0709 13:16:11.481108 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.481334 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.481372 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.481448 (+    76us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:11.481492 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.481562 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.481715 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.505467  8762 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:11.506259  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1258) took 1231 ms. Trace:
I20260709 13:16:11.468443  8764 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:16:11.507215  8764 pending_rounds.cc:85] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 6
I20260709 13:16:11.507468  8764 pending_rounds.cc:107] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:16:11.422444 11078 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.507884  8764 raft_consensus.cc:2889] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.506735  8762 rpcz_store.cc:276] 0709 13:16:10.275104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.504849 (+1229745us) service_pool.cc:224] Handling call
0709 13:16:11.505267 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.505995 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.506194 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.501837 10836 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.414520 11108 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:11.512147  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1200) took 1394 ms. Trace:
I20260709 13:16:11.513962  8764 rpcz_store.cc:276] 0709 13:16:10.117984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.467577 (+1349593us) service_pool.cc:224] Handling call
0709 13:16:11.467964 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.508462 (+ 40498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.512092 (+  3630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.514734  8762 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:11.510597  8841 consensus_meta.cc:287] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:16:11.516288  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1260) took 1077 ms. Trace:
I20260709 13:16:10.200413  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:11.506965 10999 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
W20260709 13:16:11.517737  8761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1193) took 1978 ms (client timeout 1933 ms). Trace:
I20260709 13:16:11.502089 10977 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.534716  8838 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:11.533259  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 340) took 1303 ms. Trace:
I20260709 13:16:11.516449  8841 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
W20260709 13:16:11.511873 10947 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.722s	user 0.013s	sys 0.000s
I20260709 13:16:11.502338 10726 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:11.479293 10718 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:11.777519 11135 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:11.451282  9464 rpcz_store.cc:276] 0709 13:16:09.899358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.911860 (+ 12502us) service_pool.cc:224] Handling call
0709 13:16:09.989254 (+ 77394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.033403 (+ 44149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.033453 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.034025 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.183154 (+149129us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:10.186019 (+  2865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.429443 (+1243424us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400650ed4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:11.429493 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.429544 (+    51us) raft_consensus.cc:1685] finished
0709 13:16:11.429556 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.429796 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5747,"raft.queue_time_us":6384,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":87104896,"thread_start_us":115581,"threads_started":1,"wal-append.queue_time_us":226857,"wal-append.run_cpu_time_us":2910,"wal-append.run_wall_time_us":1419159}
I20260709 13:16:11.779878  9468 rpcz_store.cc:276] 0709 13:16:10.230299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.555051 (+324752us) service_pool.cc:224] Handling call
0709 13:16:10.560752 (+  5701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.656150 (+ 95398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.532934 (+876784us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b54004637d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:11.533179 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217398016}
W20260709 13:16:11.780884  8761 rpcz_store.cc:269] 0709 13:16:09.532356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.646845 (+114489us) service_pool.cc:224] Handling call
0709 13:16:11.511021 (+1864176us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b5400337f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:11.511151 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81968384}
W20260709 13:16:11.781477 11137 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:16:11.783320 10976 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:11.534298  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 175) took 1111 ms. Trace:
W20260709 13:16:11.715919  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 326104us
W20260709 13:16:11.745536  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 287519us
I20260709 13:16:11.789163  8843 rpcz_store.cc:276] 0709 13:16:10.422714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.643446 (+220732us) service_pool.cc:224] Handling call
0709 13:16:11.534015 (+890569us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54003a5f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:11.534224 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515975040}
W20260709 13:16:11.548733 10839 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.909s	user 0.011s	sys 0.001s
I20260709 13:16:11.529230  9465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 224) took 1636 ms. Trace:
I20260709 13:16:11.803563  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:16:11.641785  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.777854 10971 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:11.815624  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.532464 11116 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.550777  8762 rpcz_store.cc:276] 0709 13:16:10.438959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.513806 (+1074847us) service_pool.cc:224] Handling call
0709 13:16:11.514141 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.515164 (+  1023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.516059 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.830009  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1264) took 1173 ms. Trace:
I20260709 13:16:11.824098 10971 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.801949  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:11.788347 11127 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:16:11.528348 11110 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 1.107s	user 0.005s	sys 0.005s
W20260709 13:16:11.619258 11061 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.003s
W20260709 13:16:11.694813  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 51803.1us
I20260709 13:16:11.773095 11133 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.519383 10836 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.787081 11139 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:11.569202 11120 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:11.693205 10859 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.799437 10999 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.822170 10726 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.823180 10690 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:11.727519 11070 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.823427  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1262) took 1241 ms. Trace:
I20260709 13:16:11.882229  8761 rpcz_store.cc:276] 0709 13:16:10.581943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.815490 (+1233547us) service_pool.cc:224] Handling call
0709 13:16:11.822938 (+  7448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.823116 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.823143 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.823186 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:11.823214 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.823268 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.823373 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.827883 11119 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.823549  9460 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.825007  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1245) took 2107 ms. Trace:
I20260709 13:16:11.885035  8765 rpcz_store.cc:276] 0709 13:16:09.717751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.707207 (+989456us) service_pool.cc:224] Handling call
0709 13:16:10.714830 (+  7623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.715056 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:11.419377 (+704321us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.824641 (+405264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.824696 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:11.824742 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.824803 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.824944 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":788959,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":93,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10699,"thread_start_us":1060588,"threads_started":2}
I20260709 13:16:11.830271  8762 rpcz_store.cc:276] 0709 13:16:10.657089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.829247 (+1172158us) service_pool.cc:224] Handling call
0709 13:16:11.829552 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.829722 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.829747 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:11.829781 (+    34us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:11.829807 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.829857 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.829950 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:11.790210  8838 pending_rounds.cc:85] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 7
W20260709 13:16:11.521100 11126 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:16:11.795804  8840 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:11.804411 11118 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.840567  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.899997  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:11.731278  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.844573  8735 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:11.813753  9465 rpcz_store.cc:276] 0709 13:16:09.898970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.906361 (+  7391us) service_pool.cc:224] Handling call
0709 13:16:09.978558 (+ 72197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.516318 (+537760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.528814 (+1012496us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540057c1d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:11.529149 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953633152}
I20260709 13:16:11.855549  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.856640  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:11.817727 11026 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:11.800181 10947 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:11.882222  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 75797.1us
I20260709 13:16:11.887089  8838 pending_rounds.cc:107] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:11.904887  8842 raft_consensus.cc:2393] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:11.905069  8838 raft_consensus.cc:2889] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.818490 10839 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:11.905583  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 89289.6us
I20260709 13:16:11.905745  8843 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:11.907649  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 63149.8us
I20260709 13:16:11.905791  8809 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:11.909605 11070 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:11.847718 10937 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.876073 10869 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:11.910306  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:11.913884  8840 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:11.914402  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 70700.6us
I20260709 13:16:11.919216  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:11.920717 11078 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:11.921474 11124 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.580s	user 0.002s	sys 0.002s
I20260709 13:16:11.921907  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1316) took 1011 ms. Trace:
I20260709 13:16:11.845208 10971 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:11.923213  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1172) took 2928 ms. Trace:
I20260709 13:16:11.925673  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1315) took 1057 ms. Trace:
I20260709 13:16:11.943158  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:11.942736  8837 rpcz_store.cc:276] 0709 13:16:10.868580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.467321 (+598741us) service_pool.cc:224] Handling call
0709 13:16:11.470018 (+  2697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.470505 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.470546 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.483088 (+ 12542us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.720360 (+237272us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:11.720402 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.720478 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.925397 (+204919us) raft_consensus.cc:1685] finished
0709 13:16:11.925421 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.925600 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1644,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":23483,"thread_start_us":219459,"threads_started":1,"wal-append.queue_time_us":407844}
W20260709 13:16:11.927417 10929 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.147s	user 0.007s	sys 0.006s
I20260709 13:16:11.872370 11061 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.922317  8839 rpcz_store.cc:276] 0709 13:16:10.910538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.475218 (+564680us) service_pool.cc:224] Handling call
0709 13:16:11.475531 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.475888 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.475930 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.517170 (+ 41240us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.790431 (+273261us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:11.790487 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.790587 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.921716 (+131129us) raft_consensus.cc:1685] finished
0709 13:16:11.921733 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.921853 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6026,"thread_start_us":269323,"threads_started":1,"wal-append.queue_time_us":325912}
I20260709 13:16:11.933320  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:11.911661 10726 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.940542  8769 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:11.879141 11133 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:11.911980 11118 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:11.938519  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.914666 10690 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:11.912231  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:54308 (request call id 227) took 1995 ms. Trace:
I20260709 13:16:11.884758 10859 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:11.977372  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44138.1us
I20260709 13:16:11.984193  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:11.931931 11070 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:12.015925 11070 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.000948  8766 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:11.915647 11108 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:11.915766 11120 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:16:12.008761 10836 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.953459 11132 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:12.011535 10786 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.004s
I20260709 13:16:12.013499 11064 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:12.014501 10859 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.898749 11139 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:11.913348 11026 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:12.014930  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58862 (request call id 168) took 1914 ms. Trace:
I20260709 13:16:12.015954  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1246) took 2292 ms. Trace:
I20260709 13:16:12.006498 10947 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:11.987221 11078 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:12.070945  8767 rpcz_store.cc:276] 0709 13:16:10.100426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.413109 (+312683us) service_pool.cc:224] Handling call
0709 13:16:12.014707 (+1601598us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b5400339354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:12.014866 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531796224}
I20260709 13:16:12.071102  8763 rpcz_store.cc:276] 0709 13:16:09.724145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.718093 (+993948us) service_pool.cc:224] Handling call
0709 13:16:10.739293 (+ 21200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.853187 (+113894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.853214 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.853254 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:10.853292 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.015579 (+1162287us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001a7f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.015628 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.015891 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261485824}
I20260709 13:16:12.076207  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1456) took 1910 ms. Trace:
I20260709 13:16:12.081370  8844 rpcz_store.cc:276] 0709 13:16:10.165973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.803269 (+637296us) service_pool.cc:224] Handling call
0709 13:16:10.803538 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.503512 (+699974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.075924 (+572412us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b54002f21d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.076124 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608416128}
I20260709 13:16:12.080535  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1497) took 1856 ms. Trace:
I20260709 13:16:12.019248  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:12.026145 11094 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:12.027329 11142 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:16:12.031111  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 137433us
I20260709 13:16:11.931095 10869 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.083264  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1173) took 3082 ms. Trace:
W20260709 13:16:12.084084  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65384.3us
W20260709 13:16:12.036477 10751 consensus_meta.cc:287] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.001s
I20260709 13:16:12.029201 11119 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:12.086628  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1224) took 1501 ms. Trace:
I20260709 13:16:12.083030  8910 rpcz_store.cc:276] 0709 13:16:10.224392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.236083 (+ 11691us) service_pool.cc:224] Handling call
0709 13:16:10.404073 (+167990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.427750 (+1023677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.080208 (+652458us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002936d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.080465 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2311990528}
I20260709 13:16:12.094235  8769 rpcz_store.cc:276] 0709 13:16:09.000687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.444518 (+1443831us) service_pool.cc:224] Handling call
0709 13:16:10.503165 (+ 58647us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:11.974840 (+1471675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.083021 (+108181us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540025b054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.083210 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3304806656}
I20260709 13:16:12.029588 10690 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:12.095172  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:12.070749 11128 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:12.097211  8763 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:12.111018  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 143794us
I20260709 13:16:12.115550  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1310) took 1248 ms. Trace:
I20260709 13:16:12.116120  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.170428  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.175650  8761 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:16:12.108829  8912 rpcz_store.cc:276] 0709 13:16:10.585136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.585253 (+   117us) service_pool.cc:224] Handling call
0709 13:16:12.086416 (+1501163us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b5400258d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:12.086554 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128772352}
I20260709 13:16:12.071588 10786 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:12.205005  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 182932us
W20260709 13:16:12.187467  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.186902  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.116110  8838 rpcz_store.cc:276] 0709 13:16:10.867205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.395271 (+528066us) service_pool.cc:224] Handling call
0709 13:16:11.534210 (+138939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:11.905677 (+371467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.115360 (+209683us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003a5f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:12.115493 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287843200}
I20260709 13:16:12.234299  8761 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:11.985836  9460 rpcz_store.cc:276] 0709 13:16:09.907417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.912290 (+  4873us) service_pool.cc:224] Handling call
0709 13:16:10.055681 (+143391us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d76a40 00007fce74d621e9 00007fce74d61c85 00007fce6e2e6254
0709 13:16:11.585998 (+1530317us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b540057c1d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd91a3d 00007fce74d61cd0 00007fce6e2e6254 00007fce6e2e61e2 00007fce6e2e6111 00007fce6e2e608c 00007fce6e2e5342 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:11.902904 (+316906us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89809536}
I20260709 13:16:12.221127  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.237730 11139 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:12.238253  8769 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:12.238674 10936 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:12.223951 10947 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.239097 10936 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:12.239439 10947 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.239959 10936 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.242264 10947 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:12.203523 11094 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:12.243834 11094 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:12.245297  8917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1210) took 1956 ms (client timeout 1658 ms). Trace:
W20260709 13:16:12.245735 11121 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.895s	user 0.003s	sys 0.003s
I20260709 13:16:12.222371  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:12.087982 10859 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:12.245862  8667 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 4, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:12.245028 11094 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:12.247622  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1191) took 3042 ms. Trace:
I20260709 13:16:12.250182  8768 rpcz_store.cc:276] 0709 13:16:09.205462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.641653 (+1436191us) service_pool.cc:224] Handling call
0709 13:16:10.641997 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.642228 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.642249 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.661665 (+ 19416us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.941110 (+279445us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:10.941153 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.941219 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.245180 (+1303961us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:12.247314 (+  2134us) raft_consensus.cc:1685] finished
0709 13:16:12.247339 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.247564 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71600384,"thread_start_us":226615,"threads_started":1,"wal-append.queue_time_us":545525}
W20260709 13:16:12.202195 10841 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.001s
W20260709 13:16:12.245754  8917 rpcz_store.cc:269] 0709 13:16:10.288706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.300740 (+ 12034us) service_pool.cc:224] Handling call
0709 13:16:12.245069 (+1944329us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001d2c54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:12.245218 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954383744}
W20260709 13:16:12.179766  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65274us
I20260709 13:16:12.104348 11119 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:12.179226 11064 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:12.298978  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 379844us
I20260709 13:16:12.246913 10859 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:12.113821 10751 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.104789 11029 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:12.170890 10836 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:12.222713  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.357277 10947 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.357420 10786 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.357868 10947 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:12.358494 11154 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:16:12.359799  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1321) took 1116 ms. Trace:
W20260709 13:16:12.232556 10725 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.976s	user 0.013s	sys 0.000s
I20260709 13:16:12.360370 10725 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.033010 11153 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.182s
I20260709 13:16:12.071565 11132 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.103797 11155 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:12.262228  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:12.281262  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 186167us
I20260709 13:16:12.173046 11156 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:12.360140  8841 rpcz_store.cc:276] 0709 13:16:11.243052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.787294 (+544242us) service_pool.cc:224] Handling call
0709 13:16:11.787660 (+   366us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:11.788534 (+   874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.788562 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:11.804208 (+ 15646us) log.cc:844] Serialized 52 byte log entry
0709 13:16:11.909114 (+104906us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:11.909154 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.909227 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.359592 (+450365us) raft_consensus.cc:1685] finished
0709 13:16:12.359613 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.359739 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":7402,"thread_start_us":84891,"threads_started":1,"wal-append.queue_time_us":196434}
W20260709 13:16:12.429363  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129399us
I20260709 13:16:12.297020 11064 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:12.296984 11119 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.484239  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:12.327208 10859 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:11.942404  8760 rpcz_store.cc:276] 0709 13:16:08.994595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.443079 (+1448484us) service_pool.cc:224] Handling call
0709 13:16:10.489353 (+ 46274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.516222 (+ 26869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.520040 (+  3818us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.792522 (+272482us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b2c00000c88. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:16:10.792999 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.979831 (+186832us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.985300 (+  5469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.999744 (+ 14444us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:11.882141 (+882397us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:11.922876 (+ 40735us) raft_consensus.cc:1685] finished
0709 13:16:11.922910 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:11.923130 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3482,"raft.queue_time_us":5730,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12541,"spinlock_wait_cycles":96653952,"thread_start_us":135318,"threads_started":1,"wal-append.queue_time_us":407025}
I20260709 13:16:12.261216 10841 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.425793 11120 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:12.238302 11157 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.197s
I20260709 13:16:12.430842 10839 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:12.508047 11064 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.509438 10999 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:12.430387 10836 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:12.505156  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 386347us
I20260709 13:16:12.561924 11165 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:12.426707 10690 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:12.643926  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 421602us
I20260709 13:16:12.644594 10971 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:12.645309 10936 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:12.646088  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:12.646750  9460 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.646647  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.647579  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.648986  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.649891  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.650316  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.649046  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.651083  9459 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:12.651271  9462 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:12.647550  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:12.652339  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:12.649824  9461 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:12.657868  8764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.013s	sys 0.040s
W20260709 13:16:12.659010  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 302014us
I20260709 13:16:12.659225 11166 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.661936 11166 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.660820 10947 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:12.662732 11029 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:12.663182 10784 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:12.662139 11158 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:12.662276  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:12.663717 10784 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:12.664382 11166 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.664062 11158 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:12.643797  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 159691us
I20260709 13:16:12.665967 10999 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:12.668114  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:12.668957  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:12.669150 10947 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:12.668025 10999 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:12.670639  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58149.5us
I20260709 13:16:12.663743 11029 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.674413 11166 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.677098 11139 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:12.679258  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 190050us
I20260709 13:16:12.680281  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:12.682943  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:12.683857  8841 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.685096  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.687016 11152 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:12.688838 11152 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.690191 11156 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:12.693100 11146 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:12.693676 11146 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:12.693602  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.694504  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:12.695246 11146 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:12.701220 10839 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:12.666708 11158 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.702541 11158 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:12.703091  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.705055 10839 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.659162 10718 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:12.705834 10839 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:12.706135 10718 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:12.712183 10999 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:12.714799 10999 consensus_queue.cc:1243] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:12.716820 10839 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:12.717134  8841 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:12.703421 11158 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:12.666204 10784 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:12.713932  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:12.721124 10839 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:12.721845 10839 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:12.722536 10839 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:12.722646 10718 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.725551  8836 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:12.729609  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.730439  8843 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
W20260709 13:16:12.641023 11161 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 13:16:12.577221 11168 raft_consensus.cc:2764] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:12.738229  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.669836 10947 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:12.740501  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.741050  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.742973  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.744269  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.751597  8917 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:12.744612  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:12.745301  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.642024 11165 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:12.642283 11094 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.579479 11120 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:12.754484  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.745536  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.756062  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:12.773077  8915 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:12.773844  8762 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:12.758116  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 232) took 2270 ms. Trace:
I20260709 13:16:12.759997  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.761945  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.763991  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.777208  8843 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:12.777729  8839 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:16:12.778409  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:12.779439  8839 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:12.768289  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.780450  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:12.781575  8762 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:12.781647  8839 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:12.746750 11105 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.046s
I20260709 13:16:12.786105  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.786752  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:12.792143  8835 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:12.739279 11166 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.787804  8841 raft_consensus.cc:2410] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:12.789006  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.801048  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.790594  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.746647  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.753264 11026 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:12.815377  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.803068  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.816800  8842 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:12.804850  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:12.807260  8839 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:12.811177  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:12.818794  8844 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:12.797726  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:12.753999 11133 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.771687 11165 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:12.754118  9460 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:12.784819 10725 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.790454 10928 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:12.825645  8762 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:12.774997  9466 rpcz_store.cc:276] 0709 13:16:10.001584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.061802 (+ 60218us) service_pool.cc:224] Handling call
0709 13:16:10.063393 (+  1591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.119454 (+ 56061us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:10.119772 (+   318us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.279721 (+159949us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.279939 (+   218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.279996 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:10.280060 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.783142 (+503082us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:11.522979 (+739837us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b18001918c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:12.021116 (+498137us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18001918c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419
0709 13:16:12.271613 (+250497us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b54004c6654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.271663 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.271799 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":268,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":9389,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":7856,"spinlock_wait_cycles":170496640,"thread_start_us":158912,"threads_started":1,"wal-append.queue_time_us":314308,"wal-append.run_cpu_time_us":4779,"wal-append.run_wall_time_us":1346699}
I20260709 13:16:12.814851 10869 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:12.785769 11168 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 13:16:12.897322  9432 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.986s	user 0.027s	sys 0.065s
I20260709 13:16:13.517119 10841 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.985879 11132 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:12.932979 10751 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:13.513378  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 845267us
I20260709 13:16:13.092065  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.520582  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:13.520646  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.340178 11175 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.475802  8667 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:13.517966  9432 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.611s	user 0.064s	sys 0.085s
I20260709 13:16:13.091084  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:12.986424  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:13.424401  8761 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.004s
W20260709 13:16:12.892493  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 630270us
I20260709 13:16:13.521965  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:13.541689  8767 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
W20260709 13:16:13.157662 11025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.009s	sys 0.016s
I20260709 13:16:13.090967  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.376997  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:13.430812  8769 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.026s	sys 0.025s
W20260709 13:16:13.557060  8769 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.026s	sys 0.030s
I20260709 13:16:12.930665  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 331) took 2715 ms. Trace:
I20260709 13:16:13.523823  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:13.365409  8807 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.522s (SENT)
I20260709 13:16:12.880460  8841 pending_rounds.cc:85] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 1
I20260709 13:16:13.090771  8917 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:12.994135  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1261) took 2452 ms. Trace:
I20260709 13:16:13.559095  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:13.093364  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.090243  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.144099  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:12.864720  8735 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:12.967147  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.559620  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:13.559352  8764 rpcz_store.cc:276] 0709 13:16:10.541871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.521091 (+979220us) service_pool.cc:224] Handling call
0709 13:16:12.016276 (+495185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.016505 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:12.016841 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.658378 (+641537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:12.658444 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.658484 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.658545 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.993872 (+335327us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b5400339350. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:12.994057 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":736,"prepare.queue_time_us":1290,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":65838,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":22556,"spinlock_wait_cycles":1137447168,"thread_start_us":641121,"threads_started":2,"wal-append.queue_time_us":284640}
W20260709 13:16:13.531242  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.538118  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.562876  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:13.562932  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:13.563436  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.563771  8764 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:13.520970 11116 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.240024  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 405230us
W20260709 13:16:12.913129 11159 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.633s	user 0.001s	sys 0.000s
W20260709 13:16:13.547861  8761 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.007s
W20260709 13:16:13.067725 11169 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 13:16:12.895655 10947 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.810323 11166 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.553321  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:13.021795 11164 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.513s	user 0.000s	sys 0.001s
I20260709 13:16:12.986617 10999 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:13.558627  9432 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:12.884351  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1247) took 3159 ms. Trace:
I20260709 13:16:13.593125  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:13.592788  8766 rpcz_store.cc:276] 0709 13:16:09.724506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.257933 (+1533427us) service_pool.cc:224] Handling call
0709 13:16:11.258313 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.017382 (+759069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.884013 (+866631us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b5400378f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.884268 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1707425664}
I20260709 13:16:13.559057  8768 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:16:13.559144  8841 pending_rounds.cc:107] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:13.564061  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:13.557894  9467 rpcz_store.cc:276] 0709 13:16:10.215412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.216157 (+   745us) service_pool.cc:224] Handling call
0709 13:16:10.216588 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.803486 (+586898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.803515 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.803997 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.262284 (+458287us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:11.692086 (+429802us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.692422 (+   336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.897750 (+1205328us) spinlock_profiling.cc:243] Waited 586 ms on lock 0x7b54004e16d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:12.897831 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.897901 (+    70us) raft_consensus.cc:1685] finished
0709 13:16:12.930419 (+ 32518us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.930599 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":653592,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":1004,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":21096,"spinlock_wait_cycles":1348945152,"thread_start_us":742714,"threads_started":2,"wal-append.queue_time_us":568637,"wal-append.run_cpu_time_us":9952,"wal-append.run_wall_time_us":1465103}
W20260709 13:16:13.538695 10859 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.000s
W20260709 13:16:13.458165 10930 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.003s	sys 0.010s
I20260709 13:16:13.571684  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:13.572142  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.572785  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.374763 10786 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.575172  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.572904 11153 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.019749 10931 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.084160 11163 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.006s
I20260709 13:16:12.881289 11133 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.078962 11108 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.581936  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.116968  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.701445  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:13.701838  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.702497  8911 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 3.
I20260709 13:16:13.700536  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:13.703372  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.597451 10999 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:13.704057  8911 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:12.861079 10928 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:13.705598  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.706269  8911 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:13.707243  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:13.585668  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:13.548435 11146 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.852s	user 0.010s	sys 0.003s
I20260709 13:16:13.232781 10836 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:13.124974 10726 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.142s	user 0.005s	sys 0.006s
I20260709 13:16:13.537392 10751 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:16:13.559175 10839 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.000s
I20260709 13:16:13.122956 11120 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:13.719003 10839 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.720005 11120 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.721511 10839 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:13.587157  8667 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 2 to 4, term changed from 2 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to <none>, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:13.540030 11070 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:13.594822  8841 raft_consensus.cc:2889] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.548147 11061 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:13.560212 11172 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.564819 11078 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:13.727537 11172 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.727826 11078 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.728114  8667 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 5, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 5 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.722014 11120 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:13.735208 11181 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:13.736271 11178 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.730203  8667 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:13.739395  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:13.739969  8913 raft_consensus.cc:2376] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5. Re-sending same reply.
I20260709 13:16:13.663879 10786 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:13.570667 11025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.012s	sys 0.019s
I20260709 13:16:13.661489  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.659154  8917 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:13.754091  8732 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.008s	sys 0.002s
I20260709 13:16:13.754266  8917 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:13.754510  8732 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.008s	sys 0.002s
W20260709 13:16:13.754932  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 615816us
I20260709 13:16:13.664012  8915 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:12.993258 11087 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.757686 11087 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:13.671496  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.758380  8909 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:13.758445  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.759241  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.759573  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.699297 10931 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.760160  8916 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:13.760291  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.760720  8763 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:13.760919  8909 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:13.761447  8665 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 178) took 16871 ms (client timeout 15000 ms). Trace:
I20260709 13:16:13.761775  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.762439  8909 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:13.763460  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.547541 11175 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:13.771929  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.773445  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.774102 11175 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:13.774544  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.774923  9463 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:13.692765  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:13.597828  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:13.660382 10930 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.140s	user 0.009s	sys 0.016s
I20260709 13:16:13.634780 11168 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:13.800582  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:12.899466 11161 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:13.592785 11176 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:16:13.584012 11116 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:13.895067  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 381794us
W20260709 13:16:13.897773  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.898540  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 336321us
I20260709 13:16:13.900421  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1209) took 1151 ms. Trace:
I20260709 13:16:13.900971  8769 rpcz_store.cc:276] 0709 13:16:12.748792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.749045 (+   253us) service_pool.cc:224] Handling call
0709 13:16:12.792761 (+ 43716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.793030 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:13.557490 (+764460us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.899985 (+342495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:13.900037 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:13.900163 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.900243 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.900363 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19485,"prepare.queue_time_us":906853,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"thread_start_us":1069874,"threads_started":2}
W20260709 13:16:13.696460 11163 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.007s	sys 0.007s
I20260709 13:16:13.592011 10947 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.718007 10726 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.718392 10751 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:13.924219  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.590288  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.927482  8918 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:13.739969  8667 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.723961  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.077354 11060 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.532s
I20260709 13:16:13.742419 11070 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:13.912353 11064 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.299s	user 0.012s	sys 0.000s
I20260709 13:16:13.710968 11153 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:13.727555 10928 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.731205 11120 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.712134 11133 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:13.746697 10786 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:13.747521 11166 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:13.749043 10999 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:13.739009 11036 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.749522 11186 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:13.716471 11146 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.730060 11078 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:13.722215 10839 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:13.753592  8911 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:13.688920 10859 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.755091  8917 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:13.995285  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:13.995944  8769 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.996085  8917 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.756587  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:13.631675  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:13.565263 10841 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:16:13.723176 11182 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:13.768965 11119 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.209s	user 0.009s	sys 0.004s
W20260709 13:16:13.761849  8665 rpcz_store.cc:269] 0709 13:15:56.963320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.007336 (+ 44016us) service_pool.cc:224] Handling call
0709 13:16:13.761218 (+16753882us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:05.426236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:05.589716 (+163480us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:05.592174 (+  2458us) write_op.cc:435] Acquired schema lock
0709 13:16:05.593754 (+  1580us) tablet.cc:662] Decoding operations
0709 13:16:05.611676 (+ 17922us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:05.611734 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:05.611758 (+    24us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:16:05.631032 (+ 19274us) tablet.cc:701] Row locks acquired
0709 13:16:05.631058 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:16:05.631217 (+   159us) write_op.cc:270] Start()
0709 13:16:05.631359 (+   142us) write_op.cc:276] Timestamp: P: 1783602965631169 usec, L: 0
0709 13:16:05.631384 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:16:05.791375 (+159991us) log.cc:844] Serialized 5632 byte log entry
0709 13:16:06.225458 (+434083us) op_driver.cc:464] REPLICATION: finished
0709 13:16:06.661747 (+436289us) write_op.cc:301] APPLY: starting
0709 13:16:06.677266 (+ 15519us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:06.693466 (+ 16200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:06.693613 (+   147us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:06.771830 (+ 78217us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:06.772220 (+   390us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:16:06.772280 (+    60us) write_op.cc:312] APPLY: finished
0709 13:16:06.772702 (+   422us) log.cc:844] Serialized 100 byte log entry
0709 13:16:06.807238 (+ 34536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:06.844963 (+ 37725us) write_op.cc:454] Released schema lock
0709 13:16:06.845044 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:06.868776 (+ 23732us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:06.868823 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":99848,"reported_tablets":32,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":430397,"apply.run_cpu_time_us":6375,"apply.run_wall_time_us":203031,"num_ops":14,"prepare.queue_time_us":549835,"prepare.run_cpu_time_us":47538,"prepare.run_wall_time_us":489996,"raft.queue_time_us":127909,"raft.run_cpu_time_us":123510,"raft.run_wall_time_us":265325,"replication_time_us":593859,"thread_start_us":898930,"threads_started":4,"wal-append.queue_time_us":266068,"wal-append.run_cpu_time_us":40723,"wal-append.run_wall_time_us":1711957}]]}
I20260709 13:16:13.776798  8909 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:13.781322  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.762867 10931 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:13.663371  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:13.793817 11094 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 1.009s	user 0.009s	sys 0.003s
W20260709 13:16:13.911897  8838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.911s	user 0.007s	sys 0.019s
I20260709 13:16:13.918148  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:13.920166  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 386036us
W20260709 13:16:13.921643  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 362063us
I20260709 13:16:13.925191  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:13.927318  8732 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.709s (SENT)
I20260709 13:16:13.698727 11108 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.809813 11168 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:13.801705  9459 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:13.833730 11176 consensus_queue.cc:1243] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:13.937460  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:14.081494  8918 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:13.938630  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 174) took 2048 ms. Trace:
I20260709 13:16:14.082396  8765 rpcz_store.cc:276] 0709 13:16:11.890175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.890335 (+   160us) service_pool.cc:224] Handling call
0709 13:16:11.898562 (+  8227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:11.899221 (+   659us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:11.899260 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:11.911276 (+ 12016us) log.cc:844] Serialized 26 byte log entry
0709 13:16:12.036840 (+125564us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:12.095971 (+ 59131us) log.cc:844] Serialized 14 byte log entry
0709 13:16:12.096202 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.096308 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.533747 (+1437439us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b1800167e00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:13.930614 (+396867us) raft_consensus.cc:1685] finished
0709 13:16:13.938385 (+  7771us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.938559 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":218,"prepare.queue_time_us":70343,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1317,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":69117,"spinlock_wait_cycles":22183168,"thread_start_us":106074,"threads_started":1,"wal-append.queue_time_us":287317}
I20260709 13:16:13.939194  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.939030  8667 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 2 to 4, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:13.940109  8809 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.803s (SENT)
I20260709 13:16:13.944289  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.924116 10726 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.929937 10751 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:13.949662  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 385656us
W20260709 13:16:13.971873  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.10715e+06us
I20260709 13:16:14.101918  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:13.997426  8915 raft_consensus.cc:2376] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6. Re-sending same reply.
I20260709 13:16:13.948228 10836 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.006350  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:14.008325  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:14.100479  8917 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:14.012066  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1275) took 1048 ms. Trace:
I20260709 13:16:14.017225  8839 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:14.018302  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 652898us
I20260709 13:16:14.011070  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:14.118017  8763 rpcz_store.cc:276] 0709 13:16:12.963934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.376593 (+412659us) service_pool.cc:224] Handling call
0709 13:16:14.011904 (+635311us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540025bf54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:14.012010 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468710144}
I20260709 13:16:14.020607  8911 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:14.050047 11182 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:13.920308 11087 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.024487  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:14.134443  8916 raft_consensus.cc:606] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.134859  8916 raft_consensus.cc:614] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.941215 11064 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:14.138178  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.934924 11181 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 13:16:14.048768  8838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.008s	sys 0.019s
I20260709 13:16:14.048897  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:14.142599  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 215314us
I20260709 13:16:14.143502  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1328) took 1453 ms. Trace:
I20260709 13:16:14.048990  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.047606  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:14.145522  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 96610.6us
I20260709 13:16:14.051241  8762 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:14.029695  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1211) took 1275 ms. Trace:
W20260709 13:16:14.052620  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 465388us
I20260709 13:16:14.147382  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:14.148057  8918 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:14.148787  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:14.126745 10930 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:14.150094  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:14.051617  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1334) took 1324 ms. Trace:
W20260709 13:16:14.003592 11165 consensus_meta.cc:287] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 1.123s	user 0.009s	sys 0.008s
I20260709 13:16:14.064276  8842 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.067073  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:13.973443 11116 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.062422  8734 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:14.085963  8761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.007s	sys 0.025s
I20260709 13:16:14.066387  9466 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:16:14.092120  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 152022us
I20260709 13:16:14.111575 11206 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.974377  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 381323us
W20260709 13:16:14.136754 11186 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:16:14.065932 11108 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.110328  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:13.972493 11036 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:13.953022 10928 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:14.121585  8807 leader_election.cc:336] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.648s (SENT)
I20260709 13:16:14.101413 10726 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.127496  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:14.129761  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.128298  8769 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:14.112389  8667 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:14.135581  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1254) took 1175 ms. Trace:
I20260709 13:16:14.136818  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1255) took 1059 ms. Trace:
I20260709 13:16:13.974196 10839 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.029177 11119 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:14.138854  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.144737  8732 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.810s (SENT)
I20260709 13:16:14.315860  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:14.316138  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.163049  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 100762us
I20260709 13:16:14.317385  8734 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.151208 10947 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.153234  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1244) took 1340 ms. Trace:
W20260709 13:16:14.323139  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 193464us
I20260709 13:16:14.323293  8910 rpcz_store.cc:276] 0709 13:16:12.812673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.815311 (+  2638us) service_pool.cc:224] Handling call
0709 13:16:13.093581 (+278270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.094061 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.094104 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.551730 (+457626us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.919933 (+368203us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:13.938156 (+ 18223us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.939670 (+  1514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.939740 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.153023 (+213283us) raft_consensus.cc:1685] finished
0709 13:16:14.153044 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.153172 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16448,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":31690,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":8258,"thread_start_us":275475,"threads_started":1,"wal-append.queue_time_us":527229}
I20260709 13:16:14.325062  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:14.325676  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 180969us
I20260709 13:16:14.155560 10859 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:14.163569  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.150754  8836 rpcz_store.cc:276] 0709 13:16:12.727520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.737251 (+  9731us) service_pool.cc:224] Handling call
0709 13:16:12.737602 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.737870 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:13.193284 (+455414us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.046977 (+853693us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.047034 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:14.047079 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.047165 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.051548 (+  4383us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":925215,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":136972,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":92,"thread_start_us":953399,"threads_started":3,"wal-append.queue_time_us":543370}
I20260709 13:16:14.085259  8914 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:14.146109  8760 rpcz_store.cc:276] 0709 13:16:12.754354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.758265 (+  3911us) service_pool.cc:224] Handling call
0709 13:16:12.758891 (+   626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.759564 (+   673us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:13.158504 (+398940us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.029192 (+870688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.029270 (+    78us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:14.029331 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.029428 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.029619 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71762,"prepare.queue_time_us":900718,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":167160,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":16094,"spinlock_wait_cycles":41523456,"thread_start_us":1177097,"threads_started":3,"wal-append.queue_time_us":579598}
I20260709 13:16:14.333717  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:14.143893  8838 rpcz_store.cc:276] 0709 13:16:12.689882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.690081 (+   199us) service_pool.cc:224] Handling call
0709 13:16:12.690523 (+   442us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.690941 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:12.967538 (+276597us) log.cc:844] Serialized 14 byte log entry
0709 13:16:14.143180 (+1175642us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.143233 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.143277 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.143335 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.143449 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5564,"prepare.queue_time_us":944499,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"thread_start_us":1450296,"threads_started":2,"wal-append.queue_time_us":973150}
W20260709 13:16:14.108211  8883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.017s	sys 0.031s
W20260709 13:16:14.334920  8883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.017s	sys 0.031s
I20260709 13:16:14.168494  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:14.300318  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:14.138087 11145 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.299710  8915 rpcz_store.cc:276] 0709 13:16:12.960613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.134736 (+1174123us) service_pool.cc:224] Handling call
0709 13:16:14.135037 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.135225 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.135250 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.135292 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:14.135320 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.135375 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.135516 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.341677  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.300420  8917 rpcz_store.cc:276] 0709 13:16:13.077661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.135987 (+1058326us) service_pool.cc:224] Handling call
0709 13:16:14.136315 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.136493 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.136515 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.136557 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.136591 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.136660 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.136767 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.343053  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:14.343808  8917 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:14.301254  8763 raft_consensus.cc:2410] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:14.262166  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.344787  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.345363  8667 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 4, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:14.347208  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.170161  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:14.169656  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:14.194368  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.195384  8766 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:16:14.193899  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 83663.9us
W20260709 13:16:14.155925 11211 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:16:14.153234 11070 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.153482 11078 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:14.162537  8761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.007s	sys 0.028s
I20260709 13:16:14.321595  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 192) took 1064 ms. Trace:
W20260709 13:16:14.326349  8732 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.848s (SENT)
I20260709 13:16:14.163089  8909 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:14.152179 11214 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.151443 11162 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:14.153664 11087 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:14.280339  9460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.017s	sys 0.009s
W20260709 13:16:14.281524 11132 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.020s
I20260709 13:16:14.348311  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.170146  9432 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.348764  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.335785  8762 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:14.352586  8915 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:14.313624 11190 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
I20260709 13:16:14.135566 10836 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.301013 11116 raft_consensus.cc:2764] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:14.352228 10690 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.315953 10839 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:14.358999 11202 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:14.316179 11175 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:14.406777  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.405289  8918 rpcz_store.cc:276] 0709 13:16:13.257337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.188981 (+931644us) service_pool.cc:224] Handling call
0709 13:16:14.320601 (+131620us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.320987 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.321103 (+   116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:14.321191 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:14.321261 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.321342 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.321512 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:14.430460  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 74278.4us
W20260709 13:16:14.436566  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 315077us
W20260709 13:16:14.435810  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 109500us
W20260709 13:16:14.438637  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 291282us
W20260709 13:16:14.413466  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 243897us
I20260709 13:16:14.193773 10725 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:14.477245  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:14.154369 11182 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:14.343888 11094 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:14.329277 10999 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.450440  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.488997  8917 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:16:14.490553  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.491551  8917 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:14.493916  8807 leader_election.cc:336] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.658s (SENT)
I20260709 13:16:14.494547  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.452283  8734 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.446322  8667 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:14.169274 11212 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:14.351363 10971 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.453732  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:14.183156 11204 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.179584 10751 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:14.361907  8809 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.812s (SENT)
W20260709 13:16:14.581004  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 219142us
W20260709 13:16:14.581645  8809 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 2.229s (SENT)
W20260709 13:16:14.552690 11190 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:16:14.185066 11165 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:14.393735  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.199342 11206 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:14.464003  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 293932us
I20260709 13:16:14.422820 11174 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:14.454025  9460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.019s	sys 0.012s
W20260709 13:16:14.454236 11132 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.010s	sys 0.020s
I20260709 13:16:14.478969  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:14.416121  8760 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:14.476460  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.492774  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:14.471726 11205 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 13:16:14.462656 11181 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:14.460635 11162 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:14.360095 11145 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.465255 11214 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.487962 10725 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:14.460412 10786 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.496323  8667 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 5, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 5 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:14.555459  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1258) took 1357 ms. Trace:
I20260709 13:16:14.587447 10971 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.575482  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:14.454916 11070 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:16:14.413034  9464 raft_consensus.cc:2376] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6. Re-sending same reply.
I20260709 13:16:14.582039  8809 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:14.553045 11213 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:16:14.457188  8844 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:14.584197  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:14.590385  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.501045 11094 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.610801 11216 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:14.610916  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 161430us
I20260709 13:16:14.557873 11036 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:14.613102  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 119231us
I20260709 13:16:14.938781  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.939110  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:14.639885  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 156868us
I20260709 13:16:14.941375  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.552179 11133 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:14.579700 11146 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:14.495903 11220 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.465502 10690 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.181295 11168 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:14.648851  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 170081us
W20260709 13:16:14.894713  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:14.919189  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 442825us
I20260709 13:16:14.651361  8766 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 13:16:14.924532 10726 consensus_meta.cc:287] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.003s
I20260709 13:16:14.921315  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:14.677847  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 99806.7us
W20260709 13:16:14.922333  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 340697us
W20260709 13:16:14.977243  8883 leader_election.cc:336] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 2.198s (SENT)
I20260709 13:16:14.855748 11230 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.925930  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:14.926297  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.917284 11174 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:14.931869 11061 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:14.934469  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 344162us
I20260709 13:16:14.933614 11078 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.940205  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:15.007665  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 67608.2us
I20260709 13:16:15.008324  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1502) took 1744 ms. Trace:
I20260709 13:16:15.008726  8909 rpcz_store.cc:276] 0709 13:16:13.264190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.007479 (+1743289us) service_pool.cc:224] Handling call
0709 13:16:15.007814 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.008004 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.008028 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.008069 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:15.008100 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.008151 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.008268 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.009377  8918 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 13:16:14.814224 11233 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:16:14.942533  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:14.799789 11225 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.652s	user 0.000s	sys 0.002s
W20260709 13:16:14.795642 11153 consensus_meta.cc:287] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.843s	user 0.008s	sys 0.003s
I20260709 13:16:14.945953  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1233) took 2189 ms. Trace:
I20260709 13:16:14.648851 11064 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.947094  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.680871  9467 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:14.979568 11223 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.399s	user 0.002s	sys 0.000s
I20260709 13:16:14.938454 10947 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:14.979938  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.980060 11162 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:14.944475 11222 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.472s	user 0.000s	sys 0.002s
I20260709 13:16:14.981091 10726 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:14.981956  8911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1256) took 1853 ms (client timeout 2074 ms). Trace:
W20260709 13:16:14.982093 11108 consensus_meta.cc:287] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.804s	user 0.007s	sys 0.002s
I20260709 13:16:15.141949 11108 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:14.980475  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:15.143110  8766 raft_consensus.cc:1813] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Handling vote request from an unknown peer bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.143599  8766 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 3: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:15.144389 11108 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:14.983578  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:14.984962 11025 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.145149 11025 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:15.145474  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 161980us
I20260709 13:16:15.146093 11025 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.982618  8917 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: [3.2-6.4]
I20260709 13:16:15.147082  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:14.991892  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.147991  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.148245 10841 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:15.148520  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.148623  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1498) took 1890 ms. Trace:
I20260709 13:16:15.144567  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:15.149029  8917 rpcz_store.cc:276] 0709 13:16:13.258562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.945677 (+1687115us) service_pool.cc:224] Handling call
0709 13:16:14.982327 (+ 36650us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:15.147175 (+164848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.148440 (+  1265us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b54002b1450. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:15.148570 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82864000}
I20260709 13:16:15.149756  8766 raft_consensus.cc:2368] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
I20260709 13:16:15.149968  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.151126  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1232) took 1105 ms. Trace:
I20260709 13:16:15.151263  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 242) took 1593 ms. Trace:
I20260709 13:16:15.152097  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1223) took 1193 ms. Trace:
I20260709 13:16:14.929348 11152 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.744692 11119 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.942003 11094 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:15.004104  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:14.919445  8916 rpcz_store.cc:276] 0709 13:16:13.198309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.156982 (+958673us) service_pool.cc:224] Handling call
0709 13:16:14.157496 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.158076 (+   580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.158112 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:14.159342 (+  1230us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.327976 (+168634us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:14.328023 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.328106 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.555234 (+227128us) raft_consensus.cc:1685] finished
0709 13:16:14.555255 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.555400 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1675,"raft.queue_time_us":10964,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12811,"thread_start_us":163362,"threads_started":1,"wal-append.queue_time_us":394241}
I20260709 13:16:15.153060 11165 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.797863 11236 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:14.999873  8667 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 4, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:15.169260  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:15.169827 11087 consensus_meta.cc:287] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.711s	user 0.016s	sys 0.000s
I20260709 13:16:15.170396  8914 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:15.010885  8909 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:14.953492 11116 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:14.607331 11212 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.171307  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1505) took 1906 ms. Trace:
I20260709 13:16:15.010205  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1499) took 1751 ms. Trace:
I20260709 13:16:14.938087 11216 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:15.171897  8909 rpcz_store.cc:276] 0709 13:16:13.264988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.010295 (+1745307us) service_pool.cc:224] Handling call
0709 13:16:15.010576 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.171048 (+160472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.171249 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.945578 11214 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.172662 11216 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:15.173326 11212 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.945320 11218 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.956641 11036 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.173859 11214 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:15.170615  8667 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.174568 11036 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.174445 11214 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.169157 11236 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:15.049837  8912 rpcz_store.cc:276] 0709 13:16:12.744235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.744355 (+   120us) service_pool.cc:224] Handling call
0709 13:16:12.744677 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:12.753677 (+  9000us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:12.757962 (+  4285us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.483128 (+725166us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b180043a980. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:13.527976 (+ 44848us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.535018 (+  7042us) log.cc:844] Serialized 26 byte log entry
0709 13:16:13.541056 (+  6038us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:13.714527 (+173471us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180043a980. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad557 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:13.714648 (+   121us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b180043a980. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:13.889604 (+174956us) log.cc:844] Serialized 14 byte log entry
0709 13:16:13.891866 (+  2262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.891955 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:14.927145 (+1035190us) raft_consensus.cc:1685] finished
0709 13:16:14.927170 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:14.933794 (+  6624us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28347,"prepare.queue_time_us":388488,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":22740,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":30198,"spinlock_wait_cycles":67821952,"thread_start_us":627732,"threads_started":2,"wal-append.queue_time_us":957441}
I20260709 13:16:15.175420 11236 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.170393 11087 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:14.956053 11204 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.172079  8918 rpcz_store.cc:276] 0709 13:16:13.258865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.007970 (+1749105us) service_pool.cc:224] Handling call
0709 13:16:15.008662 (+   692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.009929 (+  1267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.010148 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:14.999912 10836 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.002318 11061 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:15.025846 11202 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:14.935659 10786 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:14.937429 11181 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:15.131559  8911 rpcz_store.cc:269] 0709 13:16:13.128523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.707015 (+578492us) service_pool.cc:224] Handling call
0709 13:16:14.981789 (+1274774us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b54002b1454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:14.981901 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104301312}
W20260709 13:16:15.052917 11120 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.098s	user 0.013s	sys 0.000s
I20260709 13:16:15.137534 10726 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:15.104388 11230 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:16:15.055464 11153 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.137594 10725 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.139257 10971 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:15.140472 11143 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:16:11.444165 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.7.122.68:45973 (local address 127.0.0.1:39870)
0709 13:16:12.009158 (+564993us) negotiation.cc:107] Waiting for socket to connect
0709 13:16:12.009253 (+    95us) client_negotiation.cc:175] Beginning negotiation
0709 13:16:12.009802 (+   549us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:16:13.784668 (+1774866us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 13:16:13.784727 (+    59us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 13:16:13.784892 (+   165us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0709 13:16:13.925102 (+140210us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 13:16:13.943133 (+ 18031us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 13:16:14.627503 (+684370us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.7.122.68:45973: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":397426,"thread_start_us":330346,"threads_started":1}
W20260709 13:16:15.141429 11235 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:15.142311 10947 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.147181 11025 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:14.815838 10751 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:14.873805 11219 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.136552  8915 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:14.764562 11209 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:15.153335  9465 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.939936  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 238) took 1380 ms. Trace:
I20260709 13:16:15.250507  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1507) took 1934 ms. Trace:
I20260709 13:16:15.151546  8766 rpcz_store.cc:276] 0709 13:16:14.048735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.150331 (+1101596us) service_pool.cc:224] Handling call
0709 13:16:15.150664 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.150827 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.150851 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.150895 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:15.150923 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.150983 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.151073 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.253821  8766 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:15.251868  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.254550  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1234) took 1164 ms. Trace:
I20260709 13:16:15.158583  8882 leader_election.cc:400] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
I20260709 13:16:15.151755  9468 rpcz_store.cc:276] 0709 13:16:13.557594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.557704 (+   110us) service_pool.cc:224] Handling call
0709 13:16:13.574136 (+ 16432us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:13.588598 (+ 14462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.588629 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:13.593436 (+  4807us) log.cc:844] Serialized 52 byte log entry
0709 13:16:14.063347 (+469911us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:14.063411 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.063514 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.151070 (+1087556us) raft_consensus.cc:1685] finished
0709 13:16:15.151087 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.151211 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13950,"raft.queue_time_us":116066,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":4147,"thread_start_us":371096,"threads_started":1,"wal-append.queue_time_us":785159}
I20260709 13:16:15.255000  8839 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.006080 11174 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.652550 10859 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.340s
W20260709 13:16:15.091724  9434 leader_election.cc:336] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.521s (SENT)
W20260709 13:16:15.260102  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 168424us
W20260709 13:16:15.180487  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 176490us
I20260709 13:16:15.262086  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.183408  8667 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 4, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.188339  8837 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:15.191723  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:15.151669 11166 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.176700 11214 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:15.198057  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 276874us
I20260709 13:16:15.027567 11078 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.228165  8842 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:15.232632  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.286659  8838 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:15.286754 11177 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:16:11.906833 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:39870 (local address 127.7.122.68:45973)
0709 13:16:13.758011 (+1851178us) server_negotiation.cc:207] Beginning negotiation
0709 13:16:13.758053 (+    42us) server_negotiation.cc:400] Waiting for connection header
0709 13:16:13.758118 (+    65us) server_negotiation.cc:408] Connection header received
0709 13:16:13.758304 (+   186us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:16:13.758335 (+    31us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:16:13.758653 (+   318us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:16:13.793735 (+ 35082us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0709 13:16:14.104023 (+310288us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 13:16:14.883172 (+779149us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0709 13:16:14.883942 (+   770us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39870: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":1802222,"thread_start_us":1628001,"threads_started":1}
I20260709 13:16:15.186383 11116 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.166193 11146 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:16:15.288100 11146 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.288448 11146 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:15.289275 11146 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.244768  8844 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.194512 11202 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:15.291378 11202 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.290426  8667 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 2, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.291801  8836 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:15.252353 11061 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:15.293664 11238 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:15.293983 11061 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.249495  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1486) took 2434 ms. Trace:
I20260709 13:16:15.294601  8841 rpcz_store.cc:276] 0709 13:16:12.812006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.828096 (+ 16090us) service_pool.cc:224] Handling call
0709 13:16:12.880208 (+ 52112us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:13.725895 (+845687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.725928 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:13.726493 (+   565us) log.cc:844] Serialized 52 byte log entry
0709 13:16:13.844421 (+117928us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:13.844475 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.844577 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.246230 (+1401653us) raft_consensus.cc:1685] finished
0709 13:16:15.246250 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.246385 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10409,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":73331,"threads_started":1,"wal-append.queue_time_us":282573}
I20260709 13:16:15.152673  8767 rpcz_store.cc:276] 0709 13:16:13.958965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.989755 (+ 30790us) service_pool.cc:224] Handling call
0709 13:16:13.990193 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.990550 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.990577 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.991048 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.102738 (+111690us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.102863 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.103081 (+   218us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.151875 (+1048794us) raft_consensus.cc:1685] finished
0709 13:16:15.151897 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.152040 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19630,"raft.queue_time_us":3133,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11235,"thread_start_us":111183,"threads_started":1,"wal-append.queue_time_us":1008857}
I20260709 13:16:15.297211  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1235) took 1206 ms. Trace:
I20260709 13:16:15.297550  8767 rpcz_store.cc:276] 0709 13:16:14.090876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.296374 (+1205498us) service_pool.cc:224] Handling call
0709 13:16:15.296680 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.296849 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.296900 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.296948 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:15.296978 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.297035 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.297159 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.298872  8767 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.299225 11078 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.299438  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1236) took 1164 ms. Trace:
I20260709 13:16:15.160681  8760 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.299957 10859 consensus_queue.cc:1243] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:15.300523  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1233) took 1221 ms. Trace:
I20260709 13:16:15.300846  8760 rpcz_store.cc:276] 0709 13:16:14.079436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.160083 (+1080647us) service_pool.cc:224] Handling call
0709 13:16:15.160459 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.300278 (+139819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.300470 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.302205  8760 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.302723  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1237) took 1163 ms. Trace:
I20260709 13:16:15.303020  8760 rpcz_store.cc:276] 0709 13:16:14.139633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.301586 (+1161953us) service_pool.cc:224] Handling call
0709 13:16:15.301864 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.302502 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.302673 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.304495  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1238) took 1161 ms. Trace:
I20260709 13:16:15.255237  8882 leader_election.cc:403] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:15.305740 11145 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:15.306143  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 147736us
I20260709 13:16:15.306661 11145 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
I20260709 13:16:15.252840  8915 rpcz_store.cc:276] 0709 13:16:13.316492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.135909 (+1819417us) service_pool.cc:224] Handling call
0709 13:16:15.136215 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.250232 (+114017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.250441 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.252731  9464 rpcz_store.cc:276] 0709 13:16:13.556067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.565167 (+  9100us) service_pool.cc:224] Handling call
0709 13:16:14.163074 (+597907us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:14.936287 (+773213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9228672}
I20260709 13:16:15.255045  8766 rpcz_store.cc:276] 0709 13:16:14.090541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.253388 (+1162847us) service_pool.cc:224] Handling call
0709 13:16:15.253670 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.254309 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.254498 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.231635 11243 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.248772  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 234) took 1694 ms. Trace:
I20260709 13:16:15.264396  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.270700  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:15.299773  8767 rpcz_store.cc:276] 0709 13:16:14.134788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.298400 (+1163612us) service_pool.cc:224] Handling call
0709 13:16:15.298672 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.299221 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.299387 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.322504  8911 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:15.325026  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 377990us
I20260709 13:16:15.277638  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:15.250602 11029 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.339794  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:15.340848  8844 raft_consensus.cc:2368] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
I20260709 13:16:15.311816  8835 pending_rounds.cc:85] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 6
W20260709 13:16:15.317791  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44613us
I20260709 13:16:15.342346  8835 pending_rounds.cc:107] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:16:15.342638  8835 raft_consensus.cc:2889] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.342752  9432 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.229897 11120 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:15.319396  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 263404us
I20260709 13:16:15.319532  8667 catalog_manager.cc:5697] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 5, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:15.242667 10947 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:15.326359  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48824.1us
W20260709 13:16:15.329561  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65255.1us
I20260709 13:16:15.356084  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:15.357510  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.361640  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.362651  9468 raft_consensus.cc:2410] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:15.362730  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.363632  8842 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:15.351902  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:15.335177  8911 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:15.373932  9465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54286 (request call id 394) took 1477 ms. Trace:
I20260709 13:16:15.374071  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1526) took 1054 ms. Trace:
I20260709 13:16:15.374329  9465 rpcz_store.cc:276] 0709 13:16:13.896470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.912350 (+ 15880us) service_pool.cc:224] Handling call
0709 13:16:13.933414 (+ 21064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.261306 (+1327892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.373703 (+112397us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54004e25d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:15.373872 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2805146368}
I20260709 13:16:15.273586 10836 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.325906  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:15.351608  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.382347  8841 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:15.290457 11146 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.304796  8760 rpcz_store.cc:276] 0709 13:16:14.142947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.303732 (+1160785us) service_pool.cc:224] Handling call
0709 13:16:15.304036 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.304201 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.304222 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:15.304261 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:15.304289 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.304338 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.304444 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:15.268178 11166 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:15.392976  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.350164 11108 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:15.378573  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.374569  8914 rpcz_store.cc:276] 0709 13:16:14.320088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.332836 (+ 12748us) service_pool.cc:224] Handling call
0709 13:16:15.373918 (+1041082us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002ab2d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:15.374017 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1656852864}
I20260709 13:16:15.381793  9464 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:15.381250  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55433.4us
I20260709 13:16:15.374955  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:15.387408  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.336341 11078 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.397630  8667 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.355510 10841 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.399973 11152 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:15.400193  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:15.378955 11061 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:15.375954  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 433486us
W20260709 13:16:15.412055  9434 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.502s (SENT)
I20260709 13:16:15.444149  8884 leader_election.cc:400] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6.
W20260709 13:16:15.446820  8809 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.883s (SENT) [suppressed 55 similar messages]
I20260709 13:16:15.387282 11237 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:15.447654  9434 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.756s (SENT)
I20260709 13:16:15.448684 11237 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:15.456453 11237 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:15.459139  9434 leader_election.cc:336] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.789s (SENT)
I20260709 13:16:15.462001  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.263808 11209 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:15.464847  8809 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.528s (SENT)
I20260709 13:16:15.390837 11204 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:15.433481  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58606.1us
I20260709 13:16:15.362776 11214 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:16:15.260824 11219 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.470918  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:15.373107 11119 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.389910 11206 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.436425  8667 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 2, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 2 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:15.380914 10690 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:15.468976  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 393) took 1573 ms. Trace:
I20260709 13:16:15.477069  9466 rpcz_store.cc:276] 0709 13:16:13.896059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.896191 (+   132us) service_pool.cc:224] Handling call
0709 13:16:15.468772 (+1572581us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b540012d9d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:15.468913 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40372480}
I20260709 13:16:15.396611 11166 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.474970  8667 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:15.483078  8667 catalog_manager.cc:5697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 4, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.327052 11243 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.446635 11061 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:15.431905  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 59885.5us
I20260709 13:16:15.442029 11218 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:15.490765  8910 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.493250  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.468075 11165 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:15.491456  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.469255 10841 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:15.385134 11105 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.096s
I20260709 13:16:15.468487 11087 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:15.474061 11204 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.392493 10971 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:16:15.490773  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:15.442240  8653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 184210us
I20260709 13:16:15.501226  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:15.508733  9434 leader_election.cc:336] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.619s (SENT)
I20260709 13:16:15.478981  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.568524  9459 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:15.540674  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.572454  8844 raft_consensus.cc:2410] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:15.486159 11247 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.540833  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.573318  8838 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:15.573653  9466 raft_consensus.cc:2410] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:16:15.575250  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.544142  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.535318 11105 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:15.497627 11061 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:15.558332  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67643.3us
I20260709 13:16:15.582739  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:15.593567  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.489197  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.594846  9461 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:15.566960 11172 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:15.560422  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51966.2us
I20260709 13:16:15.563452 11245 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:15.546160 11204 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.629344 11224 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:15.559448 11087 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:15.606979  8910 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:15.587641 10930 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:15.644014  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.644822  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.645258  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:15.645519  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.585896 11105 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:15.645895  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.651867  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.651825 11216 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:15.585738 11247 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:15.656647  9432 connection.cc:256] RPC call timeout handler was delayed by -2.3920850050001263s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:16:15.658706  9432 connection.cc:256] RPC call timeout handler was delayed by -2.2982993499999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:16:15.659126  9432 connection.cc:256] RPC call timeout handler was delayed by -2.2867850049999561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260709 13:16:15.660549 11247 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.529608 11218 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.661274 11243 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.663107 11218 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.663931 11105 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.665360 11105 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:15.665117 11087 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.549214 11240 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 13:16:15.657841 11165 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:15.639411 11172 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:16:15.673465 11165 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:15.674440 11172 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.674851 11172 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:15.675909 11165 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:15.675789 11172 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.681087 10841 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:15.632115 10928 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.325s	user 0.011s	sys 0.000s
I20260709 13:16:15.683949  8913 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:15.684460 11215 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.624305 10726 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.685925  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.690380  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.696789 10999 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:15.697336 11242 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.697800 11242 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:15.698632 11242 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:15.699846 11242 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.694162 11165 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.701330  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.702759 11218 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:15.705894 11120 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:15.706116 11166 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:15.707182  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.707541  8916 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:15.708436 11209 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:15.707541 11219 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.710354 11166 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:15.712273  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.715451  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:15.716849  8767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:15.717049  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.717614  8767 raft_consensus.cc:606] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.718010  8767 raft_consensus.cc:614] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:15.687143 11215 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.718401  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.719946  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.722013  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.722906  8838 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.723366  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.725922  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.726845 11168 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.729734 11246 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.729074  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.730022 11218 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:15.729092  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:15.730692  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 96835.4us
I20260709 13:16:15.732556 10718 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:15.633455 11245 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:15.737746  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.739329  8883 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:15.739684  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.740734  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.743566  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.744383  8918 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:15.747071  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:15.748646  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:15.749738  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.753444  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.753844  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.755298  9464 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:15.755599  8912 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:15.758279  8915 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:15.759649  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:15.760473  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 284092us
I20260709 13:16:15.769487  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.771606  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:15.771978  9467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 243) took 2197 ms (client timeout 2241 ms). Trace:
I20260709 13:16:15.772625  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:15.774106  9467 rpcz_store.cc:269] 0709 13:16:13.557881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.631315 (+ 73434us) service_pool.cc:224] Handling call
0709 13:16:15.754774 (+2123459us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54004c72d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:15.754949 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1509713664}
I20260709 13:16:15.775305  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:15.776889  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.773252  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:15.778716  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:15.780584  8914 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:15.775930  8912 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:15.786864  8914 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:15.729414 11212 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:15.694382  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:15.791337  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.795382  8837 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.795914  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:15.803972  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.804205  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:15.773550 11236 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.005s
I20260709 13:16:15.794473  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:15.767585 11094 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 13:16:15.805879 10999 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.773299 10690 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.765085 11209 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:15.793968  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.773097 11172 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.813378  8909 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:15.776419 10836 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.814738  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:15.815416  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 1.48679e+06us
I20260709 13:16:15.819041  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:15.819904  8839 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.809248  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:15.777475 11246 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.789633 11214 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:15.827710  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.831291  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.906723  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:15.696056 11237 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.805073 11212 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:15.934543  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af7776ba20a14a499de5919550fdada6"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:15.935140  8914 raft_consensus.cc:606] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:15.935479  8914 raft_consensus.cc:614] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:15.807173 10751 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.776772 11240 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:16:15.910205  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:15.932184  8840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.009s	sys 0.026s
I20260709 13:16:15.911517  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:15.946543  8840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.009s	sys 0.026s
W20260709 13:16:15.904619 11146 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:16:15.913144  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.916242  8837 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:16:15.322018  9460 rpcz_store.cc:276] 0709 13:16:13.554196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.564923 (+ 10727us) service_pool.cc:224] Handling call
0709 13:16:13.725986 (+161063us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:13.756712 (+ 30726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:13.769720 (+ 13008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:13.769753 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:13.770401 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:16:14.947430 (+1177029us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:14.955532 (+  8102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:14.992697 (+ 37165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:15.194670 (+201973us) raft_consensus.cc:1685] finished
0709 13:16:15.194691 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:15.245515 (+ 50824us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"spinlock_wait_cycles":9427200,"thread_start_us":1151601,"threads_started":1,"wal-append.queue_time_us":715910}
I20260709 13:16:15.951855  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.777850 11202 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:15.928251  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:15.930280  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:15.817808  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:15.821291 10718 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:15.810395 11261 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.944356  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:15.984511  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:15.834376 10999 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.934284 11152 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:15.937819  9459 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:15.809121 11094 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:15.907224 11214 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:15.812848 11236 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:15.957409  8918 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:15.921468 11209 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.941615 11212 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.973699  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:16.009910  8912 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:15.983007 10836 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.011287  9465 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:15.985371 11262 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:15.921818 10971 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:15.981853  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:15.988076 10999 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:15.941207 11070 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:15.998687 11214 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:15.986905  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:16.017429 11025 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.764s	user 0.008s	sys 0.003s
I20260709 13:16:16.010046 11209 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.026367  9466 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:16.013582 10836 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.016390  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:16.015916 11262 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:16.000448 11152 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:16.026525 10947 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
I20260709 13:16:16.023259 10999 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.022954 11182 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:16.023149 11216 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:16.031010 10836 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:16.047601 11259 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:16:16.048825 11152 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:16.051622 11204 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:16.053531 11260 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:16.058741 11209 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:16.065081 11116 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:16:16.085951 11263 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:16.093950 11236 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.094347 11214 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.095028 11245 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:16.087971 11237 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.080942 11262 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:16.099148 11228 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.371s	user 0.000s	sys 0.010s
I20260709 13:16:16.099542 11215 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:16.087559 11271 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:16:16.100835 11261 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:16.101262 11261 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:16.102056 11261 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.102416 11212 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.103374 11261 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.103089 11247 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.104607 11212 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.105297 11262 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.096658 11214 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.113003 11247 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:15.954391  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:16.149876  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 190390us
I20260709 13:16:16.157169  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:16.157790  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:16.152166  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.160362  8760 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:16.163192  8760 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:16.163851  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1245) took 1230 ms. Trace:
I20260709 13:16:16.164227  8760 rpcz_store.cc:276] 0709 13:16:14.933898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.161987 (+1228089us) service_pool.cc:224] Handling call
0709 13:16:16.162642 (+   655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.163563 (+   921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.163766 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:16.159111  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:16.150806  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.186425  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:16.187824  8836 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:16.188145  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:16.186432  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:16.189010  8838 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:16.191979  8841 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
W20260709 13:16:16.194659  8910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1524) took 1875 ms (client timeout 2174 ms). Trace:
W20260709 13:16:16.195428  8910 rpcz_store.cc:269] 0709 13:16:14.319481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.482497 (+163016us) service_pool.cc:224] Handling call
0709 13:16:16.194166 (+1711669us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54000389d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:16.194384 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304238464}
W20260709 13:16:16.202258  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.205557  9434 leader_election.cc:336] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 2.174s (SENT)
I20260709 13:16:16.210202  8915 raft_consensus.cc:2376] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6. Re-sending same reply.
I20260709 13:16:16.211747  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:16.212527  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:16.213285  9459 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:16.214469  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:16.215431  9460 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:16.216509  9466 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:16.218875  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:16.221189  8844 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:16.220829  8734 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:16.221568  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:16.222671  8837 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:16.224416  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:16.227130  8883 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.731s (SENT)
I20260709 13:16:16.227824  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:16.233841  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:16.247087  8913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1513) took 2766 ms (client timeout 2372 ms). Trace:
W20260709 13:16:16.057129 10839 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.576s	user 0.011s	sys 0.003s
I20260709 13:16:16.254720 10931 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.255869 10786 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:16.263548 10725 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:16.264338 10718 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.267426 10751 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.270202  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:16.260388  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:16.270236 10841 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:16:16.273618  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:16.275799  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:16.438905  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 258738us
I20260709 13:16:16.276178 10726 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:16.278867  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:16.292984 10836 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.293766  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:16.018497 10971 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.040212 10947 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.303268 11070 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:16.304494 11108 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:16.304961 11094 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.307495 11119 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.308802 11212 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.083351 11116 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:16.309753 11181 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:16.312463  8913 rpcz_store.cc:269] 0709 13:16:13.480220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.931891 (+451671us) service_pool.cc:224] Handling call
0709 13:16:16.246481 (+2314590us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54002b0f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:16.246746 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3673967360}
I20260709 13:16:16.336098  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:16.358374  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73504.5us
I20260709 13:16:16.309913 11214 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:16:16.436571  9466 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:16.443240  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 222720us
I20260709 13:16:16.446477  8835 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:16.464327  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 350) took 1024 ms. Trace:
I20260709 13:16:16.448487 10751 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:16.482911  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 189442us
I20260709 13:16:16.476653  9468 rpcz_store.cc:276] 0709 13:16:15.440121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.440275 (+   154us) service_pool.cc:224] Handling call
0709 13:16:16.259876 (+819601us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:16.460597 (+200721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5013760}
I20260709 13:16:16.465732 10931 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:16.474665 11119 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.507639  8760 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:16.496235 11218 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:16.496475  8843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.008s	sys 0.002s
I20260709 13:16:16.496788 11274 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.497352 11261 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:16.500375  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1241) took 1613 ms. Trace:
W20260709 13:16:16.550585  8843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.009s	sys 0.002s
W20260709 13:16:16.555121  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 70263us
I20260709 13:16:16.510593 11119 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.558095 11175 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:16.566994 11241 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:16.569638  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.006s	sys 0.005s
I20260709 13:16:16.570019 11202 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:16.570425 11087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.007s	sys 0.016s
W20260709 13:16:16.570910 11087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.008s	sys 0.016s
W20260709 13:16:16.571905 11238 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:16:16.573264  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 299846us
I20260709 13:16:16.577816  8734 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:16.570170  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.007s	sys 0.006s
W20260709 13:16:16.568583 11105 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.903s	user 0.012s	sys 0.002s
W20260709 13:16:16.577877  8912 consensus_meta.cc:287] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.009s
W20260709 13:16:16.600301  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 330418us
I20260709 13:16:16.605429 11175 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:16.617710  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54421.2us
I20260709 13:16:16.618795  8912 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:16.614799  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:16.640691  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 87383.8us
I20260709 13:16:16.641351  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1224) took 2641 ms. Trace:
W20260709 13:16:16.640549  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 62858.4us
I20260709 13:16:16.641867 11175 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.643134 11078 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.644133 11209 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.643929 11078 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:16.644229  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.644786 11209 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.641839  8764 rpcz_store.cc:276] 0709 13:16:14.000302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.000464 (+   162us) service_pool.cc:224] Handling call
0709 13:16:14.000754 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:14.000991 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:16.462981 (+2461990us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.606326 (+143345us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.640664 (+ 34338us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:16.640736 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.640855 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.641129 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2186923,"prepare.queue_time_us":2557618,"raft.queue_time_us":81553,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"thread_start_us":334725,"threads_started":2}
I20260709 13:16:16.645980  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:16.625860  8667 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.006s	sys 0.030s
I20260709 13:16:16.641664 11261 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:16.656316 11261 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.656526 11064 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.656756 11261 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:16.656817  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:16.599817 10725 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:16:16.658100  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:16.658407  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:16.557898 10839 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.659240  8764 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:16.630854 10718 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:16.660373  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:16.660730  8765 raft_consensus.cc:2368] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7.
I20260709 13:16:16.659194 11108 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:16.668329  8667 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.007s	sys 0.030s
W20260709 13:16:16.673681  9463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.022s	sys 0.022s
I20260709 13:16:16.595515 10971 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:16.649178 11262 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.006s
W20260709 13:16:16.734061  9463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.023s	sys 0.023s
W20260709 13:16:16.734748  8883 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.860s (SENT)
I20260709 13:16:16.738848  8760 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.739368 11165 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.742651 11209 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:16.601464 11212 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.613131 11274 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.746809 11212 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.748149 11274 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.725159 11105 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:16:16.753427  8765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1231) took 2731 ms (client timeout 1687 ms). Trace:
I20260709 13:16:16.753610 10839 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.754091  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:16.673053 11108 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:16.759315  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 174778us
I20260709 13:16:16.759860 11219 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:16.766703  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 1.17312e+06us
W20260709 13:16:16.778928  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 52264.1us
I20260709 13:16:16.781689 11243 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:16.784487  8765 rpcz_store.cc:269] 0709 13:16:14.021499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.086893 (+ 65394us) service_pool.cc:224] Handling call
0709 13:16:16.753100 (+2666207us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b540021e154. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:16.753302 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5861030656}
I20260709 13:16:16.791777 11108 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:16.802261  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 135494us
I20260709 13:16:16.803151  9465 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:16.804679 11025 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:16.807253 11025 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.807653 11025 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:16.794423  8760 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:16.782502 11286 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:16.817595 10999 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.005s
I20260709 13:16:16.824321 10836 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.826437 11247 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:16.828532  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1354) took 1614 ms. Trace:
I20260709 13:16:16.828727 11215 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:16.829450  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:16.813869  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:16.802575  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:16.843643 11165 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:16.844290  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:16.824337  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:16.853278  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:16.858752 11174 consensus_meta.cc:287] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.585s	user 0.009s	sys 0.006s
I20260709 13:16:16.847049  8843 rpcz_store.cc:276] 0709 13:16:15.195206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.195327 (+   121us) service_pool.cc:224] Handling call
0709 13:16:15.195638 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.195855 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:15.397024 (+201169us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.729162 (+332138us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b18003bb480. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce73c6e58f 00007fce6ccad571 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd
0709 13:16:16.613424 (+884262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.664716 (+ 51292us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.725673 (+ 60957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.777235 (+ 51562us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.809426 (+ 32191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5162,"prepare.queue_time_us":290330,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":28792,"raft.queue_time_us":64436,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":10088,"spinlock_wait_cycles":47739264,"thread_start_us":1329805,"threads_started":3,"wal-append.queue_time_us":226953,"wal-append.run_cpu_time_us":1534,"wal-append.run_wall_time_us":1099837}
W20260709 13:16:16.863413 11294 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:16:16.864158  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:16.866571  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:16.552050  8766 rpcz_store.cc:276] 0709 13:16:14.886547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.560277 (+673730us) service_pool.cc:224] Handling call
0709 13:16:15.573865 (+ 13588us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:15.574269 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.574305 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:15.616509 (+ 42204us) log.cc:844] Serialized 52 byte log entry
0709 13:16:15.835337 (+218828us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.469765 (+634428us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.499804 (+ 30039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.499902 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.499975 (+    73us) raft_consensus.cc:1685] finished
0709 13:16:16.499986 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.500163 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264727,"prepare.queue_time_us":563537,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":9054,"raft.queue_time_us":159,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":33330,"thread_start_us":425754,"threads_started":2,"wal-append.queue_time_us":340484}
I20260709 13:16:16.834175 11286 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:16.910238 11262 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:16.868765 10690 consensus_meta.cc:287] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.062s	user 0.013s	sys 0.009s
I20260709 13:16:16.869270 10999 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:16.886307  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 107290us
W20260709 13:16:16.893736  8761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.051s	sys 0.051s
I20260709 13:16:16.930195  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:16.930791  8761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.052s	sys 0.052s
I20260709 13:16:16.870991 11261 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.903627  8765 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:16.905587  8913 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:16.905776  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72775.2us
I20260709 13:16:16.906090  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 253) took 1093 ms. Trace:
I20260709 13:16:16.906504  8835 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:16.906972  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 82887.4us
I20260709 13:16:16.908299 11274 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:16.909034  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1226) took 2903 ms. Trace:
I20260709 13:16:16.910836 11262 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:16.902671 11174 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.873781 11215 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:16.846935 11247 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:16.991906 10836 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.957432  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:16.975337 10999 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:16.977785  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:16.978404 10928 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.978678  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48591.5us
W20260709 13:16:16.979923  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 253487us
I20260709 13:16:16.981735 11261 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:16.982501 11174 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:16.951866  8763 rpcz_store.cc:276] 0709 13:16:14.005590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.360841 (+355251us) service_pool.cc:224] Handling call
0709 13:16:14.376275 (+ 15434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:14.460030 (+ 83755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:14.460087 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:14.480676 (+ 20589us) log.cc:844] Serialized 52 byte log entry
0709 13:16:14.610534 (+129858us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:16.170168 (+1559634us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.830509 (+660341us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b180013c960. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1
0709 13:16:16.897649 (+ 67140us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b180013c960. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287
0709 13:16:16.897562 (+   -87us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b180013c960. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:16.908426 (+ 10864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.908550 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.908602 (+    52us) raft_consensus.cc:1685] finished
0709 13:16:16.908612 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.908792 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1597410,"prepare.queue_time_us":1726717,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":6036,"raft.queue_time_us":186905,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":29778,"spinlock_wait_cycles":180984320,"thread_start_us":233878,"threads_started":2,"wal-append.queue_time_us":599797}
I20260709 13:16:16.985280 11171 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.987644  8917 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:16.988785 11070 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.009833 11215 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.980132 11262 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:16.910532 11286 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:16.985323  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1213) took 4230 ms. Trace:
W20260709 13:16:16.936152  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50955.1us
I20260709 13:16:17.008607 11245 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.009168 11288 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:16.967239 10690 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.989326 11029 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.020398  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:17.028733  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.028813 11070 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.029294 11274 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:17.029476 11279 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.030012 11300 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:17.031059  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1221) took 3085 ms. Trace:
I20260709 13:16:16.891566 11105 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.028102 10928 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.053681  9465 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:17.074055  8913 raft_consensus.cc:2410] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:16.956769 11219 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.177940  8765 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:17.178679  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1254) took 1004 ms. Trace:
I20260709 13:16:17.179112  8765 rpcz_store.cc:276] 0709 13:16:16.174721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.977455 (+802734us) service_pool.cc:224] Handling call
0709 13:16:17.178611 (+201156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:17.037544 11168 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.307s	user 0.015s	sys 0.003s
I20260709 13:16:17.032421 11202 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.193223 11296 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:17.206712 11108 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.207922  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1554) took 1458 ms. Trace:
I20260709 13:16:17.032469  8761 rpcz_store.cc:276] 0709 13:16:12.755029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.816339 (+ 61310us) service_pool.cc:224] Handling call
0709 13:16:12.859439 (+ 43100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.859753 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:13.569148 (+709395us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.169823 (+2600675us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.984762 (+814939us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.984849 (+    87us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:16.984987 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.985096 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.985260 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1895579,"prepare.queue_time_us":2706071,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":4904,"raft.queue_time_us":93474,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":4528,"thread_start_us":2271080,"threads_started":3,"wal-append.queue_time_us":1550876,"wal-append.run_cpu_time_us":2633,"wal-append.run_wall_time_us":1611250}
I20260709 13:16:17.208271  8911 rpcz_store.cc:276] 0709 13:16:15.749636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.787851 (+ 38215us) service_pool.cc:224] Handling call
0709 13:16:15.788254 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.788738 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.788778 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.270480 (+481702us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b2c00125038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:16:16.271234 (+   754us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.555643 (+284409us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.614529 (+ 58886us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.646612 (+ 32083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.646734 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.207516 (+560782us) raft_consensus.cc:1685] finished
0709 13:16:17.207605 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.207744 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3885,"prepare.queue_time_us":63026,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":11405,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":11868,"spinlock_wait_cycles":4263680,"thread_start_us":278630,"threads_started":1,"wal-append.queue_time_us":528545}
I20260709 13:16:17.209631  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.211110  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.212013  8761 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:17.195842 11215 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:17.214825 11172 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.357s	user 0.012s	sys 0.008s
W20260709 13:16:17.215549  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.216110  8763 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:17.217489 11247 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.218770 11247 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.220245  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1227) took 3009 ms. Trace:
I20260709 13:16:17.177632  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:17.194701  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 127863us
I20260709 13:16:17.199740  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:17.199985 10869 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:17.173590 11174 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.200699  8766 raft_consensus.cc:2410] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:17.028137 11171 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.202502 11078 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.203101 11105 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:17.204187 11061 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.587s	user 0.016s	sys 0.003s
I20260709 13:16:17.205658  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1243) took 2120 ms. Trace:
I20260709 13:16:17.043028 10751 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.205704 11288 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.066753  8768 rpcz_store.cc:276] 0709 13:16:13.945815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:13.945964 (+   149us) service_pool.cc:224] Handling call
0709 13:16:13.946259 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.946468 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:16.667659 (+2721191us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.030108 (+362449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.030196 (+    88us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:17.030291 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.030367 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.030877 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2235015,"prepare.queue_time_us":2608997,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":5729,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":612793,"threads_started":2}
I20260709 13:16:17.226649  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.220660  8762 rpcz_store.cc:276] 0709 13:16:14.006012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.450365 (+444353us) service_pool.cc:224] Handling call
0709 13:16:14.450680 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:14.585539 (+134859us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:16.442437 (+1856898us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.630825 (+188388us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.639225 (+  8400us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.639398 (+   173us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.639454 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.639607 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.994928 (+355321us) raft_consensus.cc:1685] finished
0709 13:16:16.994954 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.015464 (+ 20510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1659629,"prepare.queue_time_us":1880733,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":9142,"raft.queue_time_us":204537,"raft.run_cpu_time_us":2415,"raft.run_wall_time_us":64483,"thread_start_us":266927,"threads_started":2,"wal-append.queue_time_us":517428}
W20260709 13:16:17.254385  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 185844us
I20260709 13:16:17.205945 11286 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:17.235566  8838 raft_consensus.cc:2955] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:17.255976  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:17.259490  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 189836us
I20260709 13:16:17.259804 11061 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.260591  8769 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:17.261020 11153 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.048069 11245 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.261569 11174 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.177253 10836 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.259354  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:17.199749 11070 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.286419  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.286919  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.290817  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.255107 11202 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:17.269174 11218 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
I20260709 13:16:17.247776  8767 rpcz_store.cc:276] 0709 13:16:14.890983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.718743 (+827760us) service_pool.cc:224] Handling call
0709 13:16:15.719032 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.719420 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:16.494788 (+775368us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.840731 (+345943us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.893234 (+ 52503us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.954990 (+ 61756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.972345 (+ 17355us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.011009 (+ 38664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":461530,"prepare.queue_time_us":776052,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":34393,"raft.queue_time_us":44692,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"thread_start_us":464581,"threads_started":2,"wal-append.queue_time_us":484627}
W20260709 13:16:17.283448  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.297070  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.277760  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:17.290987  8763 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:16:17.224545 10999 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:17.263224 11108 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.262338 11171 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:17.281780  9461 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:17.281685 11216 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.310509  8765 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:17.235385 10869 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.317440  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.319145 11243 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:17.320791 11204 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.322460 10928 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.323377  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1250) took 1150 ms. Trace:
I20260709 13:16:17.300045 11218 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.333258  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.268471 11025 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.342075  9465 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:17.346837  8766 rpcz_store.cc:276] 0709 13:16:16.173198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.927076 (+753878us) service_pool.cc:224] Handling call
0709 13:16:17.323112 (+396036us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b540003e654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:17.323301 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453757184}
I20260709 13:16:17.310611  8761 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:17.366611  9468 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:17.284129 11279 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.335414  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:17.372607 11172 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:17.396819 11172 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.366739 11153 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.372690 11282 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:17.399578 11282 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:17.373327  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.373706  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.400741  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.374598  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:17.375509  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 99061.4us
I20260709 13:16:17.375622 11182 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:17.308382 10999 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:17.379528  8769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1239) took 3209 ms (client timeout 2163 ms). Trace:
W20260709 13:16:17.382813  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56198.2us
I20260709 13:16:17.383247 11025 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.382637 11116 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.390429  8734 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:17.411773  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.386775  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:17.395051 11061 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.412302  8766 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:17.395414 11119 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.820s	user 0.010s	sys 0.000s
I20260709 13:16:17.398922  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 349) took 1970 ms. Trace:
I20260709 13:16:17.343371 11243 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.371465  8763 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.402236  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:17.391172  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:17.406056  8769 rpcz_store.cc:269] 0709 13:16:14.170021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:14.300021 (+130000us) service_pool.cc:224] Handling call
0709 13:16:17.379018 (+3078997us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b540037a354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:17.379438 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6664806144}
I20260709 13:16:17.410895  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.414986  8760 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:16.943748  9460 rpcz_store.cc:276] 0709 13:16:15.813054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.216271 (+403217us) service_pool.cc:224] Handling call
0709 13:16:16.216841 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.217701 (+   860us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.217735 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.232776 (+ 15041us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.528085 (+295309us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:16.528694 (+   609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.529736 (+  1042us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.905870 (+376134us) raft_consensus.cc:1685] finished
0709 13:16:16.905890 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.906035 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89160,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":223,"thread_start_us":290440,"threads_started":1,"wal-append.queue_time_us":394045}
I20260709 13:16:17.382661 11245 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:17.444811  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 77127.5us
I20260709 13:16:17.445171  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.446684  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.406633 11182 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:17.441819  8762 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:17.449955  8768 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:17.424152 11218 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:17.458618  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.346324 11216 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.472388  8767 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:17.459576  8769 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:17.454967 10947 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.466662 11162 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.467175 11202 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.467628 11242 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:17.441423 11168 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.430938 11119 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:17.469988  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83334.7us
I20260709 13:16:17.470639  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1261) took 1293 ms. Trace:
I20260709 13:16:17.503221  8760 rpcz_store.cc:276] 0709 13:16:16.177698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.853013 (+675315us) service_pool.cc:224] Handling call
0709 13:16:17.470371 (+617358us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400299d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:17.470491 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189161728}
I20260709 13:16:17.424705  9463 rpcz_store.cc:276] 0709 13:16:15.428950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.429178 (+   228us) service_pool.cc:224] Handling call
0709 13:16:15.710578 (+281400us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:15.710769 (+   191us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.711204 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:15.909191 (+197987us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.041319 (+1132128us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.175910 (+134591us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.263056 (+ 87146us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.270902 (+  7846us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:17.271312 (+   410us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.275891 (+  4579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.296781 (+ 20890us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.398657 (+101876us) raft_consensus.cc:1685] finished
0709 13:16:17.398676 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.398838 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80898,"prepare.queue_time_us":387320,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":126,"raft.queue_time_us":47962,"raft.run_cpu_time_us":602,"raft.run_wall_time_us":172341,"spinlock_wait_cycles":2841472,"thread_start_us":1106740,"threads_started":3,"wal-append.queue_time_us":1427726}
I20260709 13:16:17.435698 11172 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:17.477210  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75081.9us
I20260709 13:16:17.478370  8766 raft_consensus.cc:2410] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:16:17.470872 11204 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.492586 11302 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:16:17.369895 11274 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.509821  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.513970  8835 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:17.477073 11162 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.470642 11282 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.524106  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.515443  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:17.526991  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.527395  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:17.562539  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 97031.7us
I20260709 13:16:17.563723  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.481493 11218 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:17.568918  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:17.571158  8765 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:17.574647  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.576924  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.577673  8760 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:17.514268 11204 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.582554 11204 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:17.583287  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 123110us
I20260709 13:16:17.583441 10690 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.613617 10690 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.614811 10931 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:17.585274  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.615536  8768 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 3: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:17.615963  8762 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:17.585956 11029 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:17.586694 11152 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.587307 11299 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:17.621357  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.589965 11132 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:17.583305 10725 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.592032  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.592713 10869 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.593048  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.632084  8767 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:17.584112 10839 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:17.596843  8838 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:17.599730 11216 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.601166 11218 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.514189 11243 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.513985 11288 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.610047 11279 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:17.611431  8837 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:17.495229 11182 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:17.617436  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101180us
I20260709 13:16:17.500553 11153 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.615290  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 195) took 3297 ms. Trace:
I20260709 13:16:17.618036  8764 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:17.509245 10751 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.621901  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:17.624356 11262 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:17.574657 11162 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.652712  8763 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:17.657164  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.660442  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1253) took 1486 ms. Trace:
I20260709 13:16:17.670161  8769 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:17.673898  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1247) took 1501 ms. Trace:
W20260709 13:16:17.622467 11302 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:16:17.687512  8917 rpcz_store.cc:276] 0709 13:16:14.317659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.149929 (+832270us) service_pool.cc:224] Handling call
0709 13:16:15.150217 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.028330 (+1878113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.614993 (+586663us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54001d3654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:17.615203 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4224895872}
I20260709 13:16:17.698987  8766 rpcz_store.cc:276] 0709 13:16:16.172281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.591721 (+1419440us) service_pool.cc:224] Handling call
0709 13:16:17.673752 (+ 82031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.514842 11242 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.706022  8843 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.621766 11152 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:17.696552  8765 rpcz_store.cc:276] 0709 13:16:16.174283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.592743 (+1418460us) service_pool.cc:224] Handling call
0709 13:16:17.660369 (+ 67626us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:17.697290  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.698388  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 182351us
W20260709 13:16:17.672720 11311 log.cc:927] Time spent T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:17.618993 11219 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.705231  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:17.661355 11174 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.615463 10931 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.718922  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:17.683442 10869 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:17.621986 11300 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:17.731576  8838 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:17.700086 10839 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:17.723999  8760 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.730396  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1248) took 1557 ms. Trace:
I20260709 13:16:17.735821  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:17.739740  8767 rpcz_store.cc:276] 0709 13:16:16.172565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.675352 (+1502787us) service_pool.cc:224] Handling call
0709 13:16:17.701671 (+ 26319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.729932 (+ 28261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.729972 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.730029 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:17.730079 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.730166 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.730322 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.714231 11152 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.695348 10725 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.720081 10690 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.694780 11108 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:16:17.746891  8842 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:17.745428  8843 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:17.717800 11025 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:17.752565  8769 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:17.680192  8768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:17.755010  8837 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:17.755436  8768 raft_consensus.cc:606] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:17.755789  8768 raft_consensus.cc:614] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:17.755093  8882 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:17.705760 11165 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:16:17.684137 11299 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.767609 11175 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:17.770655  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.783082  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1252) took 1586 ms. Trace:
I20260709 13:16:17.784379  8769 rpcz_store.cc:276] 0709 13:16:16.173895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.704093 (+1530198us) service_pool.cc:224] Handling call
0709 13:16:17.750754 (+ 46661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.759811 (+  9057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.760087 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.786901  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1249) took 1614 ms. Trace:
I20260709 13:16:17.787318  8763 rpcz_store.cc:276] 0709 13:16:16.172897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.699294 (+1526397us) service_pool.cc:224] Handling call
0709 13:16:17.752383 (+ 53089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.786515 (+ 34132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.786555 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:17.786617 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:17.786666 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.786732 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:17.786848 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:17.747248 10999 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.795044 11219 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:17.795782 11219 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:17.713860 11262 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.733934 11247 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:16:17.745916 10839 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.804265  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.801502  9468 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:17.808279  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.809244  8763 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.817530  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:17.822453  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67439.4us
I20260709 13:16:17.799490 11105 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:17.756255 11300 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:17.808113 11306 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:16:17.799266 11216 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:17.839612  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:17.788473 10869 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.842664  8843 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:17.799268 11025 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.796453 11175 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.862874 11175 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.863449 11216 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:17.865990  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:17.866750  8769 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:17.867964  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:17.868183 10836 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:17.869215  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:17.856334 11305 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:17.869894 11116 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.871645 10928 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.872085 10928 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.872028  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:17.872617 10928 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.847503 10930 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:17.832401 11105 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.868685  8769 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.860390  8844 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.855104 10839 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.877815  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:17.886482  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 371420us
I20260709 13:16:17.860445  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:17.856256 11262 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:17.888952 11241 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:17.889092  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.890748 10690 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:17.893344 11286 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.618s	user 0.000s	sys 0.013s
I20260709 13:16:17.893247  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:17.895350 11277 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.583s	user 0.003s	sys 0.003s
I20260709 13:16:17.897185 11172 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:17.897836 11242 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:17.885993 11105 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.904605 11299 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.905367 11219 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:17.942351  8760 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:17.907744 11025 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:17.908282  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:17.909037  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:17.927400  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:17.902987 10869 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:17.928520  8842 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:17.933094  8836 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:17.930142 11172 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:17.969201  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:17.942808 10931 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:17.984992  8762 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:17.992187  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.989432  8763 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
W20260709 13:16:17.985565  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 303800us
W20260709 13:16:17.977077 11313 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:17.995417  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:17.996122  8763 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:17.981272 11286 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.991005 10839 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.013736  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:17.982853 10930 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:18.015087  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
W20260709 13:16:18.016492  8764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1251) took 1834 ms (client timeout 1987 ms). Trace:
I20260709 13:16:18.019615  8762 raft_consensus.cc:606] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:18.019590  8764 rpcz_store.cc:269] 0709 13:16:16.173516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.660076 (+486560us) service_pool.cc:224] Handling call
0709 13:16:18.007445 (+1347369us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400198f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:18.007591 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200930560}
I20260709 13:16:18.020632  8762 raft_consensus.cc:614] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:18.016896  8763 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:18.034343  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 162388us
I20260709 13:16:18.036743  8766 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:18.038611  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.038923  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1256) took 1846 ms. Trace:
I20260709 13:16:18.039332  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1260) took 1862 ms. Trace:
I20260709 13:16:18.039498  8763 rpcz_store.cc:276] 0709 13:16:16.175537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.016293 (+1840756us) service_pool.cc:224] Handling call
0709 13:16:18.016634 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.021852 (+  5218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.022065 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.040272  8766 rpcz_store.cc:276] 0709 13:16:16.177211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.014393 (+1837182us) service_pool.cc:224] Handling call
0709 13:16:18.036479 (+ 22086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.039035 (+  2556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.039275 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:18.041589  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 329959us
I20260709 13:16:18.041411  9464 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:18.025787 11314 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:16:18.053382  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:18.017521 11216 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.022662 10931 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.017366 10725 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.056437  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.057215  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.042157 11300 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.058079  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:18.047390 11312 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 13:16:18.021824 11132 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.064153  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.069399  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:18.072849  8764 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:18.111444  8842 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:18.074304  8762 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.047948 11286 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:18.117256  8766 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.086246  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.119122  8769 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:18.041575 11172 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:18.109325  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 56068.4us
I20260709 13:16:18.109767 10718 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.116995  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1262) took 1938 ms. Trace:
I20260709 13:16:18.048440 10839 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.120970  8769 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.134197  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:18.110605 11332 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.139973  8763 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:18.062650 10931 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.140618  8762 rpcz_store.cc:276] 0709 13:16:16.178145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.073765 (+1895620us) service_pool.cc:224] Handling call
0709 13:16:18.074117 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.116363 (+ 42246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.116773 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.045871 11162 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.143997  8763 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:18.174758  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1267) took 1897 ms. Trace:
I20260709 13:16:18.107519 10928 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:18.139720 11324 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:16:18.147315 10839 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.148942 11241 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.149637  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.144972  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1266) took 1867 ms. Trace:
I20260709 13:16:18.184057  8769 rpcz_store.cc:276] 0709 13:16:16.277275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.120278 (+1843003us) service_pool.cc:224] Handling call
0709 13:16:18.120696 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.144587 (+ 23891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.144897 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.153759 11286 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.155208  8761 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:18.190557  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 120192us
I20260709 13:16:18.190973  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:18.155980  9459 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.161247 10930 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:18.110908 11315 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 13:16:18.175105  8764 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:18.175138  8763 rpcz_store.cc:276] 0709 13:16:16.277578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.143410 (+1865832us) service_pool.cc:224] Handling call
0709 13:16:18.143777 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.174464 (+ 30687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.174698 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.140419 10718 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:18.183641  9467 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:18.194298  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1268) took 1916 ms. Trace:
I20260709 13:16:18.197808  8762 rpcz_store.cc:276] 0709 13:16:16.277920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.173766 (+1895846us) service_pool.cc:224] Handling call
0709 13:16:18.181907 (+  8141us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.193787 (+ 11880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.193833 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.193904 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:18.193954 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.194040 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.194222 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.175787 10931 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.200322  8763 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.200394  9463 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.195668  8764 pending_rounds.cc:85] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 3
I20260709 13:16:18.182547 11332 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.152624 11105 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.203162  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:18.204779  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 181) took 1215 ms. Trace:
I20260709 13:16:18.205356  8769 rpcz_store.cc:276] 0709 13:16:16.989252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.184820 (+1195568us) service_pool.cc:224] Handling call
0709 13:16:18.200163 (+ 15343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.204380 (+  4217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.204423 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.204498 (+    75us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:18.204538 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.204599 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.204718 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.135075 11132 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.207644  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:18.201375  8764 pending_rounds.cc:107] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:18.209435  8764 raft_consensus.cc:2889] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:18.208848 11334 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.004s
I20260709 13:16:18.211220 10839 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.211719 10839 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.211366 10718 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.212096 10839 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.212363 10928 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.212522 10718 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.213811 11132 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.202968 11332 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.221918  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.223956  8769 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:18.223675  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:18.224745  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1294) took 1022 ms. Trace:
I20260709 13:16:18.220690  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1263) took 2022 ms. Trace:
I20260709 13:16:18.225276  8769 rpcz_store.cc:276] 0709 13:16:17.202807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.206084 (+1003277us) service_pool.cc:224] Handling call
0709 13:16:18.223624 (+ 17540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.224439 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.224678 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.225908  8764 rpcz_store.cc:276] 0709 13:16:16.198608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.112571 (+1913963us) service_pool.cc:224] Handling call
0709 13:16:18.143381 (+ 30810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.220413 (+ 77032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.220623 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.223654  9467 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:18.234699  8769 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:18.227417 11132 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.237793  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:18.237982 11132 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.241441  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1293) took 1039 ms. Trace:
I20260709 13:16:18.241936  8762 rpcz_store.cc:276] 0709 13:16:17.202506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.199892 (+997386us) service_pool.cc:224] Handling call
0709 13:16:18.214924 (+ 15032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.241040 (+ 26116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.241076 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.241123 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:18.241174 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.241251 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.241377 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.243512  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1255) took 2058 ms. Trace:
I20260709 13:16:18.248399  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1299) took 1043 ms. Trace:
I20260709 13:16:18.209951 11331 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.249182  8769 rpcz_store.cc:276] 0709 13:16:17.204573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.226505 (+1021932us) service_pool.cc:224] Handling call
0709 13:16:18.234488 (+  7983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.235220 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.248317 (+ 13097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.227537 11332 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.243937  8765 rpcz_store.cc:276] 0709 13:16:16.175132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.727466 (+1552334us) service_pool.cc:224] Handling call
0709 13:16:17.749946 (+ 22480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.795122 (+ 45176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.795148 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.795762 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.995416 (+199654us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:17.995806 (+   390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.996562 (+   756us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.233342 (+236780us) raft_consensus.cc:1685] finished
0709 13:16:18.233363 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.233514 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2918,"raft.queue_time_us":16082,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":18461,"thread_start_us":198288,"threads_started":1,"wal-append.queue_time_us":271066}
I20260709 13:16:18.256994  8769 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.252991  8764 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:16:18.258962  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1270) took 1034 ms. Trace:
I20260709 13:16:18.259395  8764 rpcz_store.cc:276] 0709 13:16:17.224435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.227062 (+1002627us) service_pool.cc:224] Handling call
0709 13:16:18.243538 (+ 16476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.258612 (+ 15074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.258874 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:18.259840  8762 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.240659 11320 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.267223  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:18.271396  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.247210 10725 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.247328 11174 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.273181 11320 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.274363  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:18.271991  8917 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:18.280284  8762 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:18.282792  8765 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:18.291443 11119 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:18.295485 10928 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:18.296200  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:18.294800  8882 connection.cc:256] RPC call timeout handler was delayed by -1.1749150450000343s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
W20260709 13:16:18.310554  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.258255 11152 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.315760 11152 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.318524  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.319438  8911 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:18.319701  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.320386  8913 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:18.287616 11241 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:18.286778 11132 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.300750  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:18.323625  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.301620 10928 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.334252 10839 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.336264 11182 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.338256 10839 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.299103 11105 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.348248  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:18.350009  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.350021  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.350843  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.347499 11241 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:16:18.353978  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.354736  8911 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.334333 11320 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.348122 11162 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.360849  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.361781  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.369747  8914 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:18.372361  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.357534  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:18.376415  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.377509  8913 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:18.379468  9459 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.379837 11243 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:18.379709  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.381165  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.386190  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.387198  8909 raft_consensus.cc:2376] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7. Re-sending same reply.
W20260709 13:16:18.389096  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.423396  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 231798us
I20260709 13:16:18.424244 11219 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.424726 11219 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:18.425122 11219 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:18.426029  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 172902us
I20260709 13:16:18.426928 11242 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:18.432744  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.434224 11243 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:18.435002 11243 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.433571  8917 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:18.449332  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.449757  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.450254  8838 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.450485  8841 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:18.460319  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.453163  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.611495  8838 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.605778 11332 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.612128  8912 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [3.2-5.3]
W20260709 13:16:18.550856 11339 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:16:18.614141  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1295) took 1411 ms. Trace:
I20260709 13:16:18.604485 10928 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.614575  8763 rpcz_store.cc:276] 0709 13:16:17.203105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.206889 (+1003784us) service_pool.cc:224] Handling call
0709 13:16:18.207238 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:18.217405 (+ 10167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:18.217429 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:18.246440 (+ 29011us) log.cc:844] Serialized 52 byte log entry
0709 13:16:18.351311 (+104871us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.432023 (+ 80712us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.432438 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.432539 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.613931 (+181392us) raft_consensus.cc:1685] finished
0709 13:16:18.613952 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.614083 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11513,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":9441,"thread_start_us":143284,"threads_started":2,"wal-append.queue_time_us":96931}
I20260709 13:16:18.508222  8911 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:18.452513 11318 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.450757  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.617633 11318 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.618602  8839 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:18.454411  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.452227  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.620307 11172 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.620704  8844 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.451650  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.622146  8836 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.625161 11243 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:18.616698  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.627231 11168 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.610088  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:18.627861 11168 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.628593 11300 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:18.628677  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:18.629302 11300 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:18.630059 11168 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:18.630648 11274 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.630357 11300 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.631093 11274 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.631546 11274 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.634102  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.636199  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 361) took 1625 ms. Trace:
I20260709 13:16:18.636451 11319 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.638639  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.639590 11319 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.641239  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.630143 11165 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.641829 11165 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:18.642472  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.647562  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.643123  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.642755 11165 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.649737 11165 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.636663  9464 rpcz_store.cc:276] 0709 13:16:17.011108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.011320 (+   212us) service_pool.cc:224] Handling call
0709 13:16:17.039862 (+ 28542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:18.046838 (+1006976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.635953 (+589115us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b54004c72d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:18.636135 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241308544}
I20260709 13:16:18.644613  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:18.651521  8763 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.449394  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1282) took 1459 ms. Trace:
W20260709 13:16:18.646122  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.649223  8841 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.648978  8767 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:18.638959  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.602921 11262 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.522074  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.645264 11319 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.639133  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.648682  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.657302  8766 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.658522  8769 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.658826  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.659435  8764 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:18.660593  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.661876  8843 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.653370  8761 rpcz_store.cc:276] 0709 13:16:16.990251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.414800 (+424549us) service_pool.cc:224] Handling call
0709 13:16:18.449193 (+1034393us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b5400379e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:18.449335 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630579072}
W20260709 13:16:18.456981  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.460743  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.451186  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:18.666680  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.666857 11319 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:18.656714  8838 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:18.667280 11319 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.667191  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:18.667671  8764 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:18.667819 11319 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.668366  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.669106  8838 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:18.669195 11215 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:18.669238  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:18.669867 11215 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.670354 11215 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.671931  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.672572  8767 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
W20260709 13:16:18.672991  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 230734us
I20260709 13:16:18.674041  8841 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:18.675426  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.665109 11262 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.678875  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.679664  8760 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:18.680105  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.678015  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.681416  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.682065  8768 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:18.678925  8841 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.614217 11332 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.678035  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:18.677960  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.685428  8766 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:18.682924  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.683349  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.605325  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:18.674072  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:18.695041  8841 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:18.597074 10947 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.699589  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.700418  8835 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.453890 11247 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:18.680559 11262 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:18.707499 11243 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.710417  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.710623  8842 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:18.463534 11286 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:18.721222  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.721133  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.729156  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:18.731632  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57647.6us
W20260709 13:16:18.731830  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 101914us
I20260709 13:16:18.732077  8763 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:18.716041 10718 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:18.697543 11274 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.717221 11247 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.713459 10947 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:18.701028 11332 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:16:18.757716 11332 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.758245 11332 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:18.759294 11332 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.738951 11243 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.742342  8842 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:16:18.733038 11307 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.994s	user 0.008s	sys 0.001s
I20260709 13:16:18.746529 10718 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.743973  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.739166 11286 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.748548  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:18.767176  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.769804  8841 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:18.767912 11262 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.762563  8843 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.768575  8842 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:18.760522 11243 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.750434 11247 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:18.787004  8842 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:18.787415  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.788949  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.760747 11332 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:18.797566 10931 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.587s	user 0.015s	sys 0.005s
I20260709 13:16:18.797919  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.798161 11243 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.798777  8836 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.798033 10931 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.799412  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1559) took 1949 ms. Trace:
I20260709 13:16:18.799597 10718 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.799804  8916 rpcz_store.cc:276] 0709 13:16:16.819995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.845812 (+ 25817us) service_pool.cc:224] Handling call
0709 13:16:16.857809 (+ 11997us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:16.870859 (+ 13050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.870894 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:16.871636 (+   742us) log.cc:844] Serialized 52 byte log entry
0709 13:16:17.065320 (+193684us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:17.065359 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.065431 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.706909 (+1641478us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b24001f50c8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccec09d 00007fce6f91e10e 00007fce6f93588c 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221
0709 13:16:18.764512 (+ 57603us) raft_consensus.cc:1685] finished
0709 13:16:18.764538 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.768959 (+  4421us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":165,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":16792832,"thread_start_us":193073,"threads_started":1,"wal-append.queue_time_us":748209}
I20260709 13:16:18.801656 11318 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.803844  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.807910 11219 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.808928 10751 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.809372 10751 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.809760 10751 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.809930  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.809970 11274 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.804559  8841 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:18.815609  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:18.815900  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 117062us
I20260709 13:16:18.744613 11300 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:18.749751 11319 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.763517 11165 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:18.821419  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.827620  8841 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:18.828701  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.784494 11242 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.837109 11242 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.837604 11242 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.838137 11286 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:18.839093  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:18.840050  9460 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:18.841828  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.842204  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.842535  8911 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:18.842589  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.843940  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.845281  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.846104  8915 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:18.846985  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.848173  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:18.849309  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.824745  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.850720  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.851670  8836 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 2: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.825412  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.826104  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.778270 11262 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:18.850045  8844 raft_consensus.cc:2376] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6. Re-sending same reply.
I20260709 13:16:18.829905  8841 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.833456  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.861124  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:18.834010  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.834527 10947 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.844563  8843 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:18.852669  8835 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:18.860558  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.823953 11243 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:18.862893  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.874220  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.852944 10718 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.848389 11247 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.864306  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.823933 10931 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:18.873035  8839 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:18.861768  8837 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.881686  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.855418 11262 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.883285  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.914842  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.913216  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.917475  8838 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.917611  9463 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:18.914649  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.918768  8844 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.919097  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.912395  8914 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:18.916117  8910 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:18.920624  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.890611  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.848389 11215 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.925545  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:18.881976 11162 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.926465 11162 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.927402 10839 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.928674  8918 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:18.929361  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.932534  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.912659 11243 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:18.927456 11215 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:18.875511 11182 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.539s	user 0.013s	sys 0.000s
I20260709 13:16:18.935563  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:18.925899  9459 consensus_meta.cc:287] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.003s
I20260709 13:16:18.927335  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:18.940717  8840 raft_consensus.cc:2368] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:18.921707  8909 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.937745  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:18.941651  8763 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:18.938563  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.942761  9465 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:18.943192 10947 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:18.943524  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.943964  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.944121  8914 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:18.944610  8913 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:18.950114  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:18.951181  8841 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 3: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.952749  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.956197  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.947547  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.957365  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.957696  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:18.957902  8912 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:18.958272  9463 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:18.928596 11162 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:18.959461  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:18.961323  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 172439us
I20260709 13:16:18.961716  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.963721  8917 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:18.963811  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.956542  8809 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:18.961187  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:18.966039  8841 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:18.967819  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:18.968763  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.970619  8838 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:18.883760 10718 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:18.945256  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:18.974917  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.940121  9459 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:18.976367  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49104.9us
I20260709 13:16:18.934561 11243 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.978530  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:18.982815  8916 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2.
I20260709 13:16:18.963825 11241 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.987003  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.987111  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.988883  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:18.989676  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.989598  8912 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:18.992274  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:18.996002  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:18.998508  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:18.999126  8915 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.004678  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:19.005127  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:19.005445  8840 raft_consensus.cc:2368] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:19.006165  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:19.007676  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:19.008023  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:19.008286  8843 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:19.009387  8843 raft_consensus.cc:1217] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Deduplicated request from leader. Original: 1.1->[3.2-5.3]   Dedup: 3.2->[5.3-5.3]
I20260709 13:16:19.009930  8843 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:18.990043 10718 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:19.017012 10931 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:19.011914  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:19.013796 11116 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:18.997296 10839 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.025151 10839 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:18.998068 11241 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.025532 10839 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:19.026459 10839 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.014767 11119 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:19.018944 11318 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:19.034319 11318 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:19.034509 11247 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.035264 11318 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:18.997805 11286 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:19.037196 11286 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.037572 11286 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:19.040158  9465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 409) took 1022 ms. Trace:
I20260709 13:16:19.040717  9465 rpcz_store.cc:276] 0709 13:16:18.018174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.018350 (+   176us) service_pool.cc:224] Handling call
0709 13:16:19.039928 (+1021578us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b540057dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:19.040081 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077556480}
I20260709 13:16:19.045392 11219 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:19.018945  8840 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.026859 11319 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.022413  8917 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
W20260709 13:16:19.049427  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3b34c95a175945b88b17f07fbc650abf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:19.063053  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.066708  8909 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:19.072489  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.077934  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:19.082429  8913 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:19.059624 11119 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.089535  8917 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.090116  8918 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:19.061936 11168 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:19.101148  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 137411us
I20260709 13:16:19.102353  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:19.102562  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:19.099756  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.103936  8909 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:19.105834  8910 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:19.107205  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:19.109846  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.066147 10751 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.112351  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.117916  8917 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:19.080590 11262 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.076665 11242 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.122984  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:19.123494  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:19.123950  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:19.109258 11319 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.098107 11119 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.137651  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.143599  8840 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:16:19.130906  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 116614us
I20260709 13:16:19.132355  8842 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:19.133384 11350 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.134006 11247 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:19.110931 11116 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:19.147393  8913 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:16:19.148429  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:19.151311  8917 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.130600 11219 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.152074  8913 pending_rounds.cc:85] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 7
I20260709 13:16:19.160239  8913 pending_rounds.cc:107] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:16:19.161123  8913 raft_consensus.cc:2889] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.185606  8735 leader_election.cc:400] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
W20260709 13:16:19.196370  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.196663 11116 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.181777  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.154187 11219 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:19.284785  9463 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:19.200565  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.324548  8915 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:19.336449  8909 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:19.271600  8912 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:19.340714  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.269172  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.343128  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.310015  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:19.258967 11355 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:19.315258 11119 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.159166 11247 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:19.344452  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:19.269629  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 135989us
W20260709 13:16:19.354827  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 169456us
W20260709 13:16:19.372409  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.373380  8914 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:19.374358  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.316674 11332 consensus_meta.cc:287] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.001s
I20260709 13:16:19.376291  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.293232 10718 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.378345 10718 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.379648 11247 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.380676 11360 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:19.370354 11355 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.387821  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:19.381678  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.381991  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.389813  8914 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:19.385262  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.390900  8915 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:19.349143 11219 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.200664 11300 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.388833  8912 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:19.391963  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:19.350888 11242 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.384408  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:19.200567 11162 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.156188 11350 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.408330  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:19.159456 11353 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.242s
I20260709 13:16:19.410884  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:19.411854  8765 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.385622 11172 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:19.382589  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.394337 11332 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 13:16:19.388266  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.398223  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.402655  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:19.403339  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:19.416410  8914 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.404493  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:19.417686 10839 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.388747 11262 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.394551 10928 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:19.392330 10751 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.416706  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:19.420235  8762 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.382282 11355 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.406553 11300 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.405081  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:19.423345 11300 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.425745  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:19.426566  8912 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.400604  8910 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:19.418299  8760 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.401194  8915 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.426025  9463 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:19.380800 10718 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:19.430989  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:19.431829  8769 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:19.438467  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:19.439621  8764 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:19.440829  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:19.441560 11241 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.396806 11215 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:19.442735  8767 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:19.442889  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:19.446362  8766 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:19.450907  8762 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:19.424817 11172 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:19.453791 11172 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:19.455353 11356 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:16:19.455699 11286 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.444183 11363 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:16:19.381240 11360 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.462581 11350 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.429734 11116 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:19.480608  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 89801.3us
W20260709 13:16:19.481271  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 107563us
I20260709 13:16:19.442618 11215 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:19.499717  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:19.501886  8765 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:19.501849  8912 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:19.502259  8915 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:19.503834  8760 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
W20260709 13:16:19.505522  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 103741us
W20260709 13:16:19.507601  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75181.2us
W20260709 13:16:19.522070  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.437096 11162 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:19.533619  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45184.6us
I20260709 13:16:19.534729  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:19.546592 11286 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:19.536530 11116 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:19.547726 11116 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:19.548906 11116 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.549372 10928 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.553040 10718 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:19.553501 10718 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:19.554724 10718 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.2, Last appended by leader: 2, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.556224 10718 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:19.558717 10947 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:16:19.560066 11241 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:19.560806 11241 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.564190 11241 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.476536 11243 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:19.568524 11243 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:19.569090 11243 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.571323 11243 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.571864 11243 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:19.575531 11360 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:19.558640 11162 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:19.552594 10928 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.572605 11243 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.504926 11215 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:19.704998  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.652220  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:19.710852  9465 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:19.711642  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 63280.4us
I20260709 13:16:19.642982  8768 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:19.534322 11367 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:19.615427  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75659us
W20260709 13:16:19.708415  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 222242us
W20260709 13:16:19.592368  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 57685us
W20260709 13:16:19.720183  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.668306  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:19.728966  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:19.729969 11168 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.730443 11168 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.652788  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:19.730858 11168 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:19.698387 11361 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.303s	user 0.000s	sys 0.003s
I20260709 13:16:19.732088  8884 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:19.732822 11377 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:19.733649 11172 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:19.734066  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 65886.9us
I20260709 13:16:19.736588  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:19.661491 10751 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:19.747309  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:19.739391  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:19.711669 11362 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.753557 11362 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.747802 10947 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:19.754624 10947 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.755751 11362 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.662338 11262 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:19.756446 11262 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:19.742192 11368 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:19.757220 11368 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:19.757599 11368 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:19.757639 11262 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.758996 11262 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.648803 11162 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.752566 11215 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.762092 11215 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.762482 11364 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:19.762929 11364 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:19.667316 11219 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.763336 11162 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.665056 11355 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.746791 10751 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:19.766211 11355 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.766731 11376 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:19.773252  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48602.5us
I20260709 13:16:19.775166  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:19.787271  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:19.740537 11172 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.740957 11367 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:19.740114 11353 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:19.807144 11243 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.808147 10718 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:19.809259 11172 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:19.805269  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58013.8us
I20260709 13:16:19.810119  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:19.809003  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:19.819908  8842 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:19.823194  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 48088us
I20260709 13:16:19.824633  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:19.825572 11355 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.826112 11355 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:19.780967 10839 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:19.839020  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 77429us
I20260709 13:16:19.839465  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:19.841739  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:19.837028  8807 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.524s (SENT)
I20260709 13:16:19.742508 11375 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:16:19.835258 11377 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:19.855914  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:19.830812 10931 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:19.817687 11219 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.818930 10947 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:19.865207  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.871503  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:19.856828  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:19.830987 11116 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.836654 11376 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:19.859443  8842 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:19.853016 11362 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:19.878892 10839 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.911478 11375 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:19.912333 11379 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:19.918542  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:19.857337 11377 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:19.828583 11353 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:19.874176 11119 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:19.928217  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 177088us
I20260709 13:16:19.910408 11162 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:19.942524  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:19.948566  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 117763us
I20260709 13:16:19.950824  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:19.917106 11362 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.951949  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.022207  8839 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:19.856083 11182 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:16:19.854979 11355 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.933280 11376 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.918951 10751 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.028606 11365 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:20.001523 11168 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.031383 11168 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:19.984643 11377 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.033020 11377 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.956780  8843 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:19.994377  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54854.4us
I20260709 13:16:20.036031  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:19.968582 11119 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:19.958461 11367 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:19.985525  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:19.957788  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 125020us
I20260709 13:16:19.955269 11384 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:19.983814  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.050571  8837 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
W20260709 13:16:19.974195  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.023772  8836 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:16:20.026216  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 154852us
I20260709 13:16:19.978139 11332 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:19.976259 11385 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:20.022882 11362 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:20.028820 11383 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:16:20.053004  8807 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.528s (SENT)
I20260709 13:16:20.055631  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.066012  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.066335 11364 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.066987  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.067624 11364 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:20.067970  8807 leader_election.cc:336] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.632s (SENT)
I20260709 13:16:20.068419  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:20.068678 11247 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.069736  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.068431  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.070947 11168 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.070518 11357 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.071363 11168 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.071516 11357 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.071810 11168 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.072005 11357 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.049206 10928 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.072608 10928 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.073030 10928 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:20.073366  8807 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.641s (SENT)
I20260709 13:16:20.073865  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.074595 11247 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:20.075342 11365 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.075352 10947 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.075989 11365 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:20.076473  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.076428 11365 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.077088 10839 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.056574 11332 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.082296 11182 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.082552 11168 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.082923 11182 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:20.061661  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 110926us
I20260709 13:16:20.080137 11172 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:20.081462  8807 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.642s (SENT)
I20260709 13:16:20.107894  8735 leader_election.cc:400] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:20.108559  8735 leader_election.cc:403] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 13:16:20.108081  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53307.7us
I20260709 13:16:20.085506  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:20.049902 11384 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.056192 11300 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:20.129498  8807 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.652s (SENT)
I20260709 13:16:20.084784 11168 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.134670  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.135574  8844 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.107192 11241 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.060537 10931 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:20.142035  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.142686  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:20.141939  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.143982  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.140129  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.144994  8841 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.142268  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.141881 11385 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:20.145932  8836 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 2.
I20260709 13:16:20.146318  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.146245  8839 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:20.156111  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48397us
I20260709 13:16:20.157662  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:20.159880  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 234095us
I20260709 13:16:20.164062  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:20.164121  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 78687us
I20260709 13:16:20.130371 11300 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:20.165573  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:20.170073  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55839.3us
I20260709 13:16:20.172827  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:20.159063  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 107902us
I20260709 13:16:20.167922  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:20.174476  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:20.174922  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.160851 11385 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.172573  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.114024 11394 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:20.177294  8842 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:20.178661  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.179694  8842 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:20.183245  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.184072  8837 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:20.082404 11332 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.180672  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:20.196810  8807 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.652s (SENT)
I20260709 13:16:20.197353  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.197817  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.193804  8842 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:20.158913 11396 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.166491 11119 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.205700  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.205883  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.212143  8909 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:20.206390  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.204316  8841 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:20.171494 11168 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.182766 10839 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.215505  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.220842  8911 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.182046 11355 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.176647 11182 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.154716 11241 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.222564  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.228029  8913 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:20.195983 10718 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:20.223500  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.230741 11355 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.231225 11355 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.231611 11355 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.206410 11219 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.257408 11368 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.261693 11172 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:20.187383 11391 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:20.266428  8837 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:20.267581  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.245291  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 74504.8us
I20260709 13:16:20.175719 11384 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:20.254004  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.275758 11241 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.283962  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.289577  8664 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 2 to 5, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:20.291463  8664 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:16:20.303453 10751 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:20.211637 11119 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:20.314495  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:20.305179 11300 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.311200 10839 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:20.312804 11384 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.226370 11332 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.326459  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.334283  8664 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:20.339910  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.340134 11362 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.339915  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.342281 11362 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.344007  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.345194  8844 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:20.345378  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.346001  8912 raft_consensus.cc:2376] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:16:20.346370  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.346896  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.347596  8843 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:20.333804 10931 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.360620  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.361434  8839 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:20.313104 11182 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:16:20.320009 11391 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:20.371815 11318 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.372478 11318 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.346956  8909 raft_consensus.cc:2376] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4. Re-sending same reply.
I20260709 13:16:20.375288  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.376142  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:20.379156  8915 raft_consensus.cc:2376] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2. Re-sending same reply.
I20260709 13:16:20.382002  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:20.382644  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.386592  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.387955  8664 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 4, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 4 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.368110 11357 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.390177  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.392076 11318 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:20.392356 11357 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.394282  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:20.401530  8839 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.401804  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.369503 11391 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.408736  8837 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:20.409669 11365 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.410291  8839 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.410910  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.385874  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.321683 11119 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.411900  8909 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
W20260709 13:16:20.413431  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.418296  8913 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:20.419838  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.421137 11390 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:20.422900  8836 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:20.424602 11241 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.425532  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:20.310223 11353 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:20.430187  8844 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:20.442286 10928 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.443850  8918 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:20.446231  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:20.448014  8807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.936s (SENT) [suppressed 45 similar messages]
I20260709 13:16:20.449741  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.460595  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:16:20.461573  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155139us
I20260709 13:16:20.451720  8911 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:20.465659  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.466423  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.463255  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:20.468737  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.476250  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:20.478744  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.479535  8844 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.485749  8664 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 1 to 4, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 4 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.356217 11355 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.445372 11368 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:20.493301  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:20.484666  8667 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 219) took 22158 ms (client timeout 15000 ms). Trace:
W20260709 13:16:20.497720  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 315299us
I20260709 13:16:20.497067  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:20.497166  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.504244  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.508133  8884 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.462364 11375 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:20.489277 11390 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:20.515729  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52559.1us
I20260709 13:16:20.491053 11377 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.517627 11390 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.490432 11241 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:16:20.522330 11390 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.522773 10928 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:20.523833 11400 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:20.524426 11410 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.525166 11410 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:20.525971 11410 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.531217 11219 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.532312 11364 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.532737 11364 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:20.533401 11390 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.534016 11364 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.497028 11387 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.513629  8844 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:20.535395 11364 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.497517 10718 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:20.541451  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.537041  8914 raft_consensus.cc:2410] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:20.561170  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49462.7us
I20260709 13:16:20.515144 11386 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:20.516084 11375 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.518422 11389 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.518713 11368 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:20.570951  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 387049us
W20260709 13:16:20.574421  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 400072us
I20260709 13:16:20.520450 11377 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.560149 11262 raft_consensus.cc:2764] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:20.535521 11390 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:20.509691 11162 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:20.539420 11396 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:20.562111 11387 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.563393 10928 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:16:20.618564  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:20.615581  8840 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:20.560026 11401 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:20.639699  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49213.6us
I20260709 13:16:20.642700  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.600775  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.591454  8732 leader_election.cc:400] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
W20260709 13:16:20.622327  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.589694 11375 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:20.644850 11353 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:20.616063 11385 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:20.588932 10718 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.646930  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:20.589479 11389 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.599408 11377 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.646138  8732 leader_election.cc:403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.598707 11386 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.611464 11365 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:20.615324 11355 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.657316  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:20.497679  8667 rpcz_store.cc:269] 0709 13:15:58.340066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.412915 (+ 72849us) service_pool.cc:224] Handling call
0709 13:16:20.484428 (+22071513us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:16.648371 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:16.665355 (+ 16984us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:16.703261 (+ 37906us) write_op.cc:435] Acquired schema lock
0709 13:16:16.729309 (+ 26048us) tablet.cc:662] Decoding operations
0709 13:16:17.190432 (+461123us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:17.190569 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:17.190645 (+    76us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:16:17.192681 (+  2036us) tablet.cc:701] Row locks acquired
0709 13:16:17.192750 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:16:17.251789 (+ 59039us) write_op.cc:270] Start()
0709 13:16:17.285794 (+ 34005us) write_op.cc:276] Timestamp: P: 1783602977246244 usec, L: 0
0709 13:16:17.298382 (+ 12588us) op_driver.cc:348] REPLICATION: starting
0709 13:16:17.468753 (+170371us) log.cc:844] Serialized 7848 byte log entry
0709 13:16:18.065900 (+597147us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd95e28 00007fce737d0581 00007fce737cfd58 00007fce737d49f1 00007fce737d49a9 00007fce737d4939 00007fce737d4901 00007fce737d3b2d 000000000038f354 000000000038f199
0709 13:16:18.359891 (+293991us) op_driver.cc:464] REPLICATION: finished
0709 13:16:18.769365 (+409474us) write_op.cc:301] APPLY: starting
0709 13:16:18.783369 (+ 14004us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:18.813295 (+ 29926us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:18.813334 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:18.930469 (+117135us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:18.930911 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=20
0709 13:16:18.930984 (+    73us) write_op.cc:312] APPLY: finished
0709 13:16:18.931550 (+   566us) log.cc:844] Serialized 138 byte log entry
0709 13:16:18.931763 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:18.931963 (+   200us) write_op.cc:454] Released schema lock
0709 13:16:18.932045 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:18.995273 (+ 63228us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:18.999784 (+  4511us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1224064,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":377716,"apply.run_cpu_time_us":6665,"apply.run_wall_time_us":210831,"num_ops":20,"prepare.queue_time_us":627262,"prepare.run_cpu_time_us":41095,"prepare.run_wall_time_us":1453413,"raft.queue_time_us":107197,"raft.run_cpu_time_us":17138,"raft.run_wall_time_us":121963,"replication_time_us":1053149,"spinlock_wait_cycles":9078528,"thread_start_us":1113134,"threads_started":4,"wal-append.queue_time_us":334916,"wal-append.run_cpu_time_us":70227,"wal-append.run_wall_time_us":2131436}]]}
W20260709 13:16:20.668287  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.638188 11387 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.597407 11392 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:16:20.674458  8838 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.678469  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:20.700907  9468 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:20.702226  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55395us
W20260709 13:16:20.681856  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.696065  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:20.707509  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 115874us
I20260709 13:16:20.709967  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.711385  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.718868  8768 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:16:20.699184 11116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.003s	sys 0.033s
I20260709 13:16:20.673128 11215 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:20.707247  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:20.720094  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.722608 11367 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.689425 11389 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.651644 10751 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:16:20.721025  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.706702 11385 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.729628  8763 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:20.697324 11219 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:20.727982  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.673350 11376 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:16:20.717021 11300 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.749769  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.747267  8760 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:20.717643 11357 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:20.754582  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.755458  8762 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:20.728439 11215 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:20.730300 11394 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.004s	sys 0.018s
I20260709 13:16:20.718509 10947 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:16:20.776960 10718 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.745517 11182 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:16:20.791142 11376 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.791687 11385 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.757092 11403 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:20.725718 11396 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:16:20.691001 11386 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.797708 11353 raft_consensus.cc:2764] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:20.756843 11391 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.810655 11390 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.834503  9468 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:16:20.824162  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 210404us
W20260709 13:16:20.828361  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 132410us
I20260709 13:16:20.836573  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:20.831696  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 120394us
I20260709 13:16:20.768796 11215 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.837947  8807 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.836572  8884 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.812880 11376 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.839656  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.846349  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.816011 11385 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.853293  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.854628  8760 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:20.856923  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.857566  8766 raft_consensus.cc:2376] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:16:20.813020 11398 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:20.861701  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.862448  8760 raft_consensus.cc:2368] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:20.854058  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.833791 11390 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.863340  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.863646  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.859211  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:20.869252  8760 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.852710 11376 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.867591  8761 raft_consensus.cc:2376] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 2. Re-sending same reply.
I20260709 13:16:20.870610  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.875145  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.844067 11411 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.874253  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:20.875571  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.871690  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.875891  8760 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:20.876346  8844 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.855549 11384 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.876227  8766 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:20.859347 11394 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:20.881354  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:20.882386  8838 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:20.883306  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 169662us
I20260709 13:16:20.833367 11410 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.839665 11119 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.862375 11262 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:20.887207  8837 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.893594  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.863618 11401 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:20.896584  8844 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:20.842187 11391 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:20.899595  8763 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:20.892774  8762 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:20.900431 10751 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:20.901443  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.903159  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.873894 10928 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.866169 11423 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:20.908039  8761 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:20.904512  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.911173  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.827497 11403 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.925042  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.925805 11403 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:20.926580  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.927798  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.928398  8762 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:20.929888  8769 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:20.930497  8767 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:20.910120  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.911085 11427 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.882941 11353 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:20.913551  9465 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.943750 11353 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:20.944742 11353 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.948379  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.948943 11411 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:20.949111  8769 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.920360  8765 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:20.909796  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:20.919741  8768 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:20.906883 11394 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.935034  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.952255  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.922459  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.871927 11368 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:20.933964  8763 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:20.953856  8768 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:20.886586 11219 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:20.963210 11411 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:20.963913 11219 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.965574  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:20.935096  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.940224 11390 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:20.942595 11391 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:20.956367  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.957016  8768 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:20.961980 11415 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:16:20.962852 11418 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:16:20.956111  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:20.974548  8763 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.967096  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:20.964171 11411 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:20.969705  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60082.3us
I20260709 13:16:20.912922 11424 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:20.972493  8764 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:20.976518  8762 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:20.976990  8767 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.983389  8844 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:20.986450  8768 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:20.913148 11162 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:16:20.982290  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:20.936591 11423 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:20.991282  8768 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.977815 10751 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:21.022883  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.031811  8763 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:21.030874  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:21.041618  8769 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:20.985075 11424 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.048418 11424 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:20.993021 11392 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:20.999826 11390 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:21.059252  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 138716us
I20260709 13:16:21.000519 11422 raft_consensus.cc:2764] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:21.030932 11368 consensus_queue.cc:1243] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:21.034442 11262 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:21.096346  9465 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:21.100495 11119 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:20.958740 11427 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.107834  8769 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:20.990537 11425 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:16:21.114007 11434 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:21.115065  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 113793us
I20260709 13:16:21.117461  8844 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:21.087615 10751 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:21.126490 11425 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:21.127380 11425 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:21.129343  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:21.129617  8763 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:21.120646 11168 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.130436 11434 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:21.131218 11168 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:21.133407 11168 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:21.135821 11434 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:21.136559  8768 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:21.138340 11427 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:21.138970  9463 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:21.139485  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:21.140079  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:21.140166  9460 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:21.141275  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:21.141816  9464 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:16:21.095624 11392 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:21.153860  9465 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:21.146073  9432 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:21.143960  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:21.144336  8836 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:21.104794 11387 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.155227  8767 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:21.157194  8807 leader_election.cc:400] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:21.157604  8807 leader_election.cc:403] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.159027  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:21.159405  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:21.060073 11377 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:21.088743 11215 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.175151  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:21.177276 11433 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:21.177119 10928 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.177871 11433 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:21.178517  8761 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:21.178812 11433 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.181253 11427 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:21.181756 11427 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:21.182734 11427 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.184154 11427 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.157258 10751 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:21.199973  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.161149 11405 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.163501 11168 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:21.162549 11172 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:21.203862  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46859.4us
I20260709 13:16:21.168565 11182 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:21.172696 11318 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.158491 11401 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:16:21.166602 11429 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:21.168473 11413 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.210275 11168 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.211886  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:21.235914 11376 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.218776 11182 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.220582  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:21.223137 11421 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.230602 11215 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:21.231482 10751 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.231971  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.232410 11437 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:21.200974 11396 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:16:21.235052  8808 leader_election.cc:400] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:21.268647  8808 leader_election.cc:400] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:21.268959  8808 leader_election.cc:403] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:21.238741  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:21.239214 11367 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.158558 11119 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:16:21.207787  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:21.219748 11318 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:21.247300  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.210652 11172 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:21.106721 11394 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.198493 11389 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.253213  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:21.201603 11388 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
W20260709 13:16:21.263660  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50849.7us
I20260709 13:16:21.262895 11182 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.248134 11168 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:21.244810 11413 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.278013  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:21.215891 11398 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:21.253170 11434 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.282231 11421 consensus_queue.cc:1243] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:21.198117 11423 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.2, Last appended by leader: 2, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.311084 11385 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.283540 11377 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:21.213606 11405 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:21.303841  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50691.6us
W20260709 13:16:21.308887  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.309108 11362 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.290202  9459 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:21.341445  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:21.342237  8911 raft_consensus.cc:2376] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:16:21.321333  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:21.332713  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:21.324051  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:21.302704  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.337785  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.282701 11435 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:16:21.342341  8918 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.343231  8915 raft_consensus.cc:2368] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4.
I20260709 13:16:21.333001  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:21.343017  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.341254  8917 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:21.343649  8836 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:21.344312  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:21.344802 11441 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:21.300413 11413 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.246798 11429 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:21.261881 11392 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.301179 11367 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.346217 11405 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:21.706736  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:21.569830 11262 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:21.715982  8912 raft_consensus.cc:2376] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6. Re-sending same reply.
W20260709 13:16:21.509092  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.001s
W20260709 13:16:21.718501  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.014s	sys 0.006s
I20260709 13:16:21.364467  8911 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:21.719194  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 753655us
W20260709 13:16:21.633597  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.487357  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.859449  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:21.407748  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:21.875106  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.934736  8909 raft_consensus.cc:2376] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:16:21.366518  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:21.936048  8842 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:21.729094  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:21.937507  8913 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:16:21.721902  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.722867  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:21.652254  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 282331us
I20260709 13:16:21.364627  8914 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:21.938880  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.762997  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 441733us
I20260709 13:16:21.322242 11364 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.936141  8838 raft_consensus.cc:2368] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
I20260709 13:16:21.942935  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:21.946398  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:21.941882  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:21.943878  8843 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:21.793774  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:21.949724  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:21.319231 11434 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:21.949582  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:21.762645  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:21.653540 11424 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.003s
W20260709 13:16:21.418900 11420 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.518s	user 0.000s	sys 0.006s
I20260709 13:16:21.967757  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.329465 11387 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:21.872738 11431 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.710s	user 0.003s	sys 0.005s
W20260709 13:16:21.457557 11375 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.806s	user 0.009s	sys 0.003s
I20260709 13:16:21.417780 11437 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:22.033231 11437 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:21.782218 11414 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:16:22.002983  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:21.880599 11241 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.456543 10931 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:21.901782 11355 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.347033 11362 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.729664 11403 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.891407 11385 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.046010 11435 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:21.999557  8835 raft_consensus.cc:2376] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6. Re-sending same reply.
I20260709 13:16:21.984218  8842 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:21.459482 11410 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:21.875823 11376 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:21.767493 11219 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:21.853701 11168 consensus_meta.cc:287] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 13:16:21.455469 11425 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:21.872370 10947 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:21.760353 11353 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.561086 11396 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.019368 11451 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:21.872722 11172 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.022137 11375 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.956846 11364 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:22.024284 11391 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:22.024554  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1451) took 1136 ms. Trace:
I20260709 13:16:21.847807 11411 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.877020 11443 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:21.913363 11119 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.027218 11318 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:21.458500 11384 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.992672  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:22.035878  8837 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
W20260709 13:16:22.045857  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 96229.7us
I20260709 13:16:22.047669  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:21.996526 11388 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.454337 11402 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:22.229583  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 212171us
I20260709 13:16:21.957399 11401 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:16:22.015383 11367 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.017994 11389 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:21.364666 11182 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.067639  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.293371  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.294059  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.294891  8760 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:22.069418  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.295735  8768 raft_consensus.cc:1813] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Handling vote request from an unknown peer bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.072875  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 220) took 1431 ms. Trace:
W20260709 13:16:22.008756  9431 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.010s
W20260709 13:16:22.303879  9431 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.011s	sys 0.010s
W20260709 13:16:22.304255  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 802938us
I20260709 13:16:22.305789  8768 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:22.098434  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:21.714102 11262 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.049646 11300 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.049638 11452 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.127676  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.315403  8842 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:22.316316  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:22.316457  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:22.317288 11398 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:22.317826  8842 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:22.293015 11466 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:16:21.992894 11424 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.318666 11182 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.319180 11318 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.130327  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.323288  8835 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:22.134001  8769 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:16:22.324694 11457 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:16:22.324932  8836 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:22.325527  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1465) took 1002 ms. Trace:
I20260709 13:16:22.325742  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.325876  8836 rpcz_store.cc:276] 0709 13:16:21.323502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.323705 (+   203us) service_pool.cc:224] Handling call
0709 13:16:22.325464 (+1001759us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:22.327391  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.328178  8769 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:22.140060  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:22.034333 11437 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.052671 10931 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:22.329521  9460 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:22.330338 10931 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.331360 10931 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.149338  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:22.332223 11452 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.104362 11435 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:22.333621 11435 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:22.335450 11452 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:22.159252  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:22.154728 11168 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.052683 10928 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:16:22.049794 11377 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:16:22.052539 11241 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.199934  8841 rpcz_store.cc:276] 0709 13:16:20.887926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.891370 (+  3444us) service_pool.cc:224] Handling call
0709 13:16:20.908562 (+ 17192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.922548 (+ 13986us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:20.922581 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.929296 (+  6715us) log.cc:844] Serialized 26 byte log entry
0709 13:16:21.004205 (+ 74909us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:21.004266 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.066747 (+ 62481us) spinlock_profiling.cc:243] Waited 7.91 ms on lock 0x7b54001d9f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:21.066791 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.872050 (+805259us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:22.024323 (+152273us) raft_consensus.cc:1685] finished
0709 13:16:22.024348 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.024491 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5361,"raft.queue_time_us":5902,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":22582,"spinlock_wait_cycles":38093440,"thread_start_us":74004,"threads_started":1,"wal-append.queue_time_us":121190}
I20260709 13:16:22.162861 11353 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.207162  8838 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:22.215345  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.165591 11396 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.072289 11403 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.222647  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:22.360332  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 137787us
I20260709 13:16:22.360713  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.361119  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.363713  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.059862 11355 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.223533 11411 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.205165 11364 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.234903 11451 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:16:22.309851  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:22.342948  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.009s	sys 0.023s
I20260709 13:16:22.310881  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:22.374774  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.009s	sys 0.023s
I20260709 13:16:22.375336  8760 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:22.154592 11434 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.296236  8840 rpcz_store.cc:276] 0709 13:16:20.641914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.642340 (+   426us) service_pool.cc:224] Handling call
0709 13:16:20.642677 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:20.643049 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:20.643086 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:20.648376 (+  5290us) log.cc:844] Serialized 26 byte log entry
0709 13:16:20.887081 (+238705us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:20.887115 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.887172 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:21.346271 (+459099us) spinlock_profiling.cc:243] Waited 944 us on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:22.061327 (+715056us) raft_consensus.cc:1685] finished
0709 13:16:22.061358 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.072767 (+ 11409us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":451,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":7279,"spinlock_wait_cycles":2171264,"thread_start_us":180623,"threads_started":1,"wal-append.queue_time_us":227631}
I20260709 13:16:22.312526  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:22.213622 11443 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:22.207633 11461 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:22.318817 11466 consensus_queue.cc:1243] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:22.329365  8836 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:22.150288  8763 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.387564  8835 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:22.151810  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.230399 11402 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:22.162299 10947 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.215399  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:22.400825  8836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:22.320652 11424 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:22.267182  8732 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.511s (SENT)
I20260709 13:16:22.407828  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.408823  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.412750  8842 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:22.340646  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 398769us
I20260709 13:16:22.237725 11384 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.231225 11119 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.373540  8765 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:22.329386  8767 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:22.314277 11429 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:22.235620 11388 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.382627  8760 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.232048 11391 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.383574  8762 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.338429 11172 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.388625  8761 raft_consensus.cc:2376] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7. Re-sending same reply.
I20260709 13:16:22.390208  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.393734  8912 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.394349  8768 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:22.396885  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.446442  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:22.405534  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1544) took 1006 ms. Trace:
I20260709 13:16:22.424572  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:22.337394 11300 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.447633  8840 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:22.386335 11425 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.465122  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.447057  8838 rpcz_store.cc:276] 0709 13:16:21.399305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.002684 (+603379us) service_pool.cc:224] Handling call
0709 13:16:22.405344 (+402660us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540021cd54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:22.405472 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371394816}
I20260709 13:16:22.374856 11452 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.401516  8836 raft_consensus.cc:606] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:22.476208  8836 raft_consensus.cc:614] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:22.445312  8918 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:22.399677 11367 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.454259  8763 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:22.454788  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:22.478024  8839 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:22.455240  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.455295  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1340) took 1112 ms. Trace:
I20260709 13:16:22.456503  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.367837 11182 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:16:22.410257 11451 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:22.406322 11466 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.474838  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.482508  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.483129  8835 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:22.478971  8912 rpcz_store.cc:276] 0709 13:16:21.342582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.717160 (+374578us) service_pool.cc:224] Handling call
0709 13:16:21.782633 (+ 65473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.445863 (+663230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.455018 (+  9155us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54000384d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:22.455240 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404748160}
I20260709 13:16:22.494051  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.501694  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.500002  8914 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:22.497571 11451 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:22.519390 11467 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:16:22.521677  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.463973 11425 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:22.511966  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 155490us
I20260709 13:16:22.407879 11461 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.509470 11466 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:22.518567  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 142825us
W20260709 13:16:22.537835 11463 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:16:22.527712  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:22.528385 11460 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:16:22.530023  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:22.530731 11469 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.481448 11367 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:22.526207  8762 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:22.500514 11452 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.521625 11451 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.532820 11423 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:22.598268  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.656467  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.700263  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.701952  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.703495  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:22.686563  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 115457us
W20260709 13:16:22.692232  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 161402us
I20260709 13:16:22.692977  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.682734  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1339) took 1340 ms. Trace:
I20260709 13:16:22.697561  8768 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:22.557574 11425 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.734344  8911 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:22.735838  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.736256  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:22.737053  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.693529 11478 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:22.652042  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:22.704844  8913 raft_consensus.cc:2368] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
I20260709 13:16:22.704843  8917 rpcz_store.cc:276] 0709 13:16:21.342333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.714757 (+372424us) service_pool.cc:224] Handling call
0709 13:16:21.715099 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:21.715497 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.715524 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:21.760982 (+ 45458us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.126244 (+365262us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:22.126319 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.126430 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.682438 (+556008us) raft_consensus.cc:1685] finished
0709 13:16:22.682471 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:22.682653 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9856,"raft.queue_time_us":13275,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":22351,"thread_start_us":264142,"threads_started":1,"wal-append.queue_time_us":623189}
I20260709 13:16:22.740324  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.705227  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.560885 11464 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:22.697588  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.739112  8836 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:22.669052 11413 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.007s
I20260709 13:16:22.471323 11402 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.563994 11467 consensus_queue.cc:1243] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:22.740628  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.671800 11449 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:22.768949  8913 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.739768  8918 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:22.746500  8767 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:22.667912 11300 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.769827  8767 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:22.747893  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:22.756239  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:22.751152  9431 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:22.804242  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53193.5us
I20260709 13:16:22.757181  8917 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:22.762559  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57406.2us
I20260709 13:16:22.631093 11392 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.805822  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.569846 11466 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.765652  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.807185  8914 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.569021 11424 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:22.581892 11375 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:22.765709  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:22.650997 11410 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.735833 11318 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:16:22.650214 11168 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:22.650328 11396 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.747087  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.731388 11405 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:22.746959  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 191549us
I20260709 13:16:22.825641 11410 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:22.826632  8735 leader_election.cc:336] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.583s (SENT)
I20260709 13:16:22.827001 11318 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.827697 11318 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:22.827944  8735 leader_election.cc:336] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.878s (SENT)
I20260709 13:16:22.828181 11318 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:22.828222 11410 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:22.828387  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:22.869690  8839 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:22.871693  8914 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:22.872684  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:22.874076  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61952.8us
I20260709 13:16:22.875792  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:22.770368  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.768117 11451 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.698796 11423 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:22.871409 11385 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.000s
I20260709 13:16:22.697824 11367 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.807410  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:22.810307 11461 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.811679 11300 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:22.766996 11353 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.813409 11392 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.764426 11478 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.732260 11469 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.826174 11119 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.799293 11403 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:22.829460  8760 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:22.829873 11396 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.830565 11168 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:22.830626 11384 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:22.817740 11452 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:22.768260 11413 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.825290  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:22.834712  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.815493 11424 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:22.800087 11411 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:22.766119 11464 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.840780 11318 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.857235  8913 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:22.822549 11355 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:22.820382 11471 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
W20260709 13:16:22.877413  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49489.7us
I20260709 13:16:22.877853  8918 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:22.803112 11467 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:22.822085 11472 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:16:22.819226 11402 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:22.802222  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:22.818697 11388 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:22.789974  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.770776  8765 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:22.770151  8915 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:22.809582 11449 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:22.883128  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 130446us
I20260709 13:16:22.917393  8910 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:16:23.115906  8734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.013s	sys 0.016s
W20260709 13:16:23.141156  8734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.014s	sys 0.017s
I20260709 13:16:23.177891  8917 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:23.112727  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 236986us
I20260709 13:16:23.178930  8763 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:23.141885  8768 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:23.102245  8732 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.007s	sys 0.018s
I20260709 13:16:22.986660  8911 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:23.178375  8735 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.894s (SENT)
W20260709 13:16:23.120489  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.143241  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.875172 11391 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:22.876580 11405 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:23.186224  8764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.024s
I20260709 13:16:23.182313  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:23.180583  8732 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.007s	sys 0.021s
I20260709 13:16:23.180842  8917 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:23.182792  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:23.183023  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:23.184098  8768 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:23.187307  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 920109us
W20260709 13:16:22.881923 11219 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.004s
W20260709 13:16:22.918215 11483 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:16:23.188539  8917 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:23.183669  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:23.187054  9463 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:16:23.184724  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.185487  8762 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:23.186853  8764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.007s	sys 0.024s
I20260709 13:16:22.924551 11422 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.210350  9460 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:23.210729 10931 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.879s	user 0.010s	sys 0.002s
I20260709 13:16:23.210500  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:23.211045  8912 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:22.975621 11489 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:16:23.212136  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:23.213706  8913 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:23.232110  8917 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:23.232765  8913 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:23.214913  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1309) took 1143 ms. Trace:
W20260709 13:16:23.177497  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.971801 11364 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.000s
I20260709 13:16:23.076475 10751 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:23.184831 11452 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.205682  8768 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:23.222868  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44546.2us
I20260709 13:16:23.224674  8761 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:23.225847  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:23.177783 11172 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.114560 11435 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.780s	user 0.005s	sys 0.007s
I20260709 13:16:23.227530  9465 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:23.120005 11262 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:23.229521  8766 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:23.236711 11388 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.237229 11479 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:23.237407 11355 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.237977  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1317) took 1164 ms. Trace:
I20260709 13:16:23.225484 11422 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:23.237236  8732 leader_election.cc:336] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.583s (SENT)
I20260709 13:16:22.876477 11428 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.344s
I20260709 13:16:23.219664  8915 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:23.211689 11481 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.217221 11353 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:16:22.920728 11466 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:23.182705 11168 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:22.916731 11423 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:23.182631 11467 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:23.075560 11443 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:23.233650  8764 rpcz_store.cc:276] 0709 13:16:22.071059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.123353 (+ 52294us) service_pool.cc:224] Handling call
0709 13:16:22.151074 (+ 27721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.151353 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:22.507045 (+355692us) log.cc:844] Serialized 14 byte log entry
0709 13:16:23.214596 (+707551us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:23.214644 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:23.214695 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:23.214754 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.214861 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":616859,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":299831,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":50284,"spinlock_wait_cycles":109282688,"thread_start_us":1043497,"threads_started":3,"wal-append.queue_time_us":296731}
I20260709 13:16:24.009711  9463 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
W20260709 13:16:23.773196  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.010772  8735 leader_election.cc:336] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.951s (SENT)
W20260709 13:16:23.961265  8808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.013s	sys 0.025s
I20260709 13:16:24.011438  8735 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:23.357335  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.011631  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.012617  8769 rpcz_store.cc:276] 0709 13:16:22.073780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.338311 (+264531us) service_pool.cc:224] Handling call
0709 13:16:22.360395 (+ 22084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:22.571121 (+210726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.571170 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:22.630041 (+ 58871us) log.cc:844] Serialized 26 byte log entry
0709 13:16:22.802570 (+172529us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:22.802614 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.802698 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.237428 (+434730us) raft_consensus.cc:1685] finished
0709 13:16:23.237454 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.237902 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":468941,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":264746,"threads_started":2,"wal-append.queue_time_us":520975}
I20260709 13:16:24.011948  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:24.011933  8914 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.135s	user 0.027s	sys 0.041s
I20260709 13:16:23.672668  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54286 (request call id 425) took 2235 ms. Trace:
W20260709 13:16:24.015060  8914 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.027s	sys 0.041s
W20260709 13:16:24.011710  8808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.013s	sys 0.028s
W20260709 13:16:24.016206  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 804098us
I20260709 13:16:24.009850  8768 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.015218  9468 rpcz_store.cc:276] 0709 13:16:21.437611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.437749 (+   138us) service_pool.cc:224] Handling call
0709 13:16:21.438137 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:21.438643 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:21.438686 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:21.956940 (+518254us) log.cc:844] Serialized 52 byte log entry
0709 13:16:22.316074 (+359134us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:22.316112 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.316176 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:23.672431 (+1356255us) raft_consensus.cc:1685] finished
0709 13:16:23.672453 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:23.672603 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2269,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":31367,"thread_start_us":266031,"threads_started":1,"wal-append.queue_time_us":434865}
I20260709 13:16:24.017064  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:23.230885  8760 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
I20260709 13:16:24.019085  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1331) took 1272 ms. Trace:
I20260709 13:16:24.019845  8760 rpcz_store.cc:276] 0709 13:16:22.746721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.765458 (+ 18737us) service_pool.cc:224] Handling call
0709 13:16:24.019005 (+1253547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:23.220110 11219 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8.
I20260709 13:16:24.018957  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:24.025146  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 293) took 1506 ms. Trace:
I20260709 13:16:24.028328  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:24.027011  9464 rpcz_store.cc:276] 0709 13:16:22.519157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.519263 (+   106us) service_pool.cc:224] Handling call
0709 13:16:22.532009 (+ 12746us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:22.532514 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:22.532557 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:22.533323 (+   766us) log.cc:844] Serialized 52 byte log entry
0709 13:16:22.778587 (+245264us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:22.779178 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:22.780263 (+  1085us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:22.974875 (+194612us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:24.012044 (+1037169us) raft_consensus.cc:1685] finished
0709 13:16:24.012067 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.025069 (+ 13002us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1479,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":37963,"spinlock_wait_cycles":83424000,"thread_start_us":82996,"threads_started":1,"wal-append.queue_time_us":300775}
I20260709 13:16:24.029047  8835 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.031201  8839 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:24.031066  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.388608  9459 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:23.945964  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:23.390017 11496 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:16:23.445915 11424 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.036451  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.037452  8916 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:24.020627 11470 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.266276 11482 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.773157 11410 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:23.735354 11478 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:24.034265  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.662470 11492 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:23.266614 11364 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.010358 10751 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:23.794509 11484 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:24.043960  8843 raft_consensus.cc:2410] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:16:23.731351 11469 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:23.645156 11494 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.026307 11435 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.024609 11452 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.029822 11477 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:16:23.834187  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.025208 11400 raft_consensus.cc:3055] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:24.046214  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.020360 11384 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:24.021633 11392 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.024842 11464 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.034102 11262 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:24.044677 11425 consensus_meta.cc:287] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.294s	user 0.013s	sys 0.000s
I20260709 13:16:24.025148 11388 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.040516 11479 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.265636 11493 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.825s
I20260709 13:16:24.042421 11423 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.066004 11424 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.026504 11481 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.025437 11355 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.058598  8768 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:24.101470  8836 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:24.101980  8840 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.124595  8768 pending_rounds.cc:85] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 3
I20260709 13:16:24.125036  8768 pending_rounds.cc:107] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:24.102411 11503 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:24.125250  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:24.126495  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.127313  8836 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:24.102614 11262 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:23.598650 11405 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.103598 11484 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:24.103255 11384 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.103344 11425 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.104498  8837 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:24.101049 11400 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:24.105176 10751 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.106022 11435 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.106660  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:24.108995  8835 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
W20260709 13:16:24.042085 11375 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.019s
I20260709 13:16:24.025298 11172 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:24.144316 11375 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.000s	sys 0.019s
W20260709 13:16:24.111027  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.057936 11413 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.077877 11478 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.113914 11353 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.150275 11504 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.150267 11353 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.150977 11504 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.056326 11410 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.109692 11428 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.115413 11466 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:24.116609 11367 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.921s	user 0.006s	sys 0.004s
W20260709 13:16:24.075018 11451 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.192s	user 0.008s	sys 0.003s
I20260709 13:16:24.118441 11241 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:24.042212  9432 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.016s	sys 0.007s
W20260709 13:16:24.160177  9432 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.016s	sys 0.007s
I20260709 13:16:24.050824 11500 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:24.125295  8768 raft_consensus.cc:2889] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:24.163935  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1333) took 1405 ms. Trace:
I20260709 13:16:24.164376  8768 rpcz_store.cc:276] 0709 13:16:22.758105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.078874 (+320769us) service_pool.cc:224] Handling call
0709 13:16:23.141720 (+ 62846us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.163672 (+1021952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.163880 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:24.128571  8836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:24.165417  8836 raft_consensus.cc:606] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:24.103226 11364 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.076660 11467 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.078058 11492 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.142207 11400 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.143746 10751 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.148938 11470 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.179318  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:24.157526  8841 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.053297 11482 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.186646 11452 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:24.161247  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:24.150265 11384 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.169463  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.191669 11364 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.149509 11413 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:24.133805 11503 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.192085 11364 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:24.192503 11364 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.192409 11413 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.193940 11503 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:24.194619 11413 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.195282  9468 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.195798  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:24.197777 11384 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:24.198269 11384 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.198657 11470 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.202112  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1477) took 1780 ms. Trace:
I20260709 13:16:24.202680  8840 rpcz_store.cc:276] 0709 13:16:22.422185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.455507 (+ 33322us) service_pool.cc:224] Handling call
0709 13:16:22.455797 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.124766 (+1668969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.201798 (+ 77032us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54003e67d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:24.202041 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3785484672}
I20260709 13:16:24.157728 11428 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.159544 11367 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.152904 11353 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.131340 11424 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.181455  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.187180 11482 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.187474  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1336) took 2853 ms. Trace:
W20260709 13:16:24.205296  9465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 289) took 2499 ms (client timeout 3252 ms). Trace:
W20260709 13:16:24.212245  9465 rpcz_store.cc:269] 0709 13:16:21.706225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.706392 (+   167us) service_pool.cc:224] Handling call
0709 13:16:24.204918 (+2498526us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540057dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.205237 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3482542976}
I20260709 13:16:24.205847  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1330) took 1459 ms. Trace:
I20260709 13:16:24.213709  8761 rpcz_store.cc:276] 0709 13:16:22.746338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.746848 (+   510us) service_pool.cc:224] Handling call
0709 13:16:24.205699 (+1458851us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400198054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.205791 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":916581760}
I20260709 13:16:24.166672 11499 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.166975  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:24.264254  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 97331.8us
W20260709 13:16:24.264878  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 254111us
I20260709 13:16:24.265358  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.168439 11504 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.210983  8910 rpcz_store.cc:276] 0709 13:16:21.334363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.334486 (+   123us) service_pool.cc:224] Handling call
0709 13:16:21.334754 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.140596 (+1805842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.187227 (+1046631us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540036fbd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:24.187411 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3638785920}
I20260709 13:16:24.166450 11500 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:24.204790  9468 raft_consensus.cc:2410] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 13:16:24.235472  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.207140  8838 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.208482 11367 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.280944  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.281790  8835 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
W20260709 13:16:24.269974  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 1.03272e+06us
W20260709 13:16:24.272956  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 76280.5us
I20260709 13:16:24.198635 11384 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.279613  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.261597  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.283841  8735 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.266438 11241 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.291397 11389 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:24.291834 11389 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:24.292594 11389 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.293918 11389 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.296954 11384 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.302457  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1342) took 1120 ms. Trace:
I20260709 13:16:24.302901  8915 rpcz_store.cc:276] 0709 13:16:23.181721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.182064 (+   343us) service_pool.cc:224] Handling call
0709 13:16:24.302239 (+1120175us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400258d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.302384 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72198400}
I20260709 13:16:24.305145 11452 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:24.305546  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1563) took 1567 ms. Trace:
I20260709 13:16:24.306064 11452 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:24.305882  8837 rpcz_store.cc:276] 0709 13:16:22.738227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.738370 (+   143us) service_pool.cc:224] Handling call
0709 13:16:22.738646 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.136320 (+1397674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.305318 (+168998us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54004114d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:24.305487 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3140755840}
I20260709 13:16:24.306769 11452 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:24.307847 11452 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.309260 11452 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.309846 11492 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.310392 11400 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.314328 11508 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.158437 11484 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.318286  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1611) took 1646 ms. Trace:
I20260709 13:16:24.318826  8917 rpcz_store.cc:276] 0709 13:16:22.671502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.221693 (+550191us) service_pool.cc:224] Handling call
0709 13:16:23.231927 (+ 10234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:23.232503 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.317867 (+1085364us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b54000389d0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.318205 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22849792}
I20260709 13:16:24.306773 11384 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:24.321512 11443 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.321781  8918 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:24.322079 11367 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:24.322407  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1605) took 1652 ms. Trace:
I20260709 13:16:24.322623 11367 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.322830  8918 rpcz_store.cc:276] 0709 13:16:22.669612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.185351 (+515739us) service_pool.cc:224] Handling call
0709 13:16:23.185745 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.321642 (+1135897us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54001737a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd11dc0 00007fce6fd9c1c0 00007fce6fd9d231 00007fce6fd99d8f 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c
0709 13:16:24.322157 (+   515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.322346 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1959951616}
I20260709 13:16:24.325549 11367 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:24.327759 11486 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.507s	user 0.008s	sys 0.008s
W20260709 13:16:24.328795  8912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1591) took 1810 ms (client timeout 1511 ms). Trace:
W20260709 13:16:24.329279  8912 rpcz_store.cc:269] 0709 13:16:22.518764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.519468 (+   704us) service_pool.cc:224] Handling call
0709 13:16:24.328454 (+1808986us) spinlock_profiling.cc:243] Waited 523 ms on lock 0x7b540026c354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.328716 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1203807616}
I20260709 13:16:24.329901  8807 leader_election.cc:400] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4.
I20260709 13:16:24.330476  8807 leader_election.cc:403] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:16:24.331373 11353 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:24.262068 11478 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:24.210187 11428 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:24.209275  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.281077 11500 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.288573 11410 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.271230 11450 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:24.316820  8844 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1459) took 3098 ms (client timeout 1541 ms). Trace:
I20260709 13:16:24.285089  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:24.384980  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55252.9us
W20260709 13:16:24.285648  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.271865 11425 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.270360 11168 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:24.286080 11402 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 1.104s	user 0.000s	sys 0.013s
W20260709 13:16:24.382397  8844 rpcz_store.cc:269] 0709 13:16:21.218263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.220335 (+  2072us) service_pool.cc:224] Handling call
0709 13:16:24.316473 (+3096138us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540039dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.316622 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3726654336}
W20260709 13:16:24.392069  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.388046  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.282912 11504 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:24.393766  8732 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.622s (SENT)
I20260709 13:16:24.327843  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.396648  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.328841 11482 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:24.333158 11449 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.402041  9463 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:24.397596  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 113804us
I20260709 13:16:24.410333  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:24.408070  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.359205 11424 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.412374 11507 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.413618  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:24.417357 11425 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:24.417851 11492 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.417963 11425 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.420626 11425 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.416706 11437 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:24.420993 11492 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:24.421342 11437 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.422735  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.424187 11479 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:24.424824 11437 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.425092 11479 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:24.382189 11450 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.381688 11367 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4.
I20260709 13:16:24.357990 11422 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:24.394701 11388 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.268330 11499 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.434083 11450 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:24.414358 11424 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.428719 11507 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:24.353367 11478 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.451102 11507 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.453279 11478 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.427752 11503 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.457216 11503 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.460958 11355 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.462808  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1480) took 2013 ms. Trace:
I20260709 13:16:24.463321  8838 rpcz_store.cc:276] 0709 13:16:22.449037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.466786 (+ 17749us) service_pool.cc:224] Handling call
0709 13:16:22.467178 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.277697 (+1810519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.462563 (+184866us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b540042b3d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:24.462743 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4001177856}
I20260709 13:16:24.466492 11499 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.429719 11482 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.473112 11362 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:24.479810  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 194790us
I20260709 13:16:24.482286  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:24.456713  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1596) took 1789 ms. Trace:
I20260709 13:16:24.475376  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:24.428097 11168 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:24.495937  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.449400  9461 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:24.488015  8914 rpcz_store.cc:276] 0709 13:16:22.667285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.873766 (+206481us) service_pool.cc:224] Handling call
0709 13:16:22.874125 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:22.874350 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:24.015466 (+1141116us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.374423 (+358957us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.456162 (+ 81739us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b18003d4c20. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:24.456342 (+   180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.456393 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.456454 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.456525 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.456652 (+   127us) inbound_call.cc:177] Queueing success response
0709 13:16:24.458909 (+  2257us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b18003d4c20. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
Metrics: {"mutex_wait_us":88498,"prepare.queue_time_us":1184458,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":80,"raft.queue_time_us":94530,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":6761,"spinlock_wait_cycles":36514048,"thread_start_us":1495001,"threads_started":2,"wal-append.queue_time_us":411013}
I20260709 13:16:24.435662 11470 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.405625 11504 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.531790  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:24.534514  8844 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:24.535621  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.536402  8835 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:24.537647  8843 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.535511  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.539350  8837 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:24.514773  8767 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.515686 11507 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.519433 11481 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:24.523541  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.541558  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.524837  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1609) took 1853 ms. Trace:
I20260709 13:16:24.542333  8911 rpcz_store.cc:276] 0709 13:16:22.670919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.209432 (+538513us) service_pool.cc:224] Handling call
0709 13:16:24.307376 (+1097944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.307641 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.307670 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.307715 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:24.307757 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.307815 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.524634 (+216819us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400258d50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.524773 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2524227328}
I20260709 13:16:24.540799  8767 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.495339 11500 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:24.512090 11471 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:24.497926 11428 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.504099 11367 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:24.564477  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.567690 11424 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:24.570173 11364 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.575313 11503 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:24.535712 11513 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:16:24.550271  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.591897  8836 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:24.550681 10947 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.546326 11482 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.552894 11507 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.541785 11429 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.594152  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1329) took 1848 ms. Trace:
I20260709 13:16:24.594628  8767 rpcz_store.cc:276] 0709 13:16:22.745913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.746060 (+   147us) service_pool.cc:224] Handling call
0709 13:16:22.746381 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.514372 (+1767991us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4c00165700. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e066a20 00007fce6e077a29 00007fce6e03d644 00007fce6e064f2d 00007fce6e064b93 00007fce6fd9518b 00007fce6fd95cb5 00007fce6fd90f30 00007fce6fd927de 00007fce6fd9cb49 00007fce6fd9d416
0709 13:16:24.593511 (+ 79139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.593540 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:24.593714 (+   174us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:24.593759 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.593834 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:24.593963 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":465,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"spinlock_wait_cycles":7935232}
I20260709 13:16:24.591392 11364 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.557425  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1337) took 3222 ms. Trace:
I20260709 13:16:24.597677  8840 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:24.545732 11405 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.556653 11172 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:24.599363  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.597549  8916 rpcz_store.cc:276] 0709 13:16:21.334647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.334984 (+   337us) service_pool.cc:224] Handling call
0709 13:16:21.345455 (+ 10471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.043683 (+2698228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.557174 (+513491us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b54002abcd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:24.557359 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6190344064}
W20260709 13:16:24.548667  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 56791.5us
I20260709 13:16:24.614188  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:24.562599  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.628373  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.566442 11367 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.576270 11413 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.625859 11479 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:16:24.579821  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:24.563766  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 158100us
I20260709 13:16:24.545699 11470 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:16:24.648387  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.757184  8837 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:24.697666  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:24.699887  8843 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.789489  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.790357  8767 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:24.792559  8762 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.792717  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1469) took 2384 ms. Trace:
W20260709 13:16:24.792724  8766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1311) took 2720 ms (client timeout 1866 ms). Trace:
W20260709 13:16:24.795301  8766 rpcz_store.cc:269] 0709 13:16:22.071825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.071942 (+   117us) service_pool.cc:224] Handling call
0709 13:16:24.792507 (+2720565us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b5400199454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:24.792653 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2060784384}
I20260709 13:16:24.795204  8841 rpcz_store.cc:276] 0709 13:16:22.408703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:22.410052 (+  1349us) service_pool.cc:224] Handling call
0709 13:16:22.410328 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:24.180052 (+1769724us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.792487 (+612435us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002805d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:24.792655 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4017710976}
I20260709 13:16:24.798025  8837 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:24.767836  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 153769us
W20260709 13:16:24.670383  9431 leader_election.cc:336] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.948s (SENT)
I20260709 13:16:24.802001  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.802948  9467 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:24.804160  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 381505us
I20260709 13:16:24.630365  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:24.641182 11367 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:24.806701  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.809163  8761 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:24.806968  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:24.725564 11513 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:24.809731  8769 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:24.812568  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.817919  8765 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:24.727326 11413 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:24.807533  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.831409  8764 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:24.832460 10751 consensus_meta.cc:287] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.652s	user 0.005s	sys 0.001s
I20260709 13:16:24.627460 11405 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.793167 11168 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.859107  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52812.3us
I20260709 13:16:24.860982  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:24.811769  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.815322  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:24.862766  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:24.869782  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54547.2us
I20260709 13:16:24.841346  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.873241  8840 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:16:24.845750  8732 connection.cc:256] RPC call timeout handler was delayed by -1.5054251429999113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28350000000000003s for a response
W20260709 13:16:24.875573  8732 connection.cc:256] RPC call timeout handler was delayed by -1.3537684030000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260709 13:16:24.875962  8732 connection.cc:256] RPC call timeout handler was delayed by -1.1283251429999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3254s for a response
I20260709 13:16:24.839349  9461 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:24.844192  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.857371  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.885776  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:24.782433 11471 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:16:24.800719  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 130410us
I20260709 13:16:24.639403 11505 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:24.863278  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 232069us
I20260709 13:16:24.891462  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.893487  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.894258  8911 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:24.894863  8917 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:24.895180  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:24.802173 11507 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:24.877941  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.878684  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:24.880081  8768 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:24.880573  8766 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:24.881733  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.882963  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.889400  8767 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:24.906358  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.907624  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.908210  8913 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:24.889873  8761 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.895578  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.896330  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.910099  8918 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:24.896850  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:24.897640  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.864056  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:24.911661  8839 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:24.899003  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:24.899360  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:24.900279  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.109s (SENT)
I20260709 13:16:24.913060  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.913224  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.913383  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.913735  8911 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
W20260709 13:16:24.901023  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90521.3us
I20260709 13:16:24.914671  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.914752  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:24.915714  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.916668  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:24.880573  9463 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:24.917435  8913 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:24.919836  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:24.883630 11410 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.890578  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:24.918358  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:24.925256  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.926433  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:24.926964  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.920745  8909 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:24.926978  8911 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:24.890123 11508 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:24.883826 11443 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:16:24.885375 11494 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:24.924265  8918 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:24.935855  8912 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:16:24.940989 11484 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:24.869146 11479 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:16:24.938692  8916 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.938879  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:24.945031  8914 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:24.949564  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.870815 11168 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.902616 11449 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.921693 11413 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:24.918292 11477 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.922647 11410 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:24.975898  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 219698us
I20260709 13:16:24.980614  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.939327 11394 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.978904  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:24.982339  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:24.985001  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:24.986325 11410 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.988782  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.990919  8765 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.991140 11509 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.991719 11394 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:24.992141 11394 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.989295  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:24.949441 11377 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.989620  8766 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.990237  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.941561 11484 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:25.002758  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:25.013962  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:25.026353  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:24.935612 11469 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:24.989913  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:25.057350  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62320.4us
I20260709 13:16:25.058205  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:24.947417 11478 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.026877  8765 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
W20260709 13:16:25.059368  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 56730.1us
I20260709 13:16:25.060729  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:24.977433 11500 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:24.921901 11507 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:24.935804 11355 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:16:25.023424 11411 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:25.028560 11505 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.057505  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.061558  8765 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:25.065858  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:25.080997  8768 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:25.074945  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61143.9us
I20260709 13:16:25.075852  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.081804  8762 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.978336 11449 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.060973  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:24.995029 11450 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.063522 11443 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.109836  8761 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.113319 11389 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:25.114295 11537 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.114987 11537 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.108594 11172 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:25.117604 11172 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:25.118815 11172 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.120957 11424 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:25.122148 11424 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:25.122535 11424 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:25.123589 11424 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.076745 11353 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:25.125012 11434 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.108798 11500 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.131002 11500 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.133708 11405 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:25.133677 11500 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.088892 11477 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.064502 11478 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.072820 11473 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.138574  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.145010  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.148586  8765 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:25.150693  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.152593  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.156391  8760 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:25.107751  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:25.159776  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.154521  8762 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
W20260709 13:16:25.018296  8732 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.664s (SENT)
W20260709 13:16:25.163938  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 145671us
I20260709 13:16:25.155129  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:25.168936  8768 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:25.170338  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.174769  8768 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:25.183678  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.183844  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.193117  8760 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:25.193338  8762 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:25.194031  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.194743  8760 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:25.184909  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.233325  8764 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:25.190057  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 82392.2us
I20260709 13:16:25.192006  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.236243  8765 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:25.087922 11479 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.073282 11384 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 13:16:25.186573  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:25.304119  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.236002  8761 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:25.239225  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:25.310282  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71156.2us
I20260709 13:16:25.311450  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:25.244215 11525 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:16:25.244081 11434 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:25.328145 11434 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:25.245592 11353 raft_consensus.cc:993] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:16:25.329838 11353 raft_consensus.cc:1081] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:16:25.332083  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.333297  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.334223 11318 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.334573  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.341208 11470 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.341980 11470 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:25.343276 11470 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.345203 11318 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.345749 11318 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:25.346203 11318 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.245393 11450 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:25.106711 11464 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 13:16:25.249434 11503 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:25.349285 11503 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:25.350258 11503 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.352053 11503 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.251482 11449 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:25.255290 11532 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:16:25.255955 11507 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.258515 11504 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.183157 11509 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.353560 11509 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.263140  9461 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:25.263551  9463 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:25.265095 11537 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:25.266315  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 286574us
I20260709 13:16:25.292388  8762 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:25.358438 11509 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.265272 11484 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.235742 11411 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:25.310439  9431 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.131s (SENT)
W20260709 13:16:25.362099  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 51710.2us
W20260709 13:16:25.363006  9431 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.155s (SENT)
I20260709 13:16:25.363519  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:25.164098 11473 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.365084 11473 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.308840  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:25.366004  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57257.7us
I20260709 13:16:25.366638  9432 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.369109 11400 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:25.370213 11400 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.370579 11400 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.370937 11400 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.357410 11318 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.345183 11499 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.375267  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:25.374398 11499 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.376369 11499 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.360441 11411 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.378876 11484 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:25.375248 11318 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.373133 11477 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.235565 11467 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:25.402278  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 43707.3us
I20260709 13:16:25.293038 11536 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.407783 11509 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:25.407931 11536 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.410315 11362 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:25.410853 11362 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:25.411339 11449 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:25.411795 11362 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.414484  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.433821  8766 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:25.382220 11477 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.325538 11377 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.325739 11478 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.272432 11500 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.179s
I20260709 13:16:25.385962 11413 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.386420 10947 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:25.463141  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 378253us
I20260709 13:16:25.465413  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:25.293835 11479 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:25.463447 11525 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:16:25.478838  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:25.481568 11452 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.455466 11477 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.469723 11172 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:25.470299 11362 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.484635 11452 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.470382 11505 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.485774 11479 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.487361  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:25.514160  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.442169 11422 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:16:25.517071  8914 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:16:25.514878  8910 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:25.521486  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:25.521677 11429 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.004s
I20260709 13:16:25.525767  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.526366 11429 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.469874 11377 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.515686 11449 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.527755 11449 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:25.528025 11423 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.402s	user 0.009s	sys 0.001s
I20260709 13:16:25.528210 11449 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.529213 11377 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.530440  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:25.523804 11394 consensus_meta.cc:287] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.531s	user 0.002s	sys 0.009s
I20260709 13:16:25.531224 11394 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.474208 11413 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:25.534812 11410 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.548s	user 0.004s	sys 0.005s
I20260709 13:16:25.535332 11394 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.535257 11410 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.539091  9468 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.488200 11544 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:16:25.540277 11410 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.553678  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.554867  8910 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:25.535245  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:25.558691  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.559327  8910 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:25.561218 11509 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:25.561784 11509 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:25.562852 11509 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.564265 11509 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.508538 11452 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.565112  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.485780 11536 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.566571  8910 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
W20260709 13:16:25.569427 11367 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.730s	user 0.005s	sys 0.006s
I20260709 13:16:25.570199 11367 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.571269  8841 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:25.508841 11168 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.574720  8910 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:25.577761 11494 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:16:25.580451  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:25.591197  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.593897  8766 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:25.372061  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:25.611914  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 243268us
I20260709 13:16:25.612906  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.623267  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:25.629452  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.633603  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:25.635609  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.636433  8916 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:25.629135 11500 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.658762  9461 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:25.655967 11394 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.661909  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:25.662298 11394 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.662927  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.663686 11384 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.656141 11500 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:25.664402 11377 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.668887  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.669759  8762 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:25.671717  8732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.465s (SENT) [suppressed 32 similar messages]
I20260709 13:16:25.674129  8762 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:25.676628  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.677934  8766 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:25.684689  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71902.8us
I20260709 13:16:25.686698 11377 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.631534 11449 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.664685 11500 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.664677 11394 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:25.664229 11384 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:25.652366 11494 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:25.722252  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 243521us
I20260709 13:16:25.689088 10947 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.746472  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:25.743870  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:25.754503  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.755503  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.756330  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.757175  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.696822 11539 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.758736  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.760546 11394 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.763091 11394 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.766040 11377 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.767216  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:25.751261 11423 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.768440  9461 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:25.769407 11423 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.770208 11482 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.770632 11482 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:25.771035 11482 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.771512 11423 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.761451 11434 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.773797 11434 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.774385 11434 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.761487 11318 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.771106  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:25.775998 11318 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:25.776470 11318 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.776691 11422 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.777158 11422 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.777493 11422 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.780838 11364 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:25.760663 11484 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:25.781482 11364 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.781921 11364 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:25.783834 11449 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:25.687336 11400 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.781811 11484 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:25.759465 11467 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.786291 11484 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.788789 11367 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.791639  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.753273 11410 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:25.792366  8767 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.725353 11388 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:16:25.702194 11499 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.799346  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:25.814762 11377 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:25.801379  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:25.816536 11389 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:25.817456  9461 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:25.818195 11552 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.818800 11552 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:25.819993 11552 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.822409 11552 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.824851 11389 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:25.829597 11548 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.360s	user 0.001s	sys 0.004s
I20260709 13:16:25.829231 11539 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.833599 11355 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:25.837431  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.844401  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.845844  8761 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:25.848642  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.851193  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.851528  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.852312  8766 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:25.852485  8762 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:25.859885  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.860904  8766 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:25.862509  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.863157  8768 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:25.863543  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.864138  8764 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.863926 11422 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.864035 11452 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.865309 11400 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:25.866082 11503 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.514s	user 0.014s	sys 0.003s
I20260709 13:16:25.866350 11452 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:25.867878  8910 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:25.863186  8765 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:25.869894  8762 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:16:25.870970  8762 pending_rounds.cc:85] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 7
I20260709 13:16:25.871726  8762 pending_rounds.cc:107] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:16:25.876767  8762 raft_consensus.cc:2889] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:25.868773  9461 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:25.876168  8764 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:25.893874  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:25.895572  8764 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:25.895673  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.896545  8762 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:25.896632  8760 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.897248  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.903019  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.903878  8761 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:16:25.904062  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64118.8us
I20260709 13:16:25.834290 11355 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:25.913335  8767 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:25.915334 11394 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:25.919463 11504 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.957445 11504 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:25.957590 11499 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:25.958482 11504 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.921248  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 235) took 1078 ms. Trace:
I20260709 13:16:25.959949  8841 rpcz_store.cc:276] 0709 13:16:24.842977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.843897 (+   920us) service_pool.cc:224] Handling call
0709 13:16:25.920898 (+1077001us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540021cd54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:25.921173 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580574592}
I20260709 13:16:25.961268  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.962738  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:25.922225 11546 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.389s	user 0.005s	sys 0.004s
I20260709 13:16:25.897217 11377 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:25.982407  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1356) took 1047 ms. Trace:
I20260709 13:16:25.982527 11377 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:25.983767 11422 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:25.982838  8769 rpcz_store.cc:276] 0709 13:16:24.934867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.935945 (+  1078us) service_pool.cc:224] Handling call
0709 13:16:24.949876 (+ 13931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.079186 (+129310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.079217 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.195148 (+115931us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.326315 (+131167us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:25.326374 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.326472 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.921254 (+594782us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:25.965395 (+ 44141us) raft_consensus.cc:1685] finished
0709 13:16:25.965416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.982321 (+ 16905us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6908,"raft.queue_time_us":110853,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5472,"spinlock_wait_cycles":14814464,"thread_start_us":252737,"threads_started":2,"wal-append.queue_time_us":319549}
I20260709 13:16:25.988588 11477 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.991559  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:25.992199  9461 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.992375  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.904232 11367 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:25.993005  8769 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.993212 11367 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:25.994216 11367 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.995656  8762 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:25.996652  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.997251  8762 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:25.998008  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.999009  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:25.999526  8762 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.000218  8769 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:25.925684 11384 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:25.926785  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:25.927443  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.928084  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.929059  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.929190  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.929515  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:25.931982  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.937209  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:25.941047  8910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:25.941746  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:25.942984  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:25.904407 11398 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.923946 11541 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.938892 11543 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.422s	user 0.007s	sys 0.004s
I20260709 13:16:26.001196  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:26.001416  8769 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.036646  8764 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 6 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:26.037148  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 100037us
I20260709 13:16:26.038293  8916 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.041118  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.035694  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:26.044847  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.035866  8761 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:26.038084  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:26.052270  8909 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:26.052136  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.053144  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.053210  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.053862  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.054675  8911 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:26.054827  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.056609  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:26.057353  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 115695us
I20260709 13:16:26.057745  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.058512  8910 raft_consensus.cc:606] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:26.057529  8767 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:26.058917  8910 raft_consensus.cc:614] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:26.060519  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.060947  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:26.037799 11473 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.006s
I20260709 13:16:26.062335  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:26.054876  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.063365  8917 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:26.063807  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.064765  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:26.066778  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 308090us
I20260709 13:16:26.066710  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.067672  8911 raft_consensus.cc:2376] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7. Re-sending same reply.
I20260709 13:16:26.069366  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.070470  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.071419  8911 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:26.069823  8909 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:26.074862  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.075683  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:26.076462  8761 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:26.076313  8841 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:26.080091  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.080471  9461 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:26.081921  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:26.082926  8761 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:26.084408  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.085688  8837 raft_consensus.cc:2410] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:16:26.086156  8761 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:26.070860  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.035262 11377 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:26.099141  8916 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:26.088008  8917 raft_consensus.cc:2376] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8. Re-sending same reply.
I20260709 13:16:26.093461  8764 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.100206  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.096920  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.097481  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.101465  8839 raft_consensus.cc:1813] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Handling vote request from an unknown peer bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:26.101522  8911 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:26.102149  8839 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:26.101886  8762 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:26.102455  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.103066  8911 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:26.052090 11423 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.103909  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.077978 10947 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:26.109007  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:26.115818  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.103287 11377 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.119758  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:26.078824 11470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.006s	sys 0.004s
I20260709 13:16:26.118311  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.126840  8909 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:26.126904  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:26.128521  8843 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.128547  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.129491  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1359) took 1223 ms. Trace:
I20260709 13:16:26.023782 11482 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.130025  8844 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:26.129971  8915 rpcz_store.cc:276] 0709 13:16:24.906114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.918525 (+ 12411us) service_pool.cc:224] Handling call
0709 13:16:24.918832 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.938217 (+ 19385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.938246 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.938713 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.294560 (+355847us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:25.294602 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.294671 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.922123 (+627452us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:26.105604 (+183481us) raft_consensus.cc:1685] finished
0709 13:16:26.105625 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.129414 (+ 23789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18990,"raft.queue_time_us":19911,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8713,"spinlock_wait_cycles":47995136,"thread_start_us":322028,"threads_started":1,"wal-append.queue_time_us":527866}
I20260709 13:16:26.092643 11172 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:26.129158 11470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.007s	sys 0.005s
I20260709 13:16:26.051592 11541 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.103763 11539 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.100284  8765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:16:26.193270  8765 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.193841  8765 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.103699 11505 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:26.072700 11410 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:25.984714 11355 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:26.198971 11355 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:26.168109  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:26.202203  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:26.203042  8764 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:26.068694 11429 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:16:26.056093 11398 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.207881 11398 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:26.098663 11467 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:16:26.092934 11473 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:26.229513  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 330886us
I20260709 13:16:26.164361 11377 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:26.164969 11172 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.171156 11425 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.124030 11423 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:26.252545 11477 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:26.265856 11509 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.695s	user 0.014s	sys 0.000s
I20260709 13:16:26.286142 11413 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.286540 11482 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.259882 11172 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:26.289255 11545 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.766s	user 0.002s	sys 0.000s
I20260709 13:16:26.290511 11423 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:26.292117  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.296180  8916 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:26.166965 11558 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:26.262044  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.297339  8838 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:26.297739  8839 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.298266  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.298544  8914 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:26.299368  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.263844  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.267467  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:26.261245  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:26.270099  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.229360 11556 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:26.304679  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.280992 11377 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:26.282311 11541 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:26.282727 11473 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:26.286341  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.254875 11428 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.301955  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.302950  8918 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:26.300247  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:26.337330  9468 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:26.268096  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:26.338261  8764 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.312672  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.338956  8842 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:26.316309  8732 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.524s (SENT)
I20260709 13:16:26.317902 11556 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:26.317726 11377 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:26.344204 11428 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:26.345784  8840 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:26.345283 11428 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.346436 11428 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.346691  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:26.292821 11434 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.007s
W20260709 13:16:26.295020 11318 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.518s	user 0.005s	sys 0.005s
I20260709 13:16:26.295673 11424 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:26.323896 11172 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.324740 11499 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:26.325546 11558 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:26.326460  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:26.362829 11558 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:26.363466 11558 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:26.269501 11425 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.365403 11556 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:26.326994 11470 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:26.367254 11470 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:26.367712 11470 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:26.368795 11470 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.370214 11470 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:26.370705 11364 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.000s
I20260709 13:16:26.371155 11364 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.306017  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.342811  8839 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:26.305384 11555 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.334962 11413 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:26.366202 11425 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.375120  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:26.391695  9468 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:26.349344  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:26.393404  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:26.380524  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:26.385968  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.395068  8838 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:26.396196  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.396962  8838 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:26.389317 11555 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.399114  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.248324  8765 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.405334  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.401492  8807 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:26.336714 10947 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.406675  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:26.418849  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 337002us
I20260709 13:16:26.421216  8838 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:26.426265  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.434624  8842 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:26.435299  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:26.436246  8838 raft_consensus.cc:2368] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:26.437017 11172 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:26.437278  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.422884 11559 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:26.439388  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.427656  8764 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:26.407354 11558 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:26.431165  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.433300  8732 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.637s (SENT)
I20260709 13:16:26.423096 11353 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:16:26.407774 11499 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.440788  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.515589  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:26.544813  8838 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 4: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:26.545094  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 111841us
I20260709 13:16:26.407397 11425 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:26.516584  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:26.517344  8766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.028s	sys 0.042s
W20260709 13:16:26.549350  8766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.029s	sys 0.042s
I20260709 13:16:26.549086  8764 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:26.549942  8914 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:26.450246  8735 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.524s (SENT)
W20260709 13:16:26.518534  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.550511  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:26.521136  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.551873  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.436583 11555 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.522089  8918 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:26.354182 11318 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.523981  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.524488  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:26.562477  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.354269 11434 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.530930  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:26.520284  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.572717  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.573376  8912 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:26.574186  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.574736  8912 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.552496  8915 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:26.576417  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.576997  8915 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:26.577720  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:26.521571  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:26.553572  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 103364us
W20260709 13:16:26.580168  8735 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.664s (SENT)
I20260709 13:16:26.580585  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:26.583069  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:26.554280  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.549048  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.585318  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.585872  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:26.552199  8765 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:26.446329 11500 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.687s	user 0.011s	sys 0.001s
I20260709 13:16:26.558518  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:26.600471  8915 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.601375  8918 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:26.601756  8918 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:26.601851  8884 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:26.602754  8769 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.043s	sys 0.047s
I20260709 13:16:26.593986  9432 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:26.604223  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:26.602487  8918 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.605626  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:26.606020  8918 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.606164  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:26.550709 11499 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:26.600003  8910 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
W20260709 13:16:26.442800 11524 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.280s	user 0.026s	sys 0.057s
W20260709 13:16:26.606828  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.606849  8764 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:26.560788 11362 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:26.553512 11484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.021s	sys 0.014s
I20260709 13:16:26.607852  8765 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:26.608403  8769 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.043s	sys 0.047s
W20260709 13:16:26.611828  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.605865  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:26.551306 11425 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:26.645671 11481 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:26.656325 11425 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:26.551658 11219 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:26.422641 11482 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 13:16:26.423422 11423 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.158s
I20260709 13:16:26.631633  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.665895  8839 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:26.635838  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:26.666741  8843 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:26.636760  8841 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:26.599695  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:26.563621 11364 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.649101  8909 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:26.651106  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.584975 11539 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.655758  8912 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:26.552743 11355 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.607553 11473 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:26.657167  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55385.3us
W20260709 13:16:26.678244  8837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.010s
W20260709 13:16:26.678718  8837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.010s	sys 0.010s
I20260709 13:16:26.565061 11541 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:16:26.647593 11557 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:26.647002 11477 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:26.659636  8768 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:26.605683 11389 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:26.669683  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.002s	sys 0.009s
I20260709 13:16:26.644773 11499 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.646507 11410 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:26.651626 11484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.021s	sys 0.015s
I20260709 13:16:26.609092 11500 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:26.685405  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.002s	sys 0.009s
I20260709 13:16:26.651863 11494 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:26.675879 11411 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.014s	sys 0.008s
I20260709 13:16:26.673744 11398 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:26.765375  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.680967 11388 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.677976 11473 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.687417 11477 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:26.778757  8840 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:26.659452 11481 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:26.766366 11411 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.015s	sys 0.008s
I20260709 13:16:26.723456 11557 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:26.818665  8761 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.011s	sys 0.017s
W20260709 13:16:26.856688  8761 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.011s	sys 0.017s
I20260709 13:16:26.766319 11355 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.686673 11539 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:26.678179 11219 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:26.798032 11473 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:26.915951  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.795540 11477 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:26.796271 11384 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.001s	sys 0.011s
I20260709 13:16:26.855365 11541 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.900779 11557 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:27.031502 11573 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:16:27.033533  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 971216us
W20260709 13:16:27.033995  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.034901  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 355590us
I20260709 13:16:27.036026  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:27.063748  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.050393 11541 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.072211 11541 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:26.988341 11384 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.002s	sys 0.012s
I20260709 13:16:26.901417 11318 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.031889 11481 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:27.145853 11566 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.377s	user 0.000s	sys 0.000s
W20260709 13:16:27.147426 11563 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:16:27.095383 11405 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:27.173892 11424 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.819s	user 0.009s	sys 0.001s
I20260709 13:16:27.166348 11219 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:27.169685 11434 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:26.976290 11355 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.178160 11355 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.178364 11539 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:27.174787 11428 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.002s
I20260709 13:16:27.179426 11500 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.180042 11559 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.180540 11559 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.182251 11405 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.182772 11405 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.183698 11425 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.151890 11410 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:27.212543 11558 consensus_meta.cc:287] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.659s	user 0.012s	sys 0.000s
I20260709 13:16:27.233309 11558 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:27.240954 11473 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:27.243155 11499 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 13:16:27.192230 11477 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.245107 11499 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.431994  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1377) took 1358 ms. Trace:
W20260709 13:16:27.326139  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.327978  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1359) took 1334 ms. Trace:
W20260709 13:16:27.327688  8764 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.686s	user 0.025s	sys 0.006s
W20260709 13:16:27.330617  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 724561us
I20260709 13:16:27.338975  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:27.339313  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1509) took 1252 ms. Trace:
W20260709 13:16:27.345993  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 311436us
W20260709 13:16:27.346378  8732 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.918s (SENT)
W20260709 13:16:27.351073  8765 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.005s	sys 0.005s
W20260709 13:16:27.353890  8915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.007s
I20260709 13:16:27.354672  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:27.356364  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1371) took 1354 ms. Trace:
I20260709 13:16:27.365901  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:27.237313 11470 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.867s	user 0.006s	sys 0.009s
I20260709 13:16:27.380311 11384 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.381280  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.441042 11384 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.372808 11473 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:27.377163 10947 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.009s	sys 0.005s
I20260709 13:16:27.427448 11410 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.431846 11477 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.337901  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1511) took 1240 ms. Trace:
I20260709 13:16:27.380749 11425 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:27.449723  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:27.451509  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:27.377954  8917 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
W20260709 13:16:27.443967  8765 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.005s	sys 0.006s
W20260709 13:16:27.443965  8915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.007s	sys 0.007s
I20260709 13:16:27.382910 11467 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:16:27.447024  8835 rpcz_store.cc:276] 0709 13:16:26.097691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.118514 (+ 20823us) service_pool.cc:224] Handling call
0709 13:16:26.118836 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.127449 (+  8613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.127493 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.152473 (+ 24980us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.633576 (+481103us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:26.633616 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.633689 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.337169 (+703480us) raft_consensus.cc:1685] finished
0709 13:16:27.337216 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.337591 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13106,"raft.queue_time_us":52205,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":43420,"thread_start_us":399079,"threads_started":1,"wal-append.queue_time_us":977664}
I20260709 13:16:27.458557  8918 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:27.459960  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.460537  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:27.460916  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:27.461568  8844 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.462661  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:27.463541  8838 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.463927  8838 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:27.465799  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:27.467065 11422 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.467465  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:27.468997 11355 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.469282 11539 raft_consensus.cc:2764] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:27.469621 11355 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.467671 11422 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:27.470217  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1575) took 1203 ms. Trace:
I20260709 13:16:27.470589 11422 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.470829  8842 rpcz_store.cc:276] 0709 13:16:26.266200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.348976 (+ 82776us) service_pool.cc:224] Handling call
0709 13:16:27.469687 (+1120711us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b54002b0554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:27.469991 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93150592}
I20260709 13:16:27.471796 11473 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:16:27.446959 10947 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.010s	sys 0.006s
I20260709 13:16:27.474221  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1571) took 1209 ms. Trace:
I20260709 13:16:27.381518 11434 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:16:27.474745  8840 rpcz_store.cc:276] 0709 13:16:26.264976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.346420 (+ 81444us) service_pool.cc:224] Handling call
0709 13:16:27.473660 (+1127240us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b5400241b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:27.474018 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991451520}
I20260709 13:16:27.460021  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:27.477756  8843 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.013s
I20260709 13:16:27.478294  8843 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:27.478981  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1516) took 1217 ms. Trace:
I20260709 13:16:27.479146  8918 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:27.479367  8843 rpcz_store.cc:276] 0709 13:16:26.261315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.635340 (+374025us) service_pool.cc:224] Handling call
0709 13:16:27.478857 (+843517us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.470124 11355 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.435696  8837 rpcz_store.cc:276] 0709 13:16:26.086957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.088958 (+  2001us) service_pool.cc:224] Handling call
0709 13:16:26.089378 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.089819 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.089861 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.100011 (+ 10150us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.034566 (+934555us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.034610 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.034698 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.338676 (+303978us) raft_consensus.cc:1685] finished
0709 13:16:27.338744 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.339096 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4456,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":5601,"thread_start_us":521761,"threads_started":1,"wal-append.queue_time_us":1024009}
I20260709 13:16:27.482517  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:27.432592  8767 rpcz_store.cc:276] 0709 13:16:26.073457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.073816 (+   359us) service_pool.cc:224] Handling call
0709 13:16:26.074147 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.094175 (+ 20028us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:26.587349 (+493174us) log.cc:844] Serialized 14 byte log entry
0709 13:16:26.861575 (+274226us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.331663 (+470088us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.332226 (+   563us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.332361 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.332547 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.431577 (+ 99030us) raft_consensus.cc:1685] finished
0709 13:16:27.431599 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.431790 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19623,"prepare.queue_time_us":628287,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":66162,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":37928,"thread_start_us":715380,"threads_started":2,"wal-append.queue_time_us":582941}
I20260709 13:16:27.486225  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1628) took 1552 ms. Trace:
I20260709 13:16:27.486721  8916 rpcz_store.cc:276] 0709 13:16:25.933181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.099973 (+166792us) service_pool.cc:224] Handling call
0709 13:16:27.485749 (+1385776us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54003adc54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:27.485964 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448766848}
I20260709 13:16:27.487010  8838 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.470216  8764 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:27.489812  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1387) took 1367 ms. Trace:
I20260709 13:16:27.490245  8764 rpcz_store.cc:276] 0709 13:16:26.122101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.557449 (+435348us) service_pool.cc:224] Handling call
0709 13:16:27.489657 (+932208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.490986 11400 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:27.433212  8760 rpcz_store.cc:276] 0709 13:16:25.993499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.993620 (+   121us) service_pool.cc:224] Handling call
0709 13:16:25.993970 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.994195 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.994219 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.994661 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.373499 (+378838us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.373552 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.373618 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.306262 (+932644us) raft_consensus.cc:1685] finished
0709 13:16:27.306353 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.327654 (+ 21301us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":378546,"threads_started":1,"wal-append.queue_time_us":680540}
I20260709 13:16:27.491464 11400 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:27.493291  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.436669  8911 rpcz_store.cc:276] 0709 13:16:26.002040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.120452 (+118412us) service_pool.cc:224] Handling call
0709 13:16:26.120762 (+   310us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.413682 (+292920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.413729 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:26.557953 (+144224us) log.cc:844] Serialized 52 byte log entry
0709 13:16:26.995889 (+437936us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.048153 (+ 52264us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.355453 (+307300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.355623 (+   170us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.355705 (+    82us) raft_consensus.cc:1685] finished
0709 13:16:27.355725 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.356122 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29819,"prepare.queue_time_us":65588,"raft.queue_time_us":84656,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":56210,"spinlock_wait_cycles":78313344,"thread_start_us":634576,"threads_started":2,"wal-append.queue_time_us":539261}
W20260709 13:16:27.494580  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.494867  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 156413us
I20260709 13:16:27.472605  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.468683  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1506) took 1389 ms. Trace:
I20260709 13:16:27.476739  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.472705 11473 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:27.500766  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.480643  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:27.484457  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:27.502805  8840 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:27.464558  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:27.486218  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.446134  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:27.509181  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.499889  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1505) took 1422 ms. Trace:
I20260709 13:16:27.516804  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1592) took 1194 ms. Trace:
I20260709 13:16:27.521505  8842 rpcz_store.cc:276] 0709 13:16:26.322102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.500360 (+1178258us) service_pool.cc:224] Handling call
0709 13:16:27.516744 (+ 16384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.488327 11384 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:27.508507 11477 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:27.501751  8841 rpcz_store.cc:276] 0709 13:16:26.079326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.079476 (+   150us) service_pool.cc:224] Handling call
0709 13:16:26.079765 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.667356 (+587591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.467985 (+800629us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b540021d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:27.468464 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280363776}
W20260709 13:16:27.511422 11538 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.772s	user 0.000s	sys 0.003s
I20260709 13:16:27.496832 11353 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.528644  8844 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:27.510214 11592 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.503839 11503 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.510834 11571 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.519169  8836 rpcz_store.cc:276] 0709 13:16:26.077348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.078389 (+  1041us) service_pool.cc:224] Handling call
0709 13:16:26.115613 (+ 37224us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.125609 (+  9996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.125655 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:26.157573 (+ 31918us) log.cc:844] Serialized 52 byte log entry
0709 13:16:26.676116 (+518543us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:26.676186 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.676281 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.499374 (+823093us) raft_consensus.cc:1685] finished
0709 13:16:27.499421 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.499668 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9393,"raft.queue_time_us":10270,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":36429,"spinlock_wait_cycles":2304,"thread_start_us":407132,"threads_started":1,"wal-append.queue_time_us":1321467}
I20260709 13:16:27.508718 11504 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.544909 11503 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.547626 11503 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:27.510991 11556 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:27.548758 11556 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.550451  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1367) took 2642 ms. Trace:
I20260709 13:16:27.551934 11556 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.551117  8913 rpcz_store.cc:276] 0709 13:16:24.908190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.924942 (+ 16752us) service_pool.cc:224] Handling call
0709 13:16:24.925979 (+  1037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.939025 (+ 13046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.939059 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.939525 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:16:25.292062 (+352537us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:25.292102 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.292167 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.510481 (+2218314us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:27.549748 (+ 39267us) raft_consensus.cc:1685] finished
0709 13:16:27.549783 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.550186 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12613,"raft.queue_time_us":12799,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8323,"spinlock_wait_cycles":29992320,"thread_start_us":309961,"threads_started":1,"wal-append.queue_time_us":682159}
I20260709 13:16:27.554282  8835 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:27.554582  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:27.555111  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1585) took 1286 ms. Trace:
I20260709 13:16:27.555492  8835 rpcz_store.cc:276] 0709 13:16:26.268627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.553471 (+1284844us) service_pool.cc:224] Handling call
0709 13:16:27.554015 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.554829 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.555034 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.530865  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.557199  8762 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 2. Preceding OpId from leader: term: 8 index: 3. (index mismatch)
I20260709 13:16:27.558211  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1390) took 1402 ms. Trace:
I20260709 13:16:27.558660  8762 rpcz_store.cc:276] 0709 13:16:26.155959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.452138 (+1296179us) service_pool.cc:224] Handling call
0709 13:16:27.516328 (+ 64190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.557791 (+ 41463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.558109 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:27.536194  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 67303.4us
I20260709 13:16:27.563838  8735 leader_election.cc:400] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:27.542208 11592 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:27.543133 11565 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.509s	user 0.002s	sys 0.001s
I20260709 13:16:27.543475 11477 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.570205 11592 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:27.545495  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.573980  9468 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:27.574285  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1356) took 1635 ms. Trace:
I20260709 13:16:27.576020  8909 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:27.574877  8766 rpcz_store.cc:276] 0709 13:16:25.939235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.939348 (+   113us) service_pool.cc:224] Handling call
0709 13:16:25.939667 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:25.940022 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.940052 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:25.940474 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.549931 (+609457us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:26.549991 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.550080 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.540429 (+990349us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:27.573731 (+ 33302us) raft_consensus.cc:1685] finished
0709 13:16:27.573766 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.574079 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1033,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":122,"spinlock_wait_cycles":35076352,"thread_start_us":586931,"threads_started":1,"wal-append.queue_time_us":849520}
I20260709 13:16:27.577626  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:27.578605  8911 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.519649 11499 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.585850  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:27.586498  8761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.006s
W20260709 13:16:27.586902  8761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.008s	sys 0.006s
I20260709 13:16:27.565819 11172 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.565353 11571 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.587517 11503 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.587733 11172 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:27.565924  8843 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.564968  8841 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:27.532805  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:27.590440  8912 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:27.567617  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.556734  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.580489  8735 leader_election.cc:403] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:16:27.585721  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:27.586186 11473 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:27.533239 11353 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.537817  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 238) took 1394 ms. Trace:
I20260709 13:16:27.593375  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:27.593098  8837 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.596223  8844 rpcz_store.cc:276] 0709 13:16:26.138347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.459832 (+1321485us) service_pool.cc:224] Handling call
0709 13:16:27.532992 (+ 73160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.594851 11473 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:27.601943  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.589253 11172 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.609727  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1587) took 1303 ms. Trace:
I20260709 13:16:27.612988  8844 rpcz_store.cc:276] 0709 13:16:26.305892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.600742 (+1294850us) service_pool.cc:224] Handling call
0709 13:16:27.608804 (+  8062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:27.609254 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.609286 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.609340 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:27.609399 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.609463 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.609625 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.607648  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1383) took 1345 ms. Trace:
I20260709 13:16:27.620134 11481 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.620795  8734 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:27.597522 11353 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.621727 11464 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.622485 11464 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.624994 11464 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.628813  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1389) took 1491 ms. Trace:
I20260709 13:16:27.629258  8765 rpcz_store.cc:276] 0709 13:16:26.137812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.651308 (+513496us) service_pool.cc:224] Handling call
0709 13:16:26.652468 (+  1160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:26.652771 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:27.461281 (+808510us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.628249 (+166968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:27.628333 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.628437 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.628555 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.628743 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35539,"prepare.queue_time_us":363553,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":27958,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"thread_start_us":908915,"threads_started":2}
I20260709 13:16:27.602246 11473 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.631860  8844 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:27.632666  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1593) took 1310 ms. Trace:
I20260709 13:16:27.633085 11362 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:27.633260  8844 rpcz_store.cc:276] 0709 13:16:26.322449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.631149 (+1308700us) service_pool.cc:224] Handling call
0709 13:16:27.631607 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.632321 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.632538 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.633906 11362 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.634938  8844 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:16:27.588306 11503 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.620319 11559 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.651875  8837 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:27.653290  8843 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:27.653290  8911 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:27.670006  8843 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:27.673003  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 109568us
I20260709 13:16:27.674369  8840 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:27.669787  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:27.674353  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1381) took 1584 ms. Trace:
I20260709 13:16:27.678740  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1595) took 1351 ms. Trace:
I20260709 13:16:27.679049  8844 rpcz_store.cc:276] 0709 13:16:26.322901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.634209 (+1311308us) service_pool.cc:224] Handling call
0709 13:16:27.634642 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.635306 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.674036 (+ 38730us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.607421 11477 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:27.682475  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1596) took 1359 ms. Trace:
I20260709 13:16:27.683715  8840 rpcz_store.cc:276] 0709 13:16:26.323131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.530203 (+1207072us) service_pool.cc:224] Handling call
0709 13:16:27.682404 (+152201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:27.685953 11481 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:27.686488 11481 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:27.687165 11481 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.653497 11355 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.693897  8843 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:16:27.694576 11567 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.661s	user 0.001s	sys 0.001s
I20260709 13:16:27.695145 11355 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:27.696254  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 43955.8us
I20260709 13:16:27.697176 11559 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.697696 11559 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.698057 11559 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:27.699090  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:27.689635  8842 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:27.701900  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 86018.1us
I20260709 13:16:27.615022  8763 rpcz_store.cc:276] 0709 13:16:26.099634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.583870 (+484236us) service_pool.cc:224] Handling call
0709 13:16:26.599730 (+ 15860us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.603048 (+  3318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.603098 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.603842 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.891776 (+287934us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:26.891835 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.891932 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.312374 (+420442us) raft_consensus.cc:1685] finished
0709 13:16:27.312414 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.445454 (+133040us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2885,"raft.queue_time_us":4282,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":27198,"thread_start_us":287514,"threads_started":1,"wal-append.queue_time_us":542029}
W20260709 13:16:27.682603  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 218315us
I20260709 13:16:27.708324  8912 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:27.710168 11355 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:27.710479  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1365) took 1715 ms. Trace:
I20260709 13:16:27.710884  8769 rpcz_store.cc:276] 0709 13:16:25.995214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.052045 (+ 56831us) service_pool.cc:224] Handling call
0709 13:16:26.069824 (+ 17779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.070182 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.070210 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:26.070693 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:16:26.650461 (+579768us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:26.650499 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.650566 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.693688 (+1043122us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:27.706346 (+ 12658us) raft_consensus.cc:1685] finished
0709 13:16:27.706367 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.710297 (+  3930us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11271,"spinlock_wait_cycles":35034880,"thread_start_us":579462,"threads_started":1,"wal-append.queue_time_us":790384}
I20260709 13:16:27.703480  8843 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:27.713078  8835 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:27.713009 11355 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.713941  8843 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.713845 11355 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.716183 11559 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.716711  8844 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:27.717173  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:27.719089  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:27.719255 11424 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.719897 11424 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.720475 11424 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:27.720376  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:27.721942  9463 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:27.722962 11353 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.723522  8840 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:27.724764 11600 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:27.726608 11473 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.726640 11423 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:27.727893 11362 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.728564  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:27.730854 11559 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.731652 11423 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:27.732009 11602 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.732285 11423 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:27.732666 11602 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.736191 11602 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.736032  8842 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:27.733619 11423 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.741467  8842 pending_rounds.cc:85] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 1
I20260709 13:16:27.741839  8842 pending_rounds.cc:107] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:27.742116  8842 raft_consensus.cc:2889] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.742444 11503 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.734040 11588 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.742854  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 396770us
I20260709 13:16:27.743362 11588 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.746496 11588 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.734670 11168 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:27.748600 11558 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.742093 11424 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.749255 11168 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.749274 11558 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.749861 11422 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.734977 11410 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:27.753566 11355 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:27.735374 11362 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:27.756409 11168 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.757093  9464 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:27.756946 11362 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:27.758534  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:27.664467 11571 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:27.763724 11422 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:27.764580  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:27.676474  8761 rpcz_store.cc:276] 0709 13:16:26.089479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.093972 (+  4493us) service_pool.cc:224] Handling call
0709 13:16:26.105935 (+ 11963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.107806 (+  1871us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:26.857352 (+749546us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.626020 (+768668us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.626242 (+   222us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.626860 (+   618us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.627059 (+   199us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.627095 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.627211 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.635706 (+  8495us) raft_consensus.cc:1685] finished
0709 13:16:27.635726 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.674292 (+ 38566us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38226,"prepare.queue_time_us":751609,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":9483,"raft.queue_time_us":53099,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":9358,"thread_start_us":1443715,"threads_started":2,"wal-append.queue_time_us":460439}
I20260709 13:16:27.813851  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:27.765417  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1586) took 1461 ms. Trace:
I20260709 13:16:27.703339 11172 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.681737 11464 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:27.866205  8837 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:27.868381  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60741.4us
I20260709 13:16:27.836589  9464 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:16:27.868927  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 104677us
I20260709 13:16:27.806762  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:27.873651  9468 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:27.867836  8836 rpcz_store.cc:276] 0709 13:16:26.305354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.557283 (+1251929us) service_pool.cc:224] Handling call
0709 13:16:27.557754 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:27.558404 (+   650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.558435 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:27.558964 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:16:27.600788 (+ 41824us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:27.600826 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.600934 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:27.765167 (+164233us) raft_consensus.cc:1685] finished
0709 13:16:27.765189 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:27.765326 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":894,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":207,"thread_start_us":41345,"threads_started":1,"wal-append.queue_time_us":203923}
I20260709 13:16:27.751268 11424 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:27.878935 11571 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:27.766012 11559 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.881547  9459 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:27.886544  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1386) took 1771 ms. Trace:
I20260709 13:16:27.887070  8768 rpcz_store.cc:276] 0709 13:16:26.114620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.656643 (+542023us) service_pool.cc:224] Handling call
0709 13:16:26.657605 (+   962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:26.683948 (+ 26343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:27.885915 (+1201967us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b540003f054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:27.886320 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3580672}
I20260709 13:16:27.880436 11422 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:27.889743 11422 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.890465  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:27.892297  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:27.893604 11505 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:27.893954 11558 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:27.894273 11505 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:27.895422 11505 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:27.900034  8917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1377) took 1379 ms (client timeout 1683 ms). Trace:
W20260709 13:16:27.900586  8917 rpcz_store.cc:269] 0709 13:16:26.520805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.523575 (+  2770us) service_pool.cc:224] Handling call
0709 13:16:27.899830 (+1376255us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54002ac6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:27.899968 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823277440}
I20260709 13:16:27.902145  9459 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:27.904325 11544 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:27.906643  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:27.907011 11400 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.908246 11400 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.909129 11384 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:27.909330 11481 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.910929 11384 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:27.913591  8732 leader_election.cc:336] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.677s (SENT)
I20260709 13:16:27.913861 11384 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:27.914204  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:27.914670 11398 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:27.916841  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:27.918258 11405 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.735s	user 0.014s	sys 0.005s
W20260709 13:16:27.919904  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.920353 11494 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.831537 11410 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:27.924817 11558 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:27.867156 11362 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:27.762590 11473 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:27.813639 11353 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:27.933122  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83946.1us
W20260709 13:16:27.946563  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 186539us
I20260709 13:16:27.941511 11422 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:27.959530 11494 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:27.971626  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58086.2us
W20260709 13:16:27.963708  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55479.6us
I20260709 13:16:27.979528  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:27.971711 11571 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:27.967499 11405 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.999194 11571 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:27.972142 11424 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.000636 11424 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:27.971800 11398 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:27.972218 11572 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:27.977185 11434 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.977072 11425 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.021167 11473 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:27.983089 11362 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:16:28.021868 11473 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.022580 11473 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.022977 11362 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:28.023409 11362 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:28.001801 11424 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.021634 11559 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:28.029815 11424 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.030097 11559 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:28.030411  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:28.030682 11481 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:28.032469  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:28.035683  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62418.3us
I20260709 13:16:28.013823 11405 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.000494 11571 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:28.050613  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 73404.1us
I20260709 13:16:27.981666 11504 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:16:28.033190 11377 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.030809 11559 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.024356 11362 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:28.075968  8732 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.120s (SENT)
I20260709 13:16:28.076162  8809 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.066280 11377 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.081322 11377 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.081504  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.086488 11398 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.031729 11428 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:28.021759 11425 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.095887  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:28.081323  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 314656us
I20260709 13:16:28.095283 11556 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.101533 11556 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.104188 11362 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:28.042198 11434 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.115686  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.116647  8842 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:28.121423  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1589) took 1806 ms. Trace:
W20260709 13:16:28.124811  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 90819.7us
I20260709 13:16:28.128892  8837 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:28.130456  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 65697.7us
W20260709 13:16:28.131765  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.104809 11556 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:28.167800  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 113165us
I20260709 13:16:28.173732 11405 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:28.174606  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.175343  8842 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.175426  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1391) took 1645 ms. Trace:
I20260709 13:16:28.176779 11559 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:28.175973  8914 rpcz_store.cc:276] 0709 13:16:26.529925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:26.608826 (+ 78901us) service_pool.cc:224] Handling call
0709 13:16:26.628791 (+ 19965us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:26.629215 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:26.629243 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:27.884001 (+1254758us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c00125038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:16:27.884683 (+   682us) log.cc:844] Serialized 52 byte log entry
0709 13:16:28.072498 (+187815us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:28.072560 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.078891 (+  6331us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.174861 (+ 95970us) raft_consensus.cc:1685] finished
0709 13:16:28.174889 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.175253 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1921,"raft.queue_time_us":517,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10269,"spinlock_wait_cycles":27853568,"thread_start_us":161449,"threads_started":1,"wal-append.queue_time_us":288016}
I20260709 13:16:28.177842 11428 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:16:28.178288  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110330us
I20260709 13:16:28.178306 11428 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.179351  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:28.179649 11428 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.175480 11505 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:28.181059 11505 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:28.182358  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 117954us
I20260709 13:16:28.182051 11505 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:28.183102  8732 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.156s (SENT)
I20260709 13:16:28.183670  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.184466 11572 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.127812 11398 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:28.185057 11398 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.185706 11627 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.186190 11398 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.187067  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.186825 11627 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:28.187806 11398 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.189059  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.189867  8839 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:28.125190  8841 rpcz_store.cc:276] 0709 13:16:26.306451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.613656 (+1307205us) service_pool.cc:224] Handling call
0709 13:16:27.697073 (+ 83417us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:27.697756 (+   683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:27.697788 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:27.698605 (+   817us) log.cc:844] Serialized 52 byte log entry
0709 13:16:27.777930 (+ 79325us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:28.009323 (+231393us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.011981 (+  2658us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.112506 (+100525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.112698 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:28.112785 (+    87us) raft_consensus.cc:1685] finished
0709 13:16:28.112825 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.113036 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":289249,"raft.queue_time_us":149249,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":17416,"spinlock_wait_cycles":28493440,"thread_start_us":386871,"threads_started":3,"wal-append.queue_time_us":256055}
I20260709 13:16:28.191649  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:28.202795  9468 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:28.193722  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:28.194586 11482 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.207020 11482 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.207571 11482 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.212702  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.194662  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:28.212797 11367 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:28.213793 11626 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.196502 11425 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:28.197032 11410 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.168231 11504 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.218393 11504 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:28.222702  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:28.224077 11494 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:28.225214 11405 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.226043  8838 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.225951 11405 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:28.229050  8732 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.167s (SENT)
I20260709 13:16:28.229928  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.231863 11494 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:28.234017 11425 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:28.237507 11428 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.242059  9463 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:28.244009 11467 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:28.255079  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:28.237021  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52108.9us
I20260709 13:16:28.260766  8838 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:16:28.262300  8838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1598) took 1611 ms (client timeout 1576 ms). Trace:
W20260709 13:16:28.263173  8732 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.169s (SENT)
W20260709 13:16:28.263518  8838 rpcz_store.cc:269] 0709 13:16:26.651052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.461975 (+810923us) service_pool.cc:224] Handling call
0709 13:16:27.932252 (+470277us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b18002b97a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fdd5646 00007fce6fd0f58e 00007fce6fd90f9e 00007fce6fd927de 00007fce6fd9e27c 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c
0709 13:16:28.225585 (+293333us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b58007d09d0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fcf60aa 00007fce6fd78447 00007fce6fd90fe7 00007fce6fd927de 00007fce6fd9e27c 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c
0709 13:16:28.262105 (+ 36520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635076864}
W20260709 13:16:28.282702  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.295333  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.291963 11405 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.294605  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.292665  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:28.298512 11494 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.296914 11405 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:28.303589  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.307752  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.305289  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:28.304345  8836 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:28.313978  9465 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:16:28.315517  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 283080us
I20260709 13:16:28.319047  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:28.365118  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 175582us
I20260709 13:16:28.175575 11452 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.244s
W20260709 13:16:28.380723  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 61810.2us
W20260709 13:16:28.384965  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78409us
I20260709 13:16:28.377640 11505 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.386391 11623 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:28.387190 11623 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.389637  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 302) took 3127 ms. Trace:
I20260709 13:16:28.390136  9467 rpcz_store.cc:276] 0709 13:16:25.262313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.294690 (+ 32377us) service_pool.cc:224] Handling call
0709 13:16:25.398298 (+103608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.398625 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:25.598597 (+199972us) log.cc:844] Serialized 14 byte log entry
0709 13:16:27.813071 (+2214474us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b1800476500. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a
0709 13:16:28.051968 (+238897us) log.cc:844] Serialized 14 byte log entry
0709 13:16:28.346263 (+294295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:28.362727 (+ 16464us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:28.388995 (+ 26268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:28.389148 (+   153us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:28.389389 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":653165,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":88,"raft.queue_time_us":11263,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":49313,"spinlock_wait_cycles":7035776,"thread_start_us":700066,"threads_started":4,"wal-append.queue_time_us":233696,"wal-append.run_cpu_time_us":1373,"wal-append.run_wall_time_us":1022828}
I20260709 13:16:28.392011 11588 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:28.392663 11588 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.394919 11588 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:28.397527  8663 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:28.408768  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.409981  8840 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:28.420416  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.422935 11434 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:28.425146 11450 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:28.430234 11172 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.552s	user 0.010s	sys 0.000s
I20260709 13:16:28.433003  8838 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:16:28.433424  8838 pending_rounds.cc:85] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 4
I20260709 13:16:28.433686  8838 pending_rounds.cc:107] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:16:28.433525  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.434011  8838 raft_consensus.cc:2889] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:28.434259  8844 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:28.434528  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.345520 11405 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.384320  8734 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:28.435141  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:28.461956  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.544003  8842 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:16:28.650864  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 388117us
I20260709 13:16:28.653093  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.654181  8838 raft_consensus.cc:2376] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7. Re-sending same reply.
W20260709 13:16:28.654338  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:28.655231  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.652768  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:28.653378  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 275443us
I20260709 13:16:28.656750  8843 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:28.532951  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 166571us
I20260709 13:16:28.400205  8663 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 4 to 6, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 6 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.652828  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:28.493526  8664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 93) took 28657 ms (client timeout 15000 ms). Trace:
I20260709 13:16:28.661662  8839 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:28.669005  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:28.665596  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 281241us
I20260709 13:16:28.672396  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.672453  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:28.648524 11424 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.008s
I20260709 13:16:28.672761  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:28.675199  8836 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:28.675668  9464 raft_consensus.cc:2410] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:28.674794  8842 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
W20260709 13:16:28.677367  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.678295  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.678746  8841 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.436040 11168 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:28.679178  8838 raft_consensus.cc:2376] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7. Re-sending same reply.
I20260709 13:16:28.559569 11627 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.551322 11384 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:16:28.530267 11450 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.658354 11623 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:28.685209  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:28.481935 11482 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.670768 11494 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:28.489953 11473 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.380008 11377 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.686205 11168 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.713480 11168 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.701715  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.709069 11450 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.686610 11405 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:28.739912  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46361.7us
W20260709 13:16:28.730178 11398 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.006s
I20260709 13:16:28.742934 11449 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:16:28.744041 11449 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:28.744483 11449 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.745018 11422 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.745373 11449 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.746003 11422 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:28.746471 11422 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.746855 11449 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.747613 11422 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.751350  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:28.663339  8664 rpcz_store.cc:269] 0709 13:15:59.836307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.836577 (+   270us) service_pool.cc:224] Handling call
0709 13:16:28.493224 (+28656647us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:20.759404 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:20.857139 (+ 97735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:20.857175 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:20.857192 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:20.857860 (+   668us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:20.857921 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:20.857945 (+    24us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:16:20.886606 (+ 28661us) tablet.cc:701] Row locks acquired
0709 13:16:20.897619 (+ 11013us) write_op.cc:260] PREPARE: finished
0709 13:16:20.911928 (+ 14309us) write_op.cc:270] Start()
0709 13:16:20.922194 (+ 10266us) write_op.cc:276] Timestamp: P: 1783602980908104 usec, L: 0
0709 13:16:20.931485 (+  9291us) op_driver.cc:348] REPLICATION: starting
0709 13:16:21.033691 (+102206us) log.cc:844] Serialized 2115 byte log entry
0709 13:16:21.419201 (+385510us) op_driver.cc:464] REPLICATION: finished
0709 13:16:22.138148 (+718947us) write_op.cc:301] APPLY: starting
0709 13:16:22.146493 (+  8345us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:22.221589 (+ 75096us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:22.285951 (+ 64362us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:22.286805 (+   854us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:22.287147 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:16:22.287223 (+    76us) write_op.cc:312] APPLY: finished
0709 13:16:22.287541 (+   318us) log.cc:844] Serialized 46 byte log entry
0709 13:16:22.316244 (+ 28703us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.355648 (+ 39404us) write_op.cc:454] Released schema lock
0709 13:16:22.358804 (+  3156us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:22.405989 (+ 47185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.408568 (+  2579us) write_op.cc:454] Released schema lock
0709 13:16:22.529879 (+121311us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b18002d2aa0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
Metrics: {"mutex_wait_us":885030,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":636502,"apply.run_cpu_time_us":4640,"apply.run_wall_time_us":307565,"mutex_wait_us":739,"num_ops":5,"prepare.queue_time_us":195260,"prepare.run_cpu_time_us":50595,"prepare.run_wall_time_us":443879,"raft.queue_time_us":117023,"raft.run_cpu_time_us":11165,"raft.run_wall_time_us":256972,"replication_time_us":415213,"spinlock_wait_cycles":25796352,"thread_start_us":490756,"threads_started":4,"wal-append.queue_time_us":365086,"wal-append.run_cpu_time_us":57589,"wal-append.run_wall_time_us":2107927}]]}
I20260709 13:16:28.752786  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.758508  8838 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:28.753859 11400 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.754535 11413 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:28.766137 11400 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.766701 11400 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.740473  8663 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.771684  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.754179 11377 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.768532 11422 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:28.787091  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.775137 11588 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.793085  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:28.815275  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.784690  8663 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 3 to 6, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 6 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:28.786243 11623 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.816629 11413 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:28.826344  8840 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:28.703485 11627 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.783206 11384 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:16:28.834905  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47201.4us
I20260709 13:16:28.793787 11590 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:28.781378 11452 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:16:28.792634 11398 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:16:28.861600  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 90042.5us
W20260709 13:16:28.861954  8807 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.683s (SENT)
I20260709 13:16:28.862390  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:28.825316 11482 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:28.857462 11377 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:28.888461 11629 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.892982 11630 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:16:28.858649 11623 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.895714  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:28.892793 11631 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 13:16:28.903368  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:28.877548 11405 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:28.867594  8663 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:28.835929 11588 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.909513 11400 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.892765 11629 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.933650  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.935699  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.940424  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:28.905683 11482 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:28.942795 11636 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:28.942641 11482 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.943538  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:28.901690 11428 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:16:28.906720 11473 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.945783 11405 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:28.946424 11405 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.947675 11405 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:28.948609 11642 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:16:28.864560 11590 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.949833 11405 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:28.913225 11424 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:16:28.953779 11627 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.954612 11424 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.955041 11424 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:28.945564  8843 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:28.957012 11400 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:28.957954 11400 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:28.958333 11400 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.958704 11400 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.961789 11172 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:28.962293 11172 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.962493  8663 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:28.963162 11172 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:28.964373 11172 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:28.921970 11353 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:28.954632 11398 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:28.966080 11398 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:28.967139 11398 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:28.968405 11398 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.960753  8841 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:28.939796  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:28.970814  9468 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:28.938159  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:28.976337  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:28.964639  8663 catalog_manager.cc:5697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 4, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:28.983987  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:28.992057  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 306975us
I20260709 13:16:28.991910  8663 catalog_manager.cc:5697] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:29.009397  8917 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:28.978505 11450 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:28.988348 11482 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:28.993283 10947 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:29.011282  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:29.013260  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:29.013377 11629 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:29.014211 11643 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 13:16:29.014132  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:29.018330  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:29.050727  8915 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.054893  8910 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:29.051522  8663 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 5, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 5 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.050354  8912 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.060710  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:29.061466  8916 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:29.076628  8912 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:29.017498 11413 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:29.046514 11364 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:29.083884 11400 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.086475 11400 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:29.087904  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.089128 11364 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:29.089489 11623 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:29.090546 11364 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:29.092463  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.093734  8914 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:29.094776  8913 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:29.095052  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:29.100469  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.107584  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:29.052953 11494 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:29.109524  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:29.110297 11494 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.112039  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:29.113761  8912 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:29.119302  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.121583  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.122182  8768 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:29.122455  8769 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:29.129122  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.135416  8840 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:29.139907  8916 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:29.143324  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:29.150440  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 288093us
I20260709 13:16:29.116333 11590 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:29.152664  8761 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:29.151916  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:29.101135 11434 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.168445  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:29.229671  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 62731.1us
I20260709 13:16:29.230166  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:29.237058  8916 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:29.237884  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:29.238732  8840 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.239590  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.171178 11428 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:29.252159  8839 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:29.165616 11646 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:29.255404 11434 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.255769  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.256651  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.089673 11413 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.261740  8835 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:29.261384  8663 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 3, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.167701 11588 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.245404 11422 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.164589 11405 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:29.270416  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.274381  8765 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:29.241429 11645 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:29.283399  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:29.181556 11590 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:16:29.286464  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.266979 11428 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.286543  8663 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 5, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 5 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:29.253473 11449 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:16:29.274523 11646 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.308373  8663 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 3, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 3 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.294268 11588 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.300696 11428 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.318428  8766 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:29.312023  8663 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 4 to 5, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 5 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:16:29.321344  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 309309us
I20260709 13:16:29.321472  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:29.312197  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 293138us
I20260709 13:16:29.332227  8663 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 3 to 4, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 4 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:29.334136  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.334820  8663 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:29.335460  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.336807  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.337433  8764 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.307206 11646 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.344936  8915 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
W20260709 13:16:29.345348  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 264355us
I20260709 13:16:29.337551  8761 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
W20260709 13:16:29.352074  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 277481us
I20260709 13:16:29.318702 11653 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.303637 11405 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.312814 10947 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:29.295807 11645 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.369165  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:29.369608 11645 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.369874  8835 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.366039 11405 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.373744  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.356194 11424 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:29.358101  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.386936 11656 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:29.387784 11656 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.363742 11644 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.359637 11653 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.366001 11353 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:29.366941 11168 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.006s
I20260709 13:16:29.366755 10947 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:29.403594  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.330135 11588 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.401484 11424 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.463455  8762 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:29.480525  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:29.487143  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:29.487938  8836 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:29.446476 11450 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.511401  8761 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:29.446846 11434 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.513983  8768 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:16:29.521513 11650 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:16:29.525291 11656 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.530613  8764 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:29.449668  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:29.534449  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 84877.4us
I20260709 13:16:29.535172  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.535809  8761 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:29.447633 11168 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:29.551878  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.552408  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.540966  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 323100us
I20260709 13:16:29.476465 11353 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.560356  8835 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:29.463542 11644 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.563984  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.540925 11647 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:29.566735  8764 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:29.568377  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.569075  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.570863  8761 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.574733  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.574762  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.575654  9463 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:29.581928 11647 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:29.583098 11647 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:29.585072 11588 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.586161 11450 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:29.586691 11450 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.587798 11168 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:29.568534 11662 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:16:29.589505  8769 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:29.590219 11651 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:16:29.592087 11644 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:29.593686  8766 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:29.601076  8763 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:29.605422  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.605798 11653 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:29.609689  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:29.610647  9465 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:29.613013  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61304.8us
I20260709 13:16:29.614712  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.615432  8763 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.616776  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:29.618983  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.549736  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:29.624374  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.617559  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:29.619743  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 294900us
I20260709 13:16:29.625756  8768 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.618346  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.550345 11645 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:16:29.651791  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:29.650223  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 100560us
I20260709 13:16:29.658677  8766 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.650964  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:29.670164  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.673799  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:29.675688  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.676052  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:29.681875  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.627698 11653 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:29.654434 11494 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:29.700708  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:29.702632  8837 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:29.705963  8761 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:29.707533  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:29.679925 11623 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:29.711660  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.726379  8836 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:29.675355 11657 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.727411 11657 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.729683 11494 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:29.730706 11494 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:29.731382 11638 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.732296 11638 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:29.735491  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:29.707237 11654 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:16:29.738725 11654 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:29.740617 11654 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:29.748286  8768 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:29.755625  8769 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:29.752283  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:29.760418  8766 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:29.700608 11482 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:29.770118  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:29.773205  8843 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:29.776592  8761 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
W20260709 13:16:29.780520  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.783311  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:29.787825  8768 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.793618  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:29.795712  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:29.710394 11653 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:29.724056 11623 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.709275 11364 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:16:30.012601  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:30.120822  8762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.009s
W20260709 13:16:29.866245  9431 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.765s (SENT)
W20260709 13:16:30.451810  8883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.009s
W20260709 13:16:30.169277  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 475954us
W20260709 13:16:30.630872  9468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.014s
W20260709 13:16:30.422492  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.007s	sys 0.006s
W20260709 13:16:30.703722  9468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.002s	sys 0.015s
W20260709 13:16:30.703945  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.011s	sys 0.008s
W20260709 13:16:30.567987  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.152709  8768 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
W20260709 13:16:30.481226  8841 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.006s
W20260709 13:16:30.412794  8881 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.014s
I20260709 13:16:30.497828  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:30.708488  8881 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.008s	sys 0.021s
W20260709 13:16:29.902662  8840 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.648s	user 0.005s	sys 0.009s
W20260709 13:16:30.708500  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58438.5us
I20260709 13:16:30.709260  8840 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:16:30.709661  8808 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.683s (SENT)
I20260709 13:16:30.709877  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1549) took 1543 ms. Trace:
I20260709 13:16:30.704566  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 399) took 1144 ms. Trace:
I20260709 13:16:30.710171  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:30.216583  8763 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.000s
I20260709 13:16:30.712409  8763 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:30.713481  8767 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 13:16:30.423534  8809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.002s	sys 0.014s
W20260709 13:16:30.715497  8809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.003s	sys 0.019s
W20260709 13:16:30.449668  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 627236us
I20260709 13:16:30.182576  8838 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:29.805466  8765 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:30.719018  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1371) took 1009 ms. Trace:
I20260709 13:16:30.719547  8765 rpcz_store.cc:276] 0709 13:16:29.709779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.746605 (+ 36826us) service_pool.cc:224] Handling call
0709 13:16:30.718918 (+972313us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:30.702180  8883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.005s	sys 0.013s
W20260709 13:16:30.705350  8762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.014s	sys 0.019s
I20260709 13:16:30.460381  8766 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.800246  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:30.272140 11675 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.471s	user 0.001s	sys 0.001s
I20260709 13:16:30.710386  9468 rpcz_store.cc:276] 0709 13:16:29.560380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.560931 (+   551us) service_pool.cc:224] Handling call
0709 13:16:29.571743 (+ 10812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.572010 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:30.127431 (+555421us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.704233 (+576802us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.704283 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:30.704332 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.704403 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.704515 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":718667,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"thread_start_us":1056151,"threads_started":2}
I20260709 13:16:30.739748  8769 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
W20260709 13:16:30.167954  8910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.007s
W20260709 13:16:30.707691  8841 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.016s
W20260709 13:16:30.740937  8910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.023s	sys 0.026s
I20260709 13:16:30.741421  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1545) took 1637 ms. Trace:
I20260709 13:16:30.498245  8843 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:16:30.328186  8839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.007s
W20260709 13:16:30.729197  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.718242  8838 pending_rounds.cc:85] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 4
I20260709 13:16:30.744562  8838 pending_rounds.cc:107] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:30.744938  8838 raft_consensus.cc:2889] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:30.742017  8841 rpcz_store.cc:276] 0709 13:16:29.103562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.147997 (+ 44435us) service_pool.cc:224] Handling call
0709 13:16:29.170257 (+ 22260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.242691 (+ 72434us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:29.541042 (+298351us) log.cc:844] Serialized 14 byte log entry
0709 13:16:29.934581 (+393539us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.741063 (+806482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.741114 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:30.741161 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.741225 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.741339 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13801,"prepare.queue_time_us":61405,"prepare.run_cpu_time_us":134,"prepare.run_wall_time_us":142,"raft.queue_time_us":276044,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":14532,"thread_start_us":1461605,"threads_started":3,"wal-append.queue_time_us":746126}
I20260709 13:16:30.745494  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1402) took 1100 ms. Trace:
I20260709 13:16:30.733812  8766 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:30.747960  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:30.056643  8760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.017s
I20260709 13:16:30.748844  8765 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:30.738302  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.710230  8840 rpcz_store.cc:276] 0709 13:16:29.166858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.167308 (+   450us) service_pool.cc:224] Handling call
0709 13:16:30.709822 (+1542514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:29.839551 11413 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:30.742767  8839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.006s	sys 0.016s
I20260709 13:16:30.746044  8763 rpcz_store.cc:276] 0709 13:16:29.614265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.614428 (+   163us) service_pool.cc:224] Handling call
0709 13:16:30.714323 (+1099895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.763368  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:30.749182  8760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.012s	sys 0.025s
I20260709 13:16:30.750396  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:30.765087  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1383) took 1027 ms. Trace:
I20260709 13:16:30.765465  8766 rpcz_store.cc:276] 0709 13:16:29.737849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.749897 (+1012048us) service_pool.cc:224] Handling call
0709 13:16:30.765007 (+ 15110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:30.287863 11646 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.929s	user 0.005s	sys 0.005s
W20260709 13:16:30.696583 11679 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:16:30.388505 11428 consensus_meta.cc:287] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.044s	user 0.012s	sys 0.000s
W20260709 13:16:30.627544 11678 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.436s	user 0.016s	sys 0.005s
W20260709 13:16:30.273273 11674 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 13:16:30.033424 11422 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:30.567456  9433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.001s	sys 0.013s
I20260709 13:16:30.728513 11623 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.737210  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1400) took 1168 ms. Trace:
I20260709 13:16:30.025080 11172 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.033138 11424 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:29.841462 11659 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.841102 11384 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.952s
W20260709 13:16:30.767362  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 901131us
I20260709 13:16:30.533177 11676 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.263440 11655 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:30.773895  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:30.858464  8768 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:30.533138 11691 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.776247  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1414) took 1685 ms. Trace:
I20260709 13:16:29.908574 11434 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.776347  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1554) took 1076 ms. Trace:
I20260709 13:16:30.778414  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:30.778261  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:30.479259 11654 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.639580  9459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 398) took 1068 ms. Trace:
W20260709 13:16:30.796275 11682 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:16:30.130268 11482 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:30.568392 11697 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:30.785336  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:30.784174  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:30.784497 11689 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.821228 11449 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.977s
I20260709 13:16:30.795711  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:30.796185 11422 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.851351  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1370) took 1159 ms. Trace:
W20260709 13:16:30.852083  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 142505us
I20260709 13:16:30.852514  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:30.903095  8767 rpcz_store.cc:276] 0709 13:16:29.692212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.693073 (+   861us) service_pool.cc:224] Handling call
0709 13:16:30.713113 (+1020040us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.727934 (+ 14821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.851135 (+123201us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400198f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:30.851289 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307126656}
I20260709 13:16:30.755419 11629 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:30.853404  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 77217.5us
W20260709 13:16:30.854243  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101867us
I20260709 13:16:30.911768  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:30.792584 11701 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.797575  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:30.946238  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:30.946601  8915 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:30.765518  8763 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.734831 11657 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:30.849411  8762 rpcz_store.cc:276] 0709 13:16:29.568337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.574489 (+  6152us) service_pool.cc:224] Handling call
0709 13:16:29.574775 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.736705 (+1161930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.736736 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.736790 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:30.736843 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.736952 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.737119 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4858,"raft.queue_time_us":5863,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"thread_start_us":1151490,"threads_started":1}
W20260709 13:16:30.792819  9433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.006s	sys 0.013s
I20260709 13:16:30.883345  8838 rpcz_store.cc:276] 0709 13:16:29.699659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.751831 (+ 52172us) service_pool.cc:224] Handling call
0709 13:16:30.167389 (+415558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:30.774962 (+607573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.776287 (+  1325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.885048  8917 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:30.282008 11638 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:30.887976  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:30.781455 11695 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.897217 11405 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:30.886875  9432 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.532s (SENT) [suppressed 40 similar messages]
I20260709 13:16:30.891184  8909 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:16:30.429199 11353 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:30.833431 11424 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:30.794093 11168 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.892356  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:30.885025 11676 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.890413  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1372) took 1161 ms. Trace:
I20260709 13:16:30.893448  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1393) took 1148 ms. Trace:
I20260709 13:16:30.481014 11653 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:30.901899  8911 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:30.786849 11706 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.792737 11428 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:30.899016 11691 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.970511  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.191005  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.191785  8915 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.192456  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.192658  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.155681 11700 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:16:30.861872 11172 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:30.908522  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:30.909137  8916 raft_consensus.cc:2368] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:30.962067 11694 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:30.910383 11629 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:29.959929 11450 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:30.923727  8768 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:30.858103 11655 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:30.801806  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:31.214974  8843 raft_consensus.cc:606] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:31.215382  8843 raft_consensus.cc:614] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:30.994019 11702 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:16:31.215734  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1553) took 1518 ms. Trace:
I20260709 13:16:30.859316  8910 rpcz_store.cc:276] 0709 13:16:29.090465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.092980 (+  2515us) service_pool.cc:224] Handling call
0709 13:16:29.256805 (+163825us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b58001d1f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:29.256989 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.257405 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:29.538431 (+281026us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.775925 (+1237494us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.775976 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:30.776022 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.776085 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.776190 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34519,"prepare.queue_time_us":127689,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":36034,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":10880512,"thread_start_us":1456609,"threads_started":2,"wal-append.queue_time_us":1031935}
I20260709 13:16:31.219857  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:30.780508 11646 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.953243  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.222988  8912 raft_consensus.cc:2368] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:30.960153  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1557) took 1213 ms. Trace:
I20260709 13:16:30.946924  8913 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:30.856796 11364 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:16:30.966325  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1395) took 1127 ms. Trace:
I20260709 13:16:30.888788  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1369) took 1234 ms. Trace:
I20260709 13:16:30.890875 11659 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.969504 11695 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.248603 11712 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:30.890723 11434 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.250408 11646 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.250663 11695 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.251006 11434 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:30.889689 11654 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.193281  8918 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:31.253882  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.254947  8918 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:31.178617  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.909933  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.218461  8839 rpcz_store.cc:276] 0709 13:16:29.697829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.708135 (+ 10306us) service_pool.cc:224] Handling call
0709 13:16:29.734504 (+ 26369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:30.760889 (+1026385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:30.760954 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:30.761553 (+   599us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.045305 (+283752us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:31.045362 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.045465 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.215518 (+170053us) raft_consensus.cc:1685] finished
0709 13:16:31.215539 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.215671 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":277090,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":41528,"thread_start_us":1219092,"threads_started":2,"wal-append.queue_time_us":419350}
I20260709 13:16:31.195333  8915 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:31.195640  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 64662.5us
I20260709 13:16:31.169603  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 256) took 1746 ms. Trace:
I20260709 13:16:30.995890  8763 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:31.262766  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1381) took 1530 ms (client timeout 1951 ms). Trace:
W20260709 13:16:31.263144  8763 rpcz_store.cc:269] 0709 13:16:29.732715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.762996 (+1030281us) service_pool.cc:224] Handling call
0709 13:16:31.262711 (+499715us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:31.196561  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.887279  9459 rpcz_store.cc:276] 0709 13:16:29.536727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.540549 (+  3822us) service_pool.cc:224] Handling call
0709 13:16:29.569279 (+ 28730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:29.601063 (+ 31784us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:30.102936 (+501873us) log.cc:844] Serialized 14 byte log entry
0709 13:16:30.557666 (+454730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:30.566581 (+  8915us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:30.574824 (+  8243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.586469 (+ 11645us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.601491 (+ 15022us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38440,"prepare.queue_time_us":772304,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":15505,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":31987,"thread_start_us":798334,"threads_started":2,"wal-append.queue_time_us":612370}
I20260709 13:16:30.983824  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.197835  8769 rpcz_store.cc:276] 0709 13:16:29.729248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.757665 (+1028417us) service_pool.cc:224] Handling call
0709 13:16:30.890354 (+132689us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.200374  8761 rpcz_store.cc:276] 0709 13:16:29.744905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.755450 (+1010545us) service_pool.cc:224] Handling call
0709 13:16:30.889212 (+133762us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:31.130489  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.256117  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.265733  8918 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.266258  9461 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:30.791107 11413 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:31.197440  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1393) took 1864 ms. Trace:
W20260709 13:16:31.205571  8768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1409) took 1291 ms (client timeout 1682 ms). Trace:
W20260709 13:16:31.273777  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44719.1us
W20260709 13:16:31.274183  8768 rpcz_store.cc:269] 0709 13:16:29.914477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.740699 (+826222us) service_pool.cc:224] Handling call
0709 13:16:31.205493 (+464794us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.908564 11652 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:31.207919  9431 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.651s (SENT)
I20260709 13:16:31.213310  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:31.213974  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.857374 11667 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:31.162930 11705 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
I20260709 13:16:31.223371  8762 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:31.291637  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1388) took 1552 ms. Trace:
I20260709 13:16:31.291988  8762 rpcz_store.cc:276] 0709 13:16:29.739528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.952854 (+1213326us) service_pool.cc:224] Handling call
0709 13:16:31.291571 (+338717us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.223847  8842 rpcz_store.cc:276] 0709 13:16:29.746851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.746962 (+   111us) service_pool.cc:224] Handling call
0709 13:16:29.747279 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.747647 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.747682 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.748176 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:30.186653 (+438477us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:30.186721 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.186826 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.656933 (+470107us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b48001d01d8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:16:30.917675 (+260742us) raft_consensus.cc:1685] finished
0709 13:16:30.917706 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:30.960058 (+ 42352us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":286418,"raft.run_cpu_time_us":3165,"raft.run_wall_time_us":599396,"spinlock_wait_cycles":28241152,"thread_start_us":438013,"threads_started":1,"wal-append.queue_time_us":979573}
I20260709 13:16:31.226076  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.293184  8911 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.227149  8764 rpcz_store.cc:276] 0709 13:16:29.654691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.655008 (+   317us) service_pool.cc:224] Handling call
0709 13:16:30.888590 (+1233582us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400338e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:30.888729 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2475749120}
I20260709 13:16:31.226162  8766 rpcz_store.cc:276] 0709 13:16:29.838850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.853612 (+1014762us) service_pool.cc:224] Handling call
0709 13:16:30.966245 (+112633us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:30.906674 11689 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.996016 11422 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:30.994360 11708 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:31.185148 11384 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:31.206698 11168 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.199286 11405 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:31.309558 11384 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.311429 11168 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.311805  8767 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.312443 11384 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.313123 11708 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.315450 11708 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.161288 11623 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:30.971491 11482 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.213039 11353 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:31.237142  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.238518 11691 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.325699  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.238803 11450 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:30.945641 11701 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.239769 11698 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.239890 11449 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.215061 11706 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:30.945928 11697 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.240505  8765 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:31.337598  8765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1374) took 1607 ms (client timeout 1922 ms). Trace:
W20260709 13:16:31.338112  8765 rpcz_store.cc:269] 0709 13:16:29.730060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.747565 (+1017505us) service_pool.cc:224] Handling call
0709 13:16:31.337511 (+589946us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.339417  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.241621  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.242617 11172 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.245255 11659 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.246753 11424 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.247804 11629 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.248358  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:31.352511  8914 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.272907  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.354151  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.272907  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.261989  8844 rpcz_store.cc:276] 0709 13:16:29.423019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.423311 (+   292us) service_pool.cc:224] Handling call
0709 13:16:29.467328 (+ 44017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:29.480364 (+ 13036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:29.480406 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:29.512041 (+ 31635us) log.cc:844] Serialized 26 byte log entry
0709 13:16:29.901168 (+389127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:29.901205 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:29.901275 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:31.169305 (+1268030us) raft_consensus.cc:1685] finished
0709 13:16:31.169329 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.169517 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58493,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":53,"thread_start_us":371521,"threads_started":1,"wal-append.queue_time_us":1105039}
I20260709 13:16:31.293356 11652 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.279414  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:31.356395  8913 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.281234  8916 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.289839  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.290134  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.357326  8915 raft_consensus.cc:2368] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:31.273831  8760 rpcz_store.cc:276] 0709 13:16:29.333356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.349405 (+ 16049us) service_pool.cc:224] Handling call
0709 13:16:29.360267 (+ 10862us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:29.404408 (+ 44141us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:16:29.404456 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:29.486833 (+ 82377us) log.cc:844] Serialized 52 byte log entry
0709 13:16:30.764780 (+1277947us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:30.764839 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:30.764974 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:30.982251 (+217277us) raft_consensus.cc:1685] finished
0709 13:16:30.982278 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:31.197385 (+215107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10659,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":41055,"thread_start_us":1248615,"threads_started":1,"wal-append.queue_time_us":913949}
I20260709 13:16:31.289839  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.358209  8763 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.290232  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:31.359063  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 110772us
I20260709 13:16:30.944854 11703 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.282s
W20260709 13:16:31.303984  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 96088.3us
W20260709 13:16:31.360646  9431 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.928s (SENT)
I20260709 13:16:31.361044  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:31.304428  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.355297  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:31.362340  8837 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:31.304805 11413 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.306634 11428 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.309059 11644 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.309353 11689 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.316949  8842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:31.242657 11676 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.276779 10947 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.326664  8909 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:31.329155 11353 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:31.323778  8732 connection.cc:256] RPC call timeout handler was delayed by -3.2951299110000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
I20260709 13:16:31.334152  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.335580  8835 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:31.340494  8910 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:31.387758  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:31.343531  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 476871us
I20260709 13:16:31.345024 11623 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.388069  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.387184  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.342437 11449 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.351127  8765 raft_consensus.cc:2376] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6. Re-sending same reply.
I20260709 13:16:31.356333  8840 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.287623  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.364756  8767 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:31.369486  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.396384  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.372828  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.375212  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.397217  8761 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:31.371188  8733 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60042 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:31.369541 11695 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.377727  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.369369 11172 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.369621 11712 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:31.379890  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.381109  9468 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.382369  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.379288 11654 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.330302  8769 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:31.311415 11405 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.423555  8840 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
W20260709 13:16:31.387384  8732 connection.cc:256] RPC call timeout handler was delayed by -3.2474299109999265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
I20260709 13:16:31.388409  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:31.396282  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.375443  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.427271  8844 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:31.428298  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:31.428599  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.429800 11708 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:31.377009  8842 raft_consensus.cc:606] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:31.432147  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.396963  8768 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:31.360904 11384 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.388752  8913 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:16:31.379108  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:31.433318  8768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1394) took 1594 ms (client timeout 2051 ms). Trace:
W20260709 13:16:31.433934  8768 rpcz_store.cc:269] 0709 13:16:29.838465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.287260 (+1448795us) service_pool.cc:224] Handling call
0709 13:16:31.433174 (+145914us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.434260  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.386543 11450 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.316386 11655 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.433374 11384 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.436306 11655 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.436300 11450 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:31.438524 11384 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.373363 11422 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:31.373015 11398 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.375375  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.440321  8760 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:31.440920  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1380) took 1708 ms. Trace:
I20260709 13:16:31.441347  8760 rpcz_store.cc:276] 0709 13:16:29.732262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.357838 (+1625576us) service_pool.cc:224] Handling call
0709 13:16:31.440830 (+ 82992us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.369488 11638 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:31.404557  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1378) took 1673 ms. Trace:
I20260709 13:16:31.425781  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.405750  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.443800  8761 rpcz_store.cc:276] 0709 13:16:29.731403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.350888 (+1619485us) service_pool.cc:224] Handling call
0709 13:16:31.404496 (+ 53608us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.403587  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.444547  8909 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.398736  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.341958 11698 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.410362  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.411301  8762 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:31.350486 11364 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:31.372618 11694 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:31.413334  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.413560 11711 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:31.452119  8765 raft_consensus.cc:2376] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9. Re-sending same reply.
I20260709 13:16:31.414492  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.415421  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.416147  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.416806  8763 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:31.418870  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:31.454283  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1373) took 1724 ms (client timeout 2114 ms). Trace:
W20260709 13:16:31.454686  8763 rpcz_store.cc:269] 0709 13:16:29.729631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.277977 (+1548346us) service_pool.cc:224] Handling call
0709 13:16:31.454229 (+176252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.423291  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1392) took 1682 ms. Trace:
I20260709 13:16:31.455497  8769 rpcz_store.cc:276] 0709 13:16:29.740642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.297515 (+1556873us) service_pool.cc:224] Handling call
0709 13:16:31.423224 (+125709us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.456692  8841 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.435377  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.403585  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.438941  8842 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:31.413120  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.460494  8839 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:31.460625  8917 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.449149  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:31.449882  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89263.5us
W20260709 13:16:31.449530  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47292.9us
I20260709 13:16:31.465492  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:31.466861  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.397640  8733 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60042 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1415)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1431)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1428)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1426)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1440)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1432)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1427)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1433)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1423)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1434)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1430)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1429)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1435)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1437)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1438)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1375)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1422)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1377)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1379)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1384)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1385)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1386)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1390)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1396)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1414)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1416)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1417)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1418)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1419)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1421)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1424)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1425)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1397)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1398)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1399)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1401)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1402)
I20260709 13:16:31.468125  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.468978  8837 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:31.470083  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.469995 11726 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:31.471077  8915 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.470907  8918 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:31.470849 11726 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.472152  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.472901  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.469040  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:31.473701  8841 raft_consensus.cc:606] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:31.473768  8912 raft_consensus.cc:2410] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:31.474076  8841 raft_consensus.cc:614] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.472252  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.475271  8918 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:31.476032  8916 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:31.477432  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.477982  8909 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:31.385214 11644 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.439970 11398 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.482517  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.485383  8909 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:31.397053 10947 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:31.527429  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 102458us
W20260709 13:16:31.482699  8732 connection.cc:256] RPC call timeout handler was delayed by -3.0800299109998832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
I20260709 13:16:31.525441  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:31.528813  8732 connection.cc:256] RPC call timeout handler was delayed by -2.9360299109998778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
I20260709 13:16:31.529166  8912 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:31.529173  8732 connection.cc:256] RPC call timeout handler was delayed by -2.8298299109999334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 13:16:31.529887  8732 connection.cc:256] RPC call timeout handler was delayed by -2.7686299109998345s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
W20260709 13:16:31.530284  8732 connection.cc:256] RPC call timeout handler was delayed by -2.7038299109999571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:16:31.530683  8732 connection.cc:256] RPC call timeout handler was delayed by -2.6867299109999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 13:16:31.530941  8732 connection.cc:256] RPC call timeout handler was delayed by -2.4473299109999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
W20260709 13:16:31.531204  8732 connection.cc:256] RPC call timeout handler was delayed by -2.2402143819999765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
W20260709 13:16:31.531505  8732 connection.cc:256] RPC call timeout handler was delayed by -2.1845299110000269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2757s for a response
W20260709 13:16:31.531908  8732 connection.cc:256] RPC call timeout handler was delayed by -2.1143299109999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28350000000000003s for a response
W20260709 13:16:31.532322  8732 connection.cc:256] RPC call timeout handler was delayed by -2.0720079759998953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:16:31.532639  8732 connection.cc:256] RPC call timeout handler was delayed by -2.0495079759998589s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15600000000000003s for a response
I20260709 13:16:31.424755 11667 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.528228  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:31.525528  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:31.527387  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61961.6us
I20260709 13:16:31.535349  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:31.535965  8732 connection.cc:256] RPC call timeout handler was delayed by -1.9874299109999356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29760000000000003s for a response
W20260709 13:16:31.537135  8732 connection.cc:256] RPC call timeout handler was delayed by -1.8793143820000751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22690000000000002s for a response
W20260709 13:16:31.537926  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:31.537662  8732 connection.cc:256] RPC call timeout handler was delayed by -1.8416079759997501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
I20260709 13:16:31.411738 11172 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:31.542534  8732 connection.cc:256] RPC call timeout handler was delayed by -1.8272079759999542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 13:16:31.550244  8732 connection.cc:256] RPC call timeout handler was delayed by -1.7948299109998516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.319s for a response
W20260709 13:16:31.550741  8732 connection.cc:256] RPC call timeout handler was delayed by -1.7372299109999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3254s for a response
W20260709 13:16:31.551184  8732 connection.cc:256] RPC call timeout handler was delayed by -1.73362991099998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32580000000000003s for a response
W20260709 13:16:31.551611  8732 connection.cc:256] RPC call timeout handler was delayed by -1.6985299109999232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32970000000000005s for a response
I20260709 13:16:31.551707  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:31.552028  8732 connection.cc:256] RPC call timeout handler was delayed by -1.534707975999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 13:16:31.409991 11695 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.488847 11700 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:31.552484  8732 connection.cc:256] RPC call timeout handler was delayed by -1.5077079759998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 13:16:31.553059  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:31.553349  8909 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:31.554358  8918 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:31.485994 11384 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.479584 11428 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:31.556358  8836 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:31.420650 11712 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.558717  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:31.576259  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:31.548239  8917 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:31.479763 11364 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.562492  8912 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260709 13:16:31.566404  8732 connection.cc:256] RPC call timeout handler was delayed by -1.4942079759998705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 13:16:31.581630  8732 connection.cc:256] RPC call timeout handler was delayed by -1.4915079759998662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21800000000000003s for a response
W20260709 13:16:31.582119  8732 connection.cc:256] RPC call timeout handler was delayed by -1.4447079759997905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:16:31.582489  8732 connection.cc:256] RPC call timeout handler was delayed by -1.4402079759997832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 13:16:31.582929  8732 connection.cc:256] RPC call timeout handler was delayed by -1.3754299109998556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.36560000000000004s for a response
I20260709 13:16:31.458726 11638 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.587342 11638 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.574592  8914 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:31.578272  8917 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:16:31.573495  8808 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.620s (SENT)
I20260709 13:16:31.590299  8916 raft_consensus.cc:2410] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:31.590616  8808 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.776s (SENT)
I20260709 13:16:31.588282 11638 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:31.591080  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:31.593967  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:31.563333 11172 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.596822  8911 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:31.598106 11721 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.600802  8808 leader_election.cc:336] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.844s (SENT)
I20260709 13:16:31.618166  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:31.601675 11689 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.563707 11723 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:16:31.572826 11700 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:31.608783  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.609809  8844 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:16:31.636940  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 101786us
I20260709 13:16:31.611477 11364 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.558128 11708 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.564942 11725 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:31.662047  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61286.3us
W20260709 13:16:31.662343  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45604us
I20260709 13:16:31.595279 11659 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.655870  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:31.639797 11434 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.660427 11736 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:31.666831  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:31.635325 11168 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:31.640039 11700 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.680773  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:31.666327  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 56776.4us
I20260709 13:16:31.595142 11384 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.549590 11667 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.684376  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:31.689289  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:31.690429  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:31.687151  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.687463  9467 raft_consensus.cc:2410] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:31.619313 11428 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.693666  8910 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:31.667487 11659 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.672246 11697 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.711539  8842 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:31.682099 11726 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.673628 11413 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:16:31.671420 11708 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.720676  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:31.706966 11659 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.626924 11721 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:31.723754  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 129911us
I20260709 13:16:31.708237 11168 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.727948  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:31.729102  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:31.692891 11728 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.716599 11697 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.737221  9463 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:31.724695 11712 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.671828 11725 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.742465  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:31.750262  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:31.753788 11644 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.753928  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:31.754218 11731 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:31.754711  9466 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.754997 11731 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:31.755625 11731 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:31.751936 11728 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:31.757416  8912 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:31.758832 11712 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:31.759451 11712 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:31.760012 11712 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.766747  9466 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:31.731124 11698 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:31.809289  8766 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:31.787531 11398 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.812505 11721 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.659279 11694 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.813494 10947 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:31.771847 11720 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:16:31.815137 11695 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.776183 11697 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:31.819875  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.821666 11708 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.821995  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.823289  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.867262  8764 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:31.819880 11428 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:31.854116  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:31.835656  8809 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:31.869464  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:31.858315  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1415) took 1174 ms. Trace:
I20260709 13:16:31.870257  8768 rpcz_store.cc:276] 0709 13:16:30.684057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.819599 (+1135542us) service_pool.cc:224] Handling call
0709 13:16:31.858250 (+ 38651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.871275  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.871940  8768 raft_consensus.cc:2376] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:16:31.873071 10947 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:31.873610 10947 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:31.873598  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 131278us
I20260709 13:16:31.866443  8762 raft_consensus.cc:2376] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9. Re-sending same reply.
I20260709 13:16:31.874084 10947 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:31.881752  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.882026  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.899206  8768 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:31.899263  8762 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:31.900493  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.896260 11168 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.905521 11424 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:31.901825  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.906944  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.907584  8768 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
W20260709 13:16:31.899773  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 130045us
I20260709 13:16:31.907704  8764 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:31.910614  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.919616  8764 raft_consensus.cc:2376] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6. Re-sending same reply.
I20260709 13:16:31.920498  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.921027  8764 raft_consensus.cc:2376] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:16:31.921866  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.922408  8764 raft_consensus.cc:2376] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:16:31.923285  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.923928  8764 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:31.924305  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1375) took 2194 ms. Trace:
I20260709 13:16:31.912572 11700 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:31.926411  9467 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:31.928062 11667 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:31.909641  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.929813 11697 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:31.932288  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.932659  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:31.933390  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.934149  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.924399 11353 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.937405  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:31.967945  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:31.969156  8836 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:31.953397  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.970983  8765 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:31.972107  8844 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:31.973904  8768 raft_consensus.cc:2376] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9. Re-sending same reply.
I20260709 13:16:31.975085  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:31.975841  8768 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.946393  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:31.949994  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.978927  9467 raft_consensus.cc:2410] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:31.924646  8764 rpcz_store.cc:276] 0709 13:16:29.730377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.923027 (+2192650us) service_pool.cc:224] Handling call
0709 13:16:31.924253 (+  1226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.978825  8762 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
W20260709 13:16:31.987528  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50210.2us
I20260709 13:16:31.908154 11721 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:31.955801 11652 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:31.999491  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:31.990808 11646 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.004431  8765 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:32.005162  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:31.991931 11422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.010s
W20260709 13:16:32.008972  8767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1410) took 2003 ms (client timeout 1798 ms). Trace:
W20260709 13:16:32.015105 11422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.010s	sys 0.011s
I20260709 13:16:32.015411 11706 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:32.015215  8767 rpcz_store.cc:269] 0709 13:16:30.005291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.909688 (+904397us) service_pool.cc:224] Handling call
0709 13:16:32.008749 (+1099061us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b5400379e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:32.008893 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122660096}
I20260709 13:16:32.017341  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.018510  8767 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:32.019794  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.020622  8767 raft_consensus.cc:1813] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Handling vote request from an unknown peer bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:32.022395  8766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1376) took 2291 ms (client timeout 2856 ms). Trace:
I20260709 13:16:31.935209 11731 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:32.023102  8766 rpcz_store.cc:269] 0709 13:16:29.730804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.377215 (+1646411us) service_pool.cc:224] Handling call
0709 13:16:32.022087 (+644872us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54002bfa54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:32.022306 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878637312}
I20260709 13:16:32.022632  8767 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:16:32.012046  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 528652us
I20260709 13:16:32.030625  8766 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:16:32.031255  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1377) took 2300 ms. Trace:
I20260709 13:16:32.031577  8766 rpcz_store.cc:276] 0709 13:16:29.731092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.029901 (+2298809us) service_pool.cc:224] Handling call
0709 13:16:32.030309 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.030989 (+   680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.031203 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:31.950843 11659 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:32.034734  8766 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [4.3-8.5]
I20260709 13:16:32.035431  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1379) took 2303 ms. Trace:
I20260709 13:16:32.035768  8766 rpcz_store.cc:276] 0709 13:16:29.731745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.033815 (+2302070us) service_pool.cc:224] Handling call
0709 13:16:32.034279 (+   464us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:32.035161 (+   882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.035377 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.037045  8766 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:16:32.037644  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1384) took 2299 ms. Trace:
I20260709 13:16:32.037945  8766 rpcz_store.cc:276] 0709 13:16:29.738203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.036449 (+2298246us) service_pool.cc:224] Handling call
0709 13:16:32.036812 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.037407 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.037594 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.038769  8768 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:16:32.041604  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 351222us
I20260709 13:16:32.004839 11721 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:32.044929  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.046887  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:32.048098  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:32.048244  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:32.048889  9466 raft_consensus.cc:2393] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:32.048314  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:32.048983  9461 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:32.053840  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:32.054039  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:32.055920  9468 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:32.050892  8884 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.059716  8767 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:32.054806  9467 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:32.060571  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1390) took 2320 ms. Trace:
I20260709 13:16:32.061061  8767 rpcz_store.cc:276] 0709 13:16:29.740088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.041395 (+2301307us) service_pool.cc:224] Handling call
0709 13:16:32.059395 (+ 18000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.060256 (+   861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.060508 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.063412  9463 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:32.023264 11700 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:32.031808 11706 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.064429  8732 leader_election.cc:400] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:32.092063  8732 leader_election.cc:403] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:16:32.015462 11422 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:32.088644  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:32.053524 11708 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.088645  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.045265 11723 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.095374  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44715.2us
I20260709 13:16:32.107379  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.047742 11726 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.096892 11398 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.101539  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:32.118727  8884 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:32.127058  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.178233  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.182345 11723 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:32.184504 10947 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:32.211890  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:32.212627  9461 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.213337 11422 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.119143 11726 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:32.123831 11655 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:32.109423 11747 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:32.187321 11750 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:16:32.228281 11753 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.118s	user 0.001s	sys 0.001s
I20260709 13:16:32.233289  9461 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:32.183326 11659 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:32.242398  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.207556 11697 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.118003 11708 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:32.235076 11398 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.217769 11712 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.366783 11398 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.368848 11712 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:32.252538  8808 leader_election.cc:336] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.934s (SENT)
I20260709 13:16:32.369628  8914 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.369712 11398 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.370219  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:32.322185  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.371101 11694 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:32.371272  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 118790us
I20260709 13:16:32.372594 11697 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:32.195783 11748 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.373837 11697 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.374413  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:32.282857  9432 leader_election.cc:336] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.578s (SENT)
I20260709 13:16:32.375214  8837 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:32.246949 11723 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:32.375986  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:32.365306  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 300993us
I20260709 13:16:32.376796  8842 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:32.376703  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.377107  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.259701  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:32.378322  9461 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:32.378947  8837 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:32.379251 11706 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.379362 11708 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:32.366096  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 277545us
I20260709 13:16:32.321599  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.380650  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1430) took 1011 ms. Trace:
W20260709 13:16:32.375425  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 92631.9us
I20260709 13:16:32.381567  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:32.382153  9432 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.663s (SENT)
I20260709 13:16:32.236405 11721 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:32.382974  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.384167  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:32.384801  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.678s (SENT)
I20260709 13:16:32.386026  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.239459 11747 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.385064 11748 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.387143 11747 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.380686  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:32.388543  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155082us
I20260709 13:16:32.385318  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.381275  8918 rpcz_store.cc:276] 0709 13:16:31.368958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.764780 (+395822us) service_pool.cc:224] Handling call
0709 13:16:31.765143 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.765483 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.765506 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.765959 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.989845 (+223886us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:31.989888 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:31.989957 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.213036 (+223079us) raft_consensus.cc:1685] finished
0709 13:16:32.213055 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.380562 (+167507us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23173,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":223450,"threads_started":1,"wal-append.queue_time_us":303950}
I20260709 13:16:32.387341 11748 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:32.390136 11732 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:32.390447 11748 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.390993 11450 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:32.392264  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.385525  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.393319 11450 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.393766 11708 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:32.394721  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.396602  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:32.397722  8763 raft_consensus.cc:2376] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:16:32.398371  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1432) took 1175 ms. Trace:
I20260709 13:16:32.398801  8763 rpcz_store.cc:276] 0709 13:16:31.223027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.396339 (+1173312us) service_pool.cc:224] Handling call
0709 13:16:32.398299 (+  1960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.381651  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1441) took 1126 ms. Trace:
I20260709 13:16:32.400272  8760 rpcz_store.cc:276] 0709 13:16:31.255024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.262530 (+1007506us) service_pool.cc:224] Handling call
0709 13:16:32.381590 (+119060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.404553 11726 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:32.406679  8808 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.523s (SENT)
I20260709 13:16:32.421689  8911 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:32.422904  8760 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:32.423604  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1416) took 1666 ms. Trace:
I20260709 13:16:32.423913  8760 rpcz_store.cc:276] 0709 13:16:30.756911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.401295 (+1644384us) service_pool.cc:224] Handling call
0709 13:16:32.421754 (+ 20459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.423370 (+  1616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.423551 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.401686 11712 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:32.427459  9432 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.723s (SENT)
I20260709 13:16:32.427628  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.428097  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:32.426157 11754 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 13:16:32.427881 11745 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.431742 11730 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.480572  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:32.481256  9461 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:32.481331  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53875us
W20260709 13:16:32.480343  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 85706.2us
I20260709 13:16:32.484917  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.441413 11712 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.440991 11760 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.498787  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:32.450872 11706 raft_consensus.cc:2764] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:32.486063 10947 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:32.494211 11422 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:32.525795 11765 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.533455  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.536725  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.535848  9461 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:16:32.539127  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.540446  8918 raft_consensus.cc:2410] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:32.548801  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.549794  8911 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:32.555693  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:32.571748  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.524966 11745 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:32.587469  8808 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.682s (SENT)
I20260709 13:16:32.588001  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.531225 11422 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:32.610452  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:32.615540  8808 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.073s (SENT)
W20260709 13:16:32.616555  8808 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.094s (SENT)
I20260709 13:16:32.617031  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.617867  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.540446 11732 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.610226 11765 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:32.625385 11755 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:16:32.626754 11758 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:16:32.627874  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.629187  8918 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:16:32.611877  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75268us
I20260709 13:16:32.615268 11721 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:32.630522  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.530309 11747 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:32.562038 11708 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:32.634155  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 515504us
I20260709 13:16:32.641052  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:32.634555  8808 leader_election.cc:336] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.185s (SENT)
I20260709 13:16:32.645375  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1396) took 2806 ms. Trace:
I20260709 13:16:32.619252 11422 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.588966 11730 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:16:32.653031  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.665467 11748 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:32.672905 11759 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:16:32.674345  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1385) took 2935 ms. Trace:
I20260709 13:16:32.674795  8766 rpcz_store.cc:276] 0709 13:16:29.738502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.038638 (+2300136us) service_pool.cc:224] Handling call
0709 13:16:32.038951 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.041324 (+  2373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.041354 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.053316 (+ 11962us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.307123 (+253807us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:32.307192 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.307293 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.674010 (+366717us) raft_consensus.cc:1685] finished
0709 13:16:32.674030 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.674271 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2109,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":11877,"thread_start_us":212956,"threads_started":1,"wal-append.queue_time_us":363355}
I20260709 13:16:32.675982 11748 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:32.644718 11676 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.676591  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.676623 11676 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.677606  8766 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:32.678655  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.679338  8766 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:32.679782 11676 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:32.680239  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.681068  8766 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:16:32.681313 11757 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:16:32.682166  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.672530  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1391) took 2932 ms. Trace:
I20260709 13:16:32.682798  8766 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:32.684012  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:32.683130  8765 rpcz_store.cc:276] 0709 13:16:29.740374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.046005 (+2305631us) service_pool.cc:224] Handling call
0709 13:16:32.063855 (+ 17850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.108439 (+ 44584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.108477 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.395804 (+287327us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.487442 (+ 91638us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:32.487485 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.487556 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.672285 (+184729us) raft_consensus.cc:1685] finished
0709 13:16:32.672306 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.672462 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7891,"raft.queue_time_us":6564,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":4765,"thread_start_us":60270,"threads_started":1,"wal-append.queue_time_us":208302}
I20260709 13:16:32.684929  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:32.685231  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.685957  8911 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:32.686056  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:32.686592  8765 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.686877  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.688015  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.585595 11653 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:16:32.694296  8765 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:32.706064  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:32.699906 11422 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.683676  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.708072  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.708801  8766 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:32.709131  9432 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.005s (SENT)
I20260709 13:16:32.709535 11422 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:32.709867  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.710820  8766 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:32.711931  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.712724  8766 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:32.713150 11655 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:32.713752  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:32.714728  8766 raft_consensus.cc:2368] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9.
W20260709 13:16:32.714627  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 64097.3us
I20260709 13:16:32.715030  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1431) took 1341 ms. Trace:
I20260709 13:16:32.715867  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:32.716596  8766 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:32.696234 11747 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:32.706815  8765 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.721505  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.723145  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.724222  8909 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:32.728284  8765 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:32.731681  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 255) took 1423 ms. Trace:
I20260709 13:16:32.732524  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1624) took 1357 ms. Trace:
I20260709 13:16:32.734740 11701 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:32.715467  8916 rpcz_store.cc:276] 0709 13:16:31.373199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.822102 (+448903us) service_pool.cc:224] Handling call
0709 13:16:31.822440 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:31.822886 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.822916 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:31.823385 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:16:31.991934 (+168549us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:32.008032 (+ 16098us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.008835 (+   803us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.008949 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.708471 (+699522us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b18002476c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:32.714722 (+  6251us) raft_consensus.cc:1685] finished
0709 13:16:32.714839 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.714970 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8161,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2177,"raft.queue_time_us":6314,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":15437,"spinlock_wait_cycles":40088704,"thread_start_us":167477,"threads_started":1,"wal-append.queue_time_us":205234}
W20260709 13:16:32.759387  8808 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.246s (SENT)
I20260709 13:16:32.767115  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.761281  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1414) took 2180 ms. Trace:
I20260709 13:16:32.768400  8763 rpcz_store.cc:276] 0709 13:16:30.580989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.408963 (+1827974us) service_pool.cc:224] Handling call
0709 13:16:32.421252 (+ 12289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.425872 (+  4620us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:32.548763 (+122891us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.760938 (+212175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.760991 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:32.761036 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.761112 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.761206 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":97246,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":26093,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":213318,"threads_started":2,"wal-append.queue_time_us":148149}
W20260709 13:16:32.761401  9432 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.044s (SENT)
I20260709 13:16:32.770572  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.763247 11706 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.764839  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1386) took 3026 ms. Trace:
I20260709 13:16:32.715487  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:32.771704  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 127975us
I20260709 13:16:32.767302  8912 rpcz_store.cc:276] 0709 13:16:31.308717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.581889 (+273172us) service_pool.cc:224] Handling call
0709 13:16:31.612151 (+ 30262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.757840 (+145689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.731373 (+973533us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54001d2c54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:32.731617 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333292800}
I20260709 13:16:32.766655  8839 rpcz_store.cc:276] 0709 13:16:31.376747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.730443 (+353696us) service_pool.cc:224] Handling call
0709 13:16:31.742430 (+ 11987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.752523 (+ 10093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:31.752576 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.752621 (+    45us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:31.752666 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.732252 (+979586us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b54000ad554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:32.732294 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.732452 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":29949,"spinlock_wait_cycles":10589440}
I20260709 13:16:32.775266  8768 rpcz_store.cc:276] 0709 13:16:29.738835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.039453 (+2300618us) service_pool.cc:224] Handling call
0709 13:16:32.039714 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.065231 (+ 25517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.065262 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.089758 (+ 24496us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.205830 (+116072us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:32.205902 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.713958 (+508056us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54001a8954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:32.714022 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.714098 (+    76us) raft_consensus.cc:1685] finished
0709 13:16:32.714115 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.764694 (+ 50579us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10521,"raft.queue_time_us":11111,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":22743,"spinlock_wait_cycles":33524096,"thread_start_us":104348,"threads_started":1,"wal-append.queue_time_us":384138}
I20260709 13:16:32.780769  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.781889  8763 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.782366  8916 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:32.782922  8768 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:32.784220  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1421) took 1592 ms. Trace:
I20260709 13:16:32.784829  8768 rpcz_store.cc:276] 0709 13:16:31.192167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.782149 (+1589982us) service_pool.cc:224] Handling call
0709 13:16:32.782515 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.783979 (+  1464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.784169 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.787030  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1424) took 1594 ms. Trace:
I20260709 13:16:32.787112  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:32.787714  8766 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:32.788698  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 73317.6us
I20260709 13:16:32.790345  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1419) took 1591 ms. Trace:
I20260709 13:16:32.788754  8768 rpcz_store.cc:276] 0709 13:16:31.193035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.785962 (+1592927us) service_pool.cc:224] Handling call
0709 13:16:32.786336 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.786570 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.786607 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.786669 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:32.786725 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.786808 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.786959 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.790925  8763 rpcz_store.cc:276] 0709 13:16:31.191564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.770273 (+1578709us) service_pool.cc:224] Handling call
0709 13:16:32.781723 (+ 11450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.782290 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.782482 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.792793  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.794118  8768 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:32.795284  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1398) took 1452 ms. Trace:
I20260709 13:16:32.637849 11745 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.780215  8765 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:32.797850  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1418) took 1606 ms. Trace:
I20260709 13:16:32.795885  8768 rpcz_store.cc:276] 0709 13:16:31.343089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.793237 (+1450148us) service_pool.cc:224] Handling call
0709 13:16:32.793699 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.794940 (+  1241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.795209 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.797925  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.798219  8765 rpcz_store.cc:276] 0709 13:16:31.191097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.729316 (+1538219us) service_pool.cc:224] Handling call
0709 13:16:32.773764 (+ 44448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.797618 (+ 23854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.797799 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.773762 11697 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.780468 11653 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:32.784191 11760 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:32.800419  8768 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:16:32.853121  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50167.4us
W20260709 13:16:32.795027 11698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.001s	sys 0.025s
I20260709 13:16:32.853008  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1399) took 1509 ms. Trace:
I20260709 13:16:32.853365  8765 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:32.789053 11655 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.788656 11676 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.855880  8768 rpcz_store.cc:276] 0709 13:16:31.343333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.799032 (+1455699us) service_pool.cc:224] Handling call
0709 13:16:32.799999 (+   967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.822999 (+ 23000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.852942 (+ 29943us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325824}
I20260709 13:16:32.870191  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1402) took 1526 ms. Trace:
I20260709 13:16:32.870563  8768 rpcz_store.cc:276] 0709 13:16:31.344087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.869260 (+1525173us) service_pool.cc:224] Handling call
0709 13:16:32.869564 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.869761 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.869785 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.869837 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:32.869911 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.869980 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.870111 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:32.871474 11772 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:16:32.856969 11698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.017s	sys 0.029s
I20260709 13:16:32.876729  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1417) took 1746 ms. Trace:
I20260709 13:16:32.877276  8760 rpcz_store.cc:276] 0709 13:16:31.130531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.424887 (+1294356us) service_pool.cc:224] Handling call
0709 13:16:32.431366 (+  6479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.433600 (+  2234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:32.433642 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:32.478451 (+ 44809us) log.cc:844] Serialized 26 byte log entry
0709 13:16:32.631890 (+153439us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:32.631932 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.632004 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:32.876464 (+244460us) raft_consensus.cc:1685] finished
0709 13:16:32.876488 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.876657 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":471,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":8179,"thread_start_us":106565,"threads_started":1,"wal-append.queue_time_us":301799}
W20260709 13:16:32.878907  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.823096 11760 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.854759  9459 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:32.882191 11760 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.855412  8732 leader_election.cc:400] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:32.792009 11398 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.886029  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1428) took 1517 ms. Trace:
I20260709 13:16:32.890905  8910 rpcz_store.cc:276] 0709 13:16:31.368358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.473937 (+105579us) service_pool.cc:224] Handling call
0709 13:16:32.885843 (+1411906us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400259254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:32.885970 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":368396672}
I20260709 13:16:32.803810 11697 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:32.886659  8915 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:16:32.888386  9462 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:32.889189  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57248.6us
I20260709 13:16:32.898294  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.904127  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.907891  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.909011  8836 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:32.910467 11776 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:32.910861  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.911334  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.911579  8841 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:32.911780  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.912009  8838 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:32.910949  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.914485  8732 leader_election.cc:400] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:32.857574  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1401) took 1513 ms. Trace:
I20260709 13:16:32.866706  9461 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:32.915669  8765 rpcz_store.cc:276] 0709 13:16:31.343835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.799067 (+1455232us) service_pool.cc:224] Handling call
0709 13:16:32.852905 (+ 53838us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.857290 (+  4385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.857505 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:32.860630  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.857448  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1429) took 1488 ms. Trace:
I20260709 13:16:32.917276  8918 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:32.917335  8917 rpcz_store.cc:276] 0709 13:16:31.368642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.589565 (+220923us) service_pool.cc:224] Handling call
0709 13:16:31.589876 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:31.612692 (+ 22816us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:31.670983 (+ 58291us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.870703 (+199720us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.871108 (+   405us) log.cc:844] Serialized 14 byte log entry
0709 13:16:31.871241 (+   133us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:31.871281 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:31.871326 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.823601 (+952275us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54002940d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:32.853275 (+ 29674us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.857378 (+  4103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1605,"prepare.queue_time_us":153330,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":111,"raft.queue_time_us":4633,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":46001,"spinlock_wait_cycles":51818752,"thread_start_us":254739,"threads_started":2,"wal-append.queue_time_us":262100}
I20260709 13:16:32.912366  8837 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:32.923437  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.924310  8844 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:32.858650 11449 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:32.931267  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.933411  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:32.947638  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.941504  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.953403  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.955338  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:32.956005  8808 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.704s (SENT)
I20260709 13:16:32.956806  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:32.957223  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:32.959218  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:32.961776  8918 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:32.859531 11745 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:32.941928 11738 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.963459  8910 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:32.862278 11384 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:32.935153 11692 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:32.935724 11655 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:32.966342  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:32.963941  8917 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:32.984273  8917 pending_rounds.cc:85] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 2
I20260709 13:16:32.984540  8917 pending_rounds.cc:107] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:32.984786  8917 raft_consensus.cc:2889] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.961584 11708 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:32.981354 11738 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:32.986207 11789 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:32.986868  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.987046  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.969120 11676 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:32.997098  8840 raft_consensus.cc:2410] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:32.988674  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:32.999867  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:32.996464 11789 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:33.005362 11789 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:32.973877 11712 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:33.008977 11760 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.010416  8909 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:33.010408 11712 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.011431 11760 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:33.018057 11398 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:32.982007 11697 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:33.027885  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1426) took 1660 ms. Trace:
I20260709 13:16:33.028537  8914 rpcz_store.cc:276] 0709 13:16:31.367801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.589497 (+221696us) service_pool.cc:224] Handling call
0709 13:16:31.921031 (+331534us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b58001d1f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:31.921186 (+   155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.370292 (+449106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.027556 (+657264us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54000fc654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:33.027795 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1032927232}
I20260709 13:16:33.000934  8918 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:33.036324  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.033834  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:33.040642  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.042058  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 258) took 3350 ms (client timeout 1979 ms). Trace:
W20260709 13:16:33.042702  8835 rpcz_store.cc:269] 0709 13:16:29.675604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:29.675757 (+   153us) service_pool.cc:224] Handling call
0709 13:16:33.025953 (+3350196us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400415d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:33.026165 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3806449536}
I20260709 13:16:33.022644 11789 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.047683  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.048043  9459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 327) took 1410 ms. Trace:
I20260709 13:16:33.049543  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 405) took 1214 ms. Trace:
I20260709 13:16:33.049971  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.049983  9468 rpcz_store.cc:276] 0709 13:16:31.835056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.835203 (+   147us) service_pool.cc:224] Handling call
0709 13:16:31.859012 (+ 23809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.056517 (+197505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.049278 (+992761us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400651b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:33.049468 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452216192}
W20260709 13:16:33.052300  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.052716 11789 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:33.059332 11706 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.061446  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.062054  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.062608  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1425) took 1869 ms. Trace:
I20260709 13:16:33.048457  8916 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:33.062985  8766 rpcz_store.cc:276] 0709 13:16:31.193323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.791670 (+1598347us) service_pool.cc:224] Handling call
0709 13:16:32.792093 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.799370 (+  7277us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:32.885234 (+ 85864us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.061104 (+175870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.062301 (+  1197us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:33.062369 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.062432 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.062553 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30404,"prepare.queue_time_us":64563,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"thread_start_us":151431,"threads_started":1}
I20260709 13:16:33.064910  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:33.073170  8809 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:33.072773  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 115700us
I20260709 13:16:32.994254  9461 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:32.645953  8767 rpcz_store.cc:276] 0709 13:16:29.839129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.062226 (+2223097us) service_pool.cc:224] Handling call
0709 13:16:32.062607 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.062862 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:32.174804 (+111942us) log.cc:844] Serialized 14 byte log entry
0709 13:16:32.644820 (+470016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:32.644941 (+   121us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:32.645012 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:32.645104 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:32.645292 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":388007,"prepare.run_cpu_time_us":295,"prepare.run_wall_time_us":5130,"raft.queue_time_us":4236,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3332,"thread_start_us":482945,"threads_started":2,"wal-append.queue_time_us":567209}
I20260709 13:16:32.969895 11779 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.995919  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.082274  8839 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:33.080410  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 262481us
I20260709 13:16:33.094777  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.096694  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.092826  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:33.092821  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 136850us
I20260709 13:16:33.099644  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:33.101387  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.100613  8911 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
W20260709 13:16:33.102005  8808 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.798s (SENT)
I20260709 13:16:33.105602  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.110474 11695 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:33.111878  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:33.112000  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:33.112895  8916 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.113229  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1397) took 1770 ms. Trace:
I20260709 13:16:33.113734  8763 rpcz_store.cc:276] 0709 13:16:31.342810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.792969 (+1450159us) service_pool.cc:224] Handling call
0709 13:16:32.800106 (+  7137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.800301 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:32.852995 (+ 52694us) log.cc:844] Serialized 14 byte log entry
0709 13:16:33.112598 (+259603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:33.112752 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:33.112804 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.113036 (+   232us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:33.113162 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24241,"prepare.queue_time_us":82848,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":203306,"threads_started":1}
I20260709 13:16:33.081911 11692 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.081748 11676 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:33.130002  8840 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:33.136519  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.138775  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:33.139559  8838 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:33.141444  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:33.144323  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:33.145476  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.125852  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:33.081851 11779 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:33.099712 11482 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:33.149778  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.153817  8882 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.048424  9459 rpcz_store.cc:276] 0709 13:16:31.637890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.639906 (+  2016us) service_pool.cc:224] Handling call
0709 13:16:32.730362 (+1090456us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:32.764783 (+ 34421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:32.882273 (+117490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.047752 (+165479us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b5400650ed4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:33.047961 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73484928}
I20260709 13:16:33.163007  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.158331  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.164026  8844 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.164220  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.159124  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.165274  8836 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.076778 11786 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:16:33.172138  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.116627 11655 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.116350 11781 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:33.154352 11698 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:33.147433 11676 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:33.169868 11736 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.463s	user 0.023s	sys 0.042s
I20260709 13:16:33.152768 11398 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.173687 11713 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.146922 11692 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:33.185500  8836 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:33.186750  8916 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:33.173261 11723 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.193598  8910 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:33.183918  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.195652  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.197116 11422 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.193712 11723 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.199046 11723 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:33.201725  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.202169 11422 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:33.203534 11422 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.175597 11789 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:33.173100 11482 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:33.189085  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 94436us
I20260709 13:16:33.179633 11781 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.162798 11760 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:33.182624 11697 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:33.229658  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 79994.8us
W20260709 13:16:33.189481 11736 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.486s	user 0.023s	sys 0.042s
I20260709 13:16:33.182435 11676 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:33.155205 11787 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:16:33.184721 11748 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:33.175287 11730 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:16:33.188512 11698 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:33.187783 11728 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.170571 11721 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:16:33.240792  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.273455 11789 raft_consensus.cc:2764] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:33.273922  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.275357  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.274001 11728 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.277245 11728 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.231134 11745 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.281276 11745 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.281476 11788 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.281886 11745 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:33.282397 11788 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.285813  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.244881 11731 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:33.287227 11789 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:33.287365 11785 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:33.287609  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:33.288621  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.288939 11698 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:33.290433 11789 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.242249  8769 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1426) took 2048 ms (client timeout 1731 ms). Trace:
I20260709 13:16:33.222306 11692 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.296123  8769 rpcz_store.cc:269] 0709 13:16:31.193604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.241973 (+2048369us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:33.242129 (+   156us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:33.222798 11713 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.229835 11781 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:33.297158 11713 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.248365 11168 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:16:33.254298  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.299506 11168 consensus_queue.cc:1243] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:16:33.299640  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45430.3us
I20260709 13:16:33.300983  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.301537  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 239) took 2013 ms. Trace:
I20260709 13:16:33.301966  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.303628  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.255394 11723 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.305176 11449 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.306143 11449 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.307006 11723 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:33.306818 11449 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.256567 11482 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:33.235284 11697 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:33.267707 11760 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:33.235270 11779 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:33.308076  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.245405  8844 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:33.302022  8915 rpcz_store.cc:276] 0709 13:16:31.288115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.541991 (+253876us) service_pool.cc:224] Handling call
0709 13:16:32.886439 (+1344448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:32.892343 (+  5904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.301328 (+408985us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400259250. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:33.301478 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3039794944}
W20260709 13:16:33.255331  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.362655  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 57800.5us
I20260709 13:16:33.310132  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:16:33.363942  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53948.5us
I20260709 13:16:33.364117  8884 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.364709  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.313390  8836 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:33.328218  8843 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:16:33.331274  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 135724us
W20260709 13:16:33.299257 11775 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.536s	user 0.003s	sys 0.000s
I20260709 13:16:33.366482  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.376471  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.307749 11723 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:33.379519  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:33.381542  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:33.382424  8763 raft_consensus.cc:2368] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11.
I20260709 13:16:33.383584  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.384810  8882 leader_election.cc:400] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9.
I20260709 13:16:33.385946  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.310292 11449 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.353216 11697 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:33.380645 11736 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:33.387387 11747 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:33.407797 11782 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.407889  8838 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:33.390231 11712 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:33.409117  9460 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:33.411628 11692 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.413067 11748 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:33.425334  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:33.382977 11655 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.390810 11779 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:33.432763  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.433341  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:33.389292 11723 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:33.437614  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:33.438129  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.429951 11747 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.374514 11760 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.455667  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:33.442484  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:33.398806 11384 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:33.396567 11736 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.404040 11789 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:33.406145 11422 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.444820  8768 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:16:33.405869 11398 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:33.437304  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 343274us
W20260709 13:16:33.447397  8808 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.729s (SENT)
I20260709 13:16:33.448033  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:33.456488  8769 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.440055 11737 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:33.462194  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:33.471910  8765 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:33.443740 11748 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.467471  8767 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
W20260709 13:16:33.467483  8808 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.731s (SENT)
I20260709 13:16:33.488045  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:33.468233  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.443537 11712 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:33.470326 11422 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:33.456434 11747 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:33.512410  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:33.511021 11422 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.464957  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 330) took 1784 ms. Trace:
I20260709 13:16:33.461951 11384 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:33.465991 11736 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.470598 11737 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:33.527122  8735 leader_election.cc:336] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.596s (SENT)
W20260709 13:16:33.527487  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 291577us
I20260709 13:16:33.529835  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:33.509110 11798 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:33.447968 11781 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:33.534353 11789 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:33.529254 11384 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:33.557723  8735 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.626s (SENT)
I20260709 13:16:33.528347 11802 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:33.596673  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:33.599741  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65632.4us
I20260709 13:16:33.510110 11745 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:33.606976  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61316us
W20260709 13:16:33.611380 11792 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:16:33.612066 11786 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:33.612979 11800 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:33.613265 11434 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:33.615438 11805 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:33.621107 11789 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:33.620841  8769 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
W20260709 13:16:33.622475  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64796us
I20260709 13:16:33.534435 11728 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.635146  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:33.657665  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 206259us
I20260709 13:16:33.544736 11638 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:16:33.642277 11802 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:33.521976  9460 rpcz_store.cc:276] 0709 13:16:31.676649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.681258 (+  4609us) service_pool.cc:224] Handling call
0709 13:16:33.374971 (+1693713us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:16:33.397628 (+ 22657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:33.443346 (+ 45718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.461101 (+ 17755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3922304}
I20260709 13:16:33.676930  8909 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:33.681890  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:33.683256  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.683961  8916 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:33.685434  8915 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:33.689733  8842 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:16:33.690348  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:33.544446 11723 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:33.665343 11789 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:33.706807  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.690862  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.691954  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.708489  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.710912  8910 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:33.712846  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.713459  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.713905  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.714244  8914 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:33.715116  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.712920  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.717068  8842 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:33.712282 11434 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:16:33.719272  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:33.728880  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:33.740794  8914 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.745456  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.712036 11789 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:33.761049  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:33.655937 11712 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.708060 11692 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:33.768497  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:33.778041  8808 leader_election.cc:336] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.883s (SENT)
I20260709 13:16:33.781363  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:33.789927  8912 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:33.789966  8808 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.941s (SENT)
I20260709 13:16:33.791316  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:33.757848 11655 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:33.708554 11398 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:33.776444 11769 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:16:33.769961 11789 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:33.810602  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129084us
I20260709 13:16:33.777561 11629 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:33.641427 11737 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:33.816998  8808 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.005s (SENT)
I20260709 13:16:33.817476  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:33.819242 11808 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:16:33.819955 11786 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.816586  8914 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
W20260709 13:16:33.823348  8808 leader_election.cc:336] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.071s (SENT)
I20260709 13:16:33.824049  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.825371 11721 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:33.825866  8808 leader_election.cc:336] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.088s (SENT)
I20260709 13:16:33.826550  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:33.828655 11786 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:33.829407  8761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1440) took 2574 ms (client timeout 1682 ms). Trace:
I20260709 13:16:33.829722  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.832744  8914 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:33.829813  8761 rpcz_store.cc:269] 0709 13:16:31.254763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.829090 (+2574327us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:33.829333 (+   243us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:33.833571  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.836100  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.787643 11760 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:33.838759  8914 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:33.807933 11713 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.510s	user 0.011s	sys 0.000s
I20260709 13:16:33.796972 11811 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:33.831621 11810 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:16:33.860299 11706 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:33.794855 11638 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:33.830749 11782 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:16:33.862828  8917 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:33.863365 11813 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:16:33.786778 11819 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
W20260709 13:16:33.820442 11806 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:16:33.861943 11781 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:33.850196  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:33.927981  8914 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:16:33.928324 11823 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.151s	user 0.000s	sys 0.002s
W20260709 13:16:33.930490  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.861830  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:33.887060  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 210378us
I20260709 13:16:33.839488 11655 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:33.935362  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 141406us
I20260709 13:16:33.896062  8912 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:33.861462 11713 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.903146 11738 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:33.926105  8911 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:33.937578  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:33.941313  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:33.945194  9464 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:16:33.953616  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:33.961024  8918 raft_consensus.cc:2410] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:16:33.807050 11802 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:33.965713  8915 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:33.901216 11745 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:33.970470  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:33.976790  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.977326  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:33.981637  8808 leader_election.cc:336] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.135s (SENT)
I20260709 13:16:33.982302  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:33.992362 11731 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:33.993913 11737 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:33.997540  9460 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:33.999099 11655 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:33.943876 11728 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:34.003753 11713 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:33.973664 11831 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.009600 11831 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:34.011531 11676 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.002s
I20260709 13:16:34.011972 11676 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:34.013191  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:34.017239  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46855.5us
I20260709 13:16:33.943130 11738 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:34.026947  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.029506  8836 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.028128  8843 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
W20260709 13:16:34.028522  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 166770us
I20260709 13:16:34.030519  8843 pending_rounds.cc:85] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 3
I20260709 13:16:34.030872  8843 pending_rounds.cc:107] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:34.030941  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:34.031224  8843 raft_consensus.cc:2889] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:34.035636  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 103920us
I20260709 13:16:34.039435  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:34.042059  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.042690  8839 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.044593  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.045382  8841 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:34.046013  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:34.056517  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.031980 11779 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:34.057356  8843 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:34.057554  8835 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:34.063060  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.064050  8769 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:33.939594 11398 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.036919 11732 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.047431 11638 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:34.080796  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:34.081470  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.090634  8761 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:16:34.093561  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.100962  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.101212  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.101686  8762 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.101708  8765 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.102798  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:34.108163  8839 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:34.110467  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.111152  8769 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:34.112048  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.112676  8769 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:34.113741  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.114629  8767 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:34.114805  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 43612.9us
I20260709 13:16:34.117897  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:34.113070  8836 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:34.125597  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.126295  8769 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.127375  8761 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:34.128055  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 43901.8us
I20260709 13:16:34.129949  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.088884 11638 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:34.087711 11831 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:34.139014 11828 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:34.139601 11827 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:34.139984  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:34.140255  8917 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:34.140802 11384 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 13:16:34.141320 11384 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.142761  8916 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:34.149428 11697 consensus_meta.cc:287] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.724s	user 0.003s	sys 0.008s
I20260709 13:16:34.149554 11846 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.150064 11697 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.070495 11738 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:34.151808 11748 consensus_meta.cc:287] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.635s	user 0.004s	sys 0.007s
I20260709 13:16:34.267897  8765 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:34.176820  8769 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:34.272011  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:34.183812  9464 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
W20260709 13:16:34.258396 11747 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:16:34.279999  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.281268  8769 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:34.136427 11638 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.283111  8840 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.282961  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.285480  8765 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.255362 11676 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:34.273998 11748 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.288950 10947 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.289626 10947 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.290345 11748 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:34.290949 11747 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.293129 11747 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:34.295926 11725 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:34.255811 11830 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:34.298326  8765 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:34.260190 11698 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:34.184998 11422 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.005s
I20260709 13:16:34.161298 11812 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:34.156140 11782 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:34.161037 11834 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:34.161722 11832 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.162055 11801 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.344s
I20260709 13:16:34.136042 11819 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.149s
I20260709 13:16:34.275821 11731 raft_consensus.cc:2764] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:34.161496 11825 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.152s
I20260709 13:16:34.161592 11829 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.376s
I20260709 13:16:34.338223 11829 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:34.338800 11829 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:34.133685 11840 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.259s
I20260709 13:16:34.307386 11830 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.345850 11830 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:34.350934 11826 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.479s	user 0.001s	sys 0.000s
W20260709 13:16:34.351379 11736 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.004s
I20260709 13:16:34.317097  8910 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:34.351889 11736 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.303691 11698 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:34.357160 11698 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.359725  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.360426  8841 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:34.361194  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.315894 11782 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.321558 11832 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.365782 11782 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:34.366583 11832 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:34.316314 11834 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.374703 11821 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.375427 11821 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.378835  8764 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 13:16:34.379343  8764 pending_rounds.cc:85] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 9
I20260709 13:16:34.379588  8764 pending_rounds.cc:107] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:16:34.379861  8764 raft_consensus.cc:2889] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:34.385664  8762 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:34.381644  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:34.392647  9464 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:34.298651 11789 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.323467 11779 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:34.339946 11829 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.387209 11172 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.420428  8766 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:16:34.311296 11422 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.391702 11821 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:34.434671  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 251) took 1001 ms. Trace:
I20260709 13:16:34.435149  8760 rpcz_store.cc:276] 0709 13:16:33.433726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.433855 (+   129us) service_pool.cc:224] Handling call
0709 13:16:33.440741 (+  6886us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:33.450834 (+ 10093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:33.450865 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:33.465556 (+ 14691us) log.cc:844] Serialized 26 byte log entry
0709 13:16:33.709563 (+244007us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:33.709602 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:33.709666 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:34.350220 (+640554us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:34.424953 (+ 74733us) raft_consensus.cc:1685] finished
0709 13:16:34.424985 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:34.434590 (+  9605us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":176,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":6794,"spinlock_wait_cycles":38066560,"thread_start_us":186341,"threads_started":1,"wal-append.queue_time_us":288035}
I20260709 13:16:34.436736  8915 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:34.438074  8915 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:34.439514  8767 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:34.446465 11405 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.454752 11723 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:34.458719  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:34.461120  8760 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:34.461364  8841 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:34.454846 11789 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:34.469064  8909 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:34.473112 11638 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.475782 11638 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:34.488987  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:34.491786  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.496039  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:34.497143 11695 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:34.497352  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:34.497572 11695 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:34.497977 11695 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.439709 11760 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:34.411341 11798 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:16:34.513608  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:34.514827  8837 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:34.531800  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:34.534060  8882 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:34.441404 11172 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.505561 11765 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:34.539067  8917 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:34.543154  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 124175us
I20260709 13:16:34.554767 11748 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:34.555392 11748 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:34.556306 11748 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:34.557421  8808 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.022s (SENT)
I20260709 13:16:34.557914  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:34.563500  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 183763us
I20260709 13:16:34.564143 11695 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.558488 11825 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:16:34.568015  8913 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:34.568929 11701 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.568977 11736 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:34.569484 11701 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.570822  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 254) took 1126 ms. Trace:
I20260709 13:16:34.571187  8766 rpcz_store.cc:276] 0709 13:16:33.444660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.455607 (+ 10947us) service_pool.cc:224] Handling call
0709 13:16:33.455927 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.426162 (+970235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.570536 (+144374us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b540017dc54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:34.570755 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2217390848}
I20260709 13:16:34.572361  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.515062 11760 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:34.574635  8766 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:34.577780  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:34.538160 11821 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:34.594504  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.595252  8761 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.596045  8766 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:34.540934 11834 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:34.573521 11723 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:34.534783 11638 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:34.637485  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.659305  8766 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:34.669903  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.670773  8762 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:34.605471 11168 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.605791 11655 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:34.582129 11840 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:16:34.642989 11821 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:34.666301 11652 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.677286 11736 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:34.737857 11849 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:16:34.740316  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.741717  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.742304  8763 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:34.741832 11652 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.750581 11798 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.751392 11798 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.597651 11830 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.535795 11779 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.644174 11789 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.754881  8761 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:34.759492  8762 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:34.765142  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:34.764990  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:34.766072  8842 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:34.766932  8763 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:34.767393  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:34.767895  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.769059  8842 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:34.781890  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:34.768508  8763 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:34.782680  8761 raft_consensus.cc:2376] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:16:34.787521  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:34.724323 11787 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:34.714067 11655 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.702066 11168 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.696081 11760 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:34.792805  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:35.457038  8843 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:34.761798 11736 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:34.828725 11850 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.461333  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:35.462257 11850 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.002245  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1599) took 1769 ms. Trace:
I20260709 13:16:35.463626  8835 rpcz_store.cc:276] 0709 13:16:33.233026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.313637 (+ 80611us) service_pool.cc:224] Handling call
0709 13:16:33.379963 (+ 66326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.060177 (+680214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.001983 (+941806us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b54001d9f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:35.002178 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557887360}
I20260709 13:16:35.466202 11850 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:34.980304  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1469) took 1228 ms. Trace:
I20260709 13:16:34.784264 11830 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.454191  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:35.501631  8844 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.255378 11819 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:35.217588 11364 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:34.984691 11384 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:35.415096  8733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.003s	sys 0.006s
W20260709 13:16:35.515250  8733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.004s	sys 0.006s
I20260709 13:16:35.468849 11787 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.001420  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1585) took 1868 ms. Trace:
I20260709 13:16:35.519424  8840 rpcz_store.cc:276] 0709 13:16:33.133130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.134717 (+  1587us) service_pool.cc:224] Handling call
0709 13:16:33.135101 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.285188 (+1150087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.001093 (+715905us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540028f5d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:35.001338 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639481600}
W20260709 13:16:35.326478 11861 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
I20260709 13:16:35.487097 11832 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:35.342871  8769 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.013s
I20260709 13:16:34.801963  8766 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:34.941088 11793 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:34.939935  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:35.445327 11698 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.088s	user 0.014s	sys 0.000s
I20260709 13:16:35.478480  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:35.479066 11816 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.726s	user 0.007s	sys 0.012s
I20260709 13:16:35.479343 11870 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:35.454182  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.481887  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1687) took 1801 ms. Trace:
W20260709 13:16:35.484653  8837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 275) took 1977 ms (client timeout 2112 ms). Trace:
W20260709 13:16:35.543928  8837 rpcz_store.cc:269] 0709 13:16:33.507482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.507784 (+   302us) service_pool.cc:224] Handling call
0709 13:16:35.484422 (+1976638us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540021cd54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:35.484581 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264289536}
I20260709 13:16:34.788107 11789 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:35.485553  8734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.026s
W20260709 13:16:35.547748  8734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.000s	sys 0.026s
W20260709 13:16:35.056821 11857 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.356s	user 0.000s	sys 0.000s
I20260709 13:16:35.490727  8917 rpcz_store.cc:276] 0709 13:16:33.752082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.281912 (+529830us) service_pool.cc:224] Handling call
0709 13:16:34.538874 (+256962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.541074 (+  2200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.980036 (+438962us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002940d0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:34.980220 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532697984}
I20260709 13:16:35.495903  8843 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:35.056162 11701 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:35.615127  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.607573  8843 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:35.055970 11856 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
W20260709 13:16:35.520159  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 158728us
I20260709 13:16:35.525941  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:35.538225  8842 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.537074 11793 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:35.539249  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:35.537081  8769 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.011s	sys 0.013s
I20260709 13:16:35.540719  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.496299 11736 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.513029 11697 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:35.546746  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.543310  8909 rpcz_store.cc:276] 0709 13:16:33.680619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.751745 (+ 71126us) service_pool.cc:224] Handling call
0709 13:16:35.481641 (+1729896us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b5400410854. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:35.481813 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558253440}
I20260709 13:16:35.609222  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:35.610596  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.611927  9463 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:35.612290  8844 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:35.536480  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:35.540513 11798 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.617769  8843 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.734659  8843 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.624050  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.735946  8768 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:35.736536  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1463) took 1001 ms. Trace:
I20260709 13:16:35.736940  8768 rpcz_store.cc:276] 0709 13:16:34.735003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.623783 (+888780us) service_pool.cc:224] Handling call
0709 13:16:35.736463 (+112680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.627552 11652 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.053026 11821 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:35.612836 11868 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:16:35.671133  8767 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:35.741333  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1457) took 1007 ms. Trace:
I20260709 13:16:35.741712  8767 rpcz_store.cc:276] 0709 13:16:34.733568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.543129 (+809561us) service_pool.cc:224] Handling call
0709 13:16:35.741271 (+198142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.520231 11364 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.621284 10947 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.694010  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:35.542574 11698 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.757864 11829 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:35.542358 11832 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.687024 11873 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.688437 11736 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.547215 11870 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.634465 11841 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.718866  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1471) took 1946 ms. Trace:
I20260709 13:16:35.632413  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:35.796288  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1471) took 1059 ms. Trace:
I20260709 13:16:35.796609  8766 rpcz_store.cc:276] 0709 13:16:34.736777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.539063 (+802286us) service_pool.cc:224] Handling call
0709 13:16:35.796231 (+257168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.633411  8763 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:35.797518  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.797995  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1451) took 1099 ms. Trace:
I20260709 13:16:35.798131  8766 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:35.798359  8763 rpcz_store.cc:276] 0709 13:16:34.699010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.493096 (+794086us) service_pool.cc:224] Handling call
0709 13:16:35.797939 (+304843us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.798642  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1445) took 1101 ms. Trace:
I20260709 13:16:35.639379  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:35.798956  8766 rpcz_store.cc:276] 0709 13:16:34.697416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.797255 (+1099839us) service_pool.cc:224] Handling call
0709 13:16:35.798590 (+  1335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.799420  8840 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:35.799834  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.800455  8766 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:35.674150 11871 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:35.726701  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 263892us
I20260709 13:16:35.802266  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:35.803150  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:35.803743  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1464) took 1068 ms. Trace:
I20260709 13:16:35.804597  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:35.631904 11876 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:35.728531  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 267) took 1795 ms. Trace:
I20260709 13:16:35.738549  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1613) took 1380 ms. Trace:
I20260709 13:16:35.740000  8842 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:35.741083  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:35.670099  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:35.751446  8765 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.747691 11652 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.755805 11364 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.757999 11698 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:35.518883 11819 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:35.782613 11872 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:35.781107  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:35.738422 11692 consensus_queue.cc:1175] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdb96be202c2447586477b2077b7d5bf" responder_term: 8 status { last_received { term: 8 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:35.807595  8836 rpcz_store.cc:276] 0709 13:16:34.358403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.363107 (+  4704us) service_pool.cc:224] Handling call
0709 13:16:34.363373 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.363695 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.363722 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.364156 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.537464 (+173308us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:34.537510 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.537587 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.738322 (+1200735us) raft_consensus.cc:1685] finished
0709 13:16:35.738344 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.738487 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5567,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":172871,"threads_started":1,"wal-append.queue_time_us":227605}
I20260709 13:16:35.807540  8918 rpcz_store.cc:276] 0709 13:16:33.933180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.357063 (+423883us) service_pool.cc:224] Handling call
0709 13:16:34.357422 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.357887 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.357920 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.358444 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.474054 (+115610us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:34.474949 (+   895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.475049 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.727978 (+1252929us) raft_consensus.cc:1685] finished
0709 13:16:35.728206 (+   228us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.728441 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11131,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":76,"thread_start_us":115095,"threads_started":1,"wal-append.queue_time_us":223970}
I20260709 13:16:35.792622 11736 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.814471 10947 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:35.835549 10947 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:35.835937 10947 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.836792 11832 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:35.837193 11870 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:35.837380 11832 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:35.838095 11789 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.837915 11832 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.725030 11793 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.839448 11168 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.801193 11871 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.839391 11793 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.783102 11695 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:35.794248  8910 rpcz_store.cc:276] 0709 13:16:33.772489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.352752 (+580263us) service_pool.cc:224] Handling call
0709 13:16:34.353413 (+   661us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:34.353860 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.353896 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:34.382504 (+ 28608us) log.cc:844] Serialized 52 byte log entry
0709 13:16:34.537018 (+154514us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:34.537067 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.537139 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.718550 (+1181411us) raft_consensus.cc:1685] finished
0709 13:16:35.718582 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.718777 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14928,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":91479,"threads_started":1,"wal-append.queue_time_us":293375}
I20260709 13:16:35.826555  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:35.846913  8763 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:35.827507  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1468) took 1091 ms. Trace:
I20260709 13:16:35.847330  8767 rpcz_store.cc:276] 0709 13:16:34.736121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.742454 (+1006333us) service_pool.cc:224] Handling call
0709 13:16:35.827445 (+ 84991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.831322  8765 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:35.807693 11841 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.804345  8766 rpcz_store.cc:276] 0709 13:16:34.735241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.799596 (+1064355us) service_pool.cc:224] Handling call
0709 13:16:35.803642 (+  4046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.855902  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.853472  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1446) took 1313 ms. Trace:
I20260709 13:16:35.856878  8765 rpcz_store.cc:276] 0709 13:16:34.539667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.637938 (+1098271us) service_pool.cc:224] Handling call
0709 13:16:35.853388 (+215450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.858143  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:35.859601  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.871809  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1466) took 1136 ms. Trace:
I20260709 13:16:35.872231  8765 rpcz_store.cc:276] 0709 13:16:34.735685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.859259 (+1123574us) service_pool.cc:224] Handling call
0709 13:16:35.871748 (+ 12489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.873307  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.874097  8765 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:35.875010  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.875586  8765 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:35.825448 11830 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:35.861238  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1467) took 1125 ms. Trace:
I20260709 13:16:35.878222  8766 rpcz_store.cc:276] 0709 13:16:34.735903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.855594 (+1119691us) service_pool.cc:224] Handling call
0709 13:16:35.861155 (+  5561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.879313  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.880707  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.833388 11723 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:35.877094  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.882532  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1446) took 1184 ms. Trace:
I20260709 13:16:35.883180  8767 rpcz_store.cc:276] 0709 13:16:34.697785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.848243 (+1150458us) service_pool.cc:224] Handling call
0709 13:16:35.882450 (+ 34207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.884402  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.885366  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1448) took 1187 ms. Trace:
I20260709 13:16:35.885802  8767 rpcz_store.cc:276] 0709 13:16:34.698267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.884051 (+1185784us) service_pool.cc:224] Handling call
0709 13:16:35.885297 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.886835  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:35.887737  8767 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10.
I20260709 13:16:35.888223  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1462) took 1153 ms. Trace:
I20260709 13:16:35.843179 11364 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:35.834499 11827 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:35.881434  8766 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:35.891036  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:35.891037  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.888624  8767 rpcz_store.cc:276] 0709 13:16:34.734791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.886546 (+1151755us) service_pool.cc:224] Handling call
0709 13:16:35.888147 (+  1601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.893584  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.894219  8763 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:35.846086 11168 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.895833  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:35.895968  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:35.897431  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1460) took 1163 ms. Trace:
I20260709 13:16:35.889511 11827 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.833596 11652 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.855208 11787 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.795783 11873 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.898070  8765 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:35.903909  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1443) took 1207 ms. Trace:
I20260709 13:16:35.904270  8765 rpcz_store.cc:276] 0709 13:16:34.696944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.891983 (+1195039us) service_pool.cc:224] Handling call
0709 13:16:35.903847 (+ 11864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.904682  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1430) took 1796 ms. Trace:
W20260709 13:16:35.908074  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 238426us
I20260709 13:16:35.909895  8763 raft_consensus.cc:1275] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:16:35.897804  8766 rpcz_store.cc:276] 0709 13:16:34.734345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.890736 (+1156391us) service_pool.cc:224] Handling call
0709 13:16:35.897375 (+  6639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38912}
I20260709 13:16:35.910567  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1438) took 1798 ms. Trace:
I20260709 13:16:35.911116  8763 rpcz_store.cc:276] 0709 13:16:34.111773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.894917 (+1783144us) service_pool.cc:224] Handling call
0709 13:16:35.906052 (+ 11135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.910318 (+  4266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.910513 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.914148  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:35.914692  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 366577us
W20260709 13:16:35.915709  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:35.916433 11730 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:35.917029 11730 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:35.919320 11730 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.919713 11870 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:35.920496  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:35.921700  9461 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:35.818549 11876 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.927821  8767 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:35.922495  8766 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:35.927896  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:35.928472  8766 pending_rounds.cc:85] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 4
I20260709 13:16:35.898723 11827 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:35.928794  8766 pending_rounds.cc:107] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:16:35.925940  9432 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.112s (SENT) [suppressed 38 similar messages]
I20260709 13:16:35.954227 11789 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:35.954815 11789 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.957635 11789 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.908993  8769 rpcz_store.cc:276] 0709 13:16:34.108146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.299392 (+191246us) service_pool.cc:224] Handling call
0709 13:16:34.299859 (+   467us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:34.510871 (+211012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.510921 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:34.554967 (+ 44046us) log.cc:844] Serialized 52 byte log entry
0709 13:16:34.633170 (+ 78203us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:34.792971 (+159801us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.904149 (+1111178us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.904363 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.904437 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.904475 (+    38us) raft_consensus.cc:1685] finished
0709 13:16:35.904486 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.904615 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":121957,"prepare.queue_time_us":159353,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":459026,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":37511,"thread_start_us":1352016,"threads_started":4,"wal-append.queue_time_us":819690}
I20260709 13:16:35.956741  8766 raft_consensus.cc:2889] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:35.961051  8769 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:35.962244  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1448) took 1421 ms. Trace:
I20260709 13:16:35.962776  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1440) took 1829 ms. Trace:
I20260709 13:16:35.905948 11822 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:35.899636 11841 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:35.977458  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1435) took 1866 ms. Trace:
I20260709 13:16:35.900077  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:35.861364 11882 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:16:35.982648  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 55599.7us
I20260709 13:16:35.983379  8763 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:35.983963  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1443) took 1445 ms. Trace:
I20260709 13:16:35.984544  8763 rpcz_store.cc:276] 0709 13:16:34.538754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.931376 (+1392622us) service_pool.cc:224] Handling call
0709 13:16:35.983060 (+ 51684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.983733 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.983909 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.970831  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:35.986290  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:35.904825 11168 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.966336  8766 rpcz_store.cc:276] 0709 13:16:34.134405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.911214 (+1776809us) service_pool.cc:224] Handling call
0709 13:16:35.911630 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.961074 (+ 49444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.962401 (+  1327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.962921  8769 rpcz_store.cc:276] 0709 13:16:34.540760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.959748 (+1418988us) service_pool.cc:224] Handling call
0709 13:16:35.960247 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.961816 (+  1569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.962137 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:35.975270  9459 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:35.976467  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:35.916249  8808 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.988s (SENT)
I20260709 13:16:35.977844  8760 rpcz_store.cc:276] 0709 13:16:34.110873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.502980 (+392107us) service_pool.cc:224] Handling call
0709 13:16:34.513872 (+ 10892us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.558852 (+ 44980us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:34.597627 (+ 38775us) log.cc:844] Serialized 14 byte log entry
0709 13:16:35.010059 (+412432us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.054564 (+ 44505us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.469735 (+415171us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:35.469778 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.469844 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:35.977220 (+507376us) raft_consensus.cc:1685] finished
0709 13:16:35.977240 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:35.977398 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23876,"prepare.queue_time_us":93101,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":306188,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":13495,"thread_start_us":325082,"threads_started":1,"wal-append.queue_time_us":890992}
I20260709 13:16:35.989118  8909 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:35.987172  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:35.993696  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:35.997978  8918 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:36.017921  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.018201  8763 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.019003  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1450) took 1476 ms. Trace:
I20260709 13:16:36.019415  8763 rpcz_store.cc:276] 0709 13:16:34.542449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.017377 (+1474928us) service_pool.cc:224] Handling call
0709 13:16:36.017773 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.018715 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.018937 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.020033  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:36.020999 11384 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:36.021095 11880 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:36.021641 11384 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:36.022639 11384 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.023699 11449 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:36.024248 11449 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:36.026862  8917 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:35.987164 11868 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:36.036409  8763 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.053500  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1447) took 1355 ms. Trace:
I20260709 13:16:36.054090  8763 rpcz_store.cc:276] 0709 13:16:34.698041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.020295 (+1322254us) service_pool.cc:224] Handling call
0709 13:16:36.020710 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.053194 (+ 32484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.053430 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.002367 11695 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:36.071708  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64276.8us
I20260709 13:16:36.076472  8763 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:16:36.092022  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 67653.3us
I20260709 13:16:36.025142 11841 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:36.095556  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1450) took 1396 ms. Trace:
I20260709 13:16:36.096040  8763 rpcz_store.cc:276] 0709 13:16:34.698771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.055391 (+1356620us) service_pool.cc:224] Handling call
0709 13:16:36.074493 (+ 19102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.077197 (+  2704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.094809 (+ 17612us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:36.097105  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 239021us
I20260709 13:16:36.059913 11880 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:36.105052  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 188820us
I20260709 13:16:36.077968 11881 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:36.108393  8763 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:36.113413  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1453) took 1413 ms. Trace:
I20260709 13:16:36.114218  8763 rpcz_store.cc:276] 0709 13:16:34.699516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.097010 (+1397494us) service_pool.cc:224] Handling call
0709 13:16:36.108214 (+ 11204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.113009 (+  4795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.113327 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.100060 11736 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.123617  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1466) took 2418 ms. Trace:
I20260709 13:16:36.135237  8766 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:36.135991  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1456) took 1402 ms. Trace:
I20260709 13:16:36.136296  8766 rpcz_store.cc:276] 0709 13:16:34.733187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.134674 (+1401487us) service_pool.cc:224] Handling call
0709 13:16:36.135011 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.135715 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.135925 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.138074  8769 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:36.138738  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1458) took 1404 ms. Trace:
I20260709 13:16:36.139035  8769 rpcz_store.cc:276] 0709 13:16:34.733850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.137531 (+1403681us) service_pool.cc:224] Handling call
0709 13:16:36.137855 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.138471 (+   616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.138684 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:36.140959  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:36.142242 11860 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 1.373s	user 0.004s	sys 0.008s
W20260709 13:16:36.143453  8732 connection.cc:256] RPC call timeout handler was delayed by -1.7414925860000494s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2771s for a response
W20260709 13:16:36.143936  8732 connection.cc:256] RPC call timeout handler was delayed by -1.6199925860000803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2906s for a response
I20260709 13:16:36.144953 11890 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.145054 11692 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:36.145651 11890 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.147058  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 346) took 1749 ms. Trace:
I20260709 13:16:36.147428  9464 rpcz_store.cc:276] 0709 13:16:34.397553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.399620 (+  2067us) service_pool.cc:224] Handling call
0709 13:16:34.400087 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.400657 (+   570us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.400708 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.402793 (+  2085us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.532983 (+130190us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:34.533026 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.533088 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.141618 (+1608530us) spinlock_profiling.cc:243] Waited 6.05 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:36.146761 (+  5143us) raft_consensus.cc:1685] finished
0709 13:16:36.146782 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.146992 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":641,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":9903,"spinlock_wait_cycles":13910912,"thread_start_us":90387,"threads_started":1,"wal-append.queue_time_us":269538}
I20260709 13:16:36.149230 11890 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.150089 11890 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.150635 11890 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.153837 11890 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.156533  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.157519 11890 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:36.157646 11652 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.160647 11413 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:36.163019 11730 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:36.164938 11884 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:36.165380 11884 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:36.166052  8843 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.166330 11884 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.167965 11884 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.168372 11723 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:36.169004 11723 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.171545 11692 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.172101 11692 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:35.981832 11822 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.124102  8914 rpcz_store.cc:276] 0709 13:16:33.705572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.117144 (+411572us) service_pool.cc:224] Handling call
0709 13:16:34.117437 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.380993 (+263556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.381026 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:34.381068 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:34.381109 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.123366 (+1742257us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54001d3654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:36.123411 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.123551 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":605587712}
I20260709 13:16:36.175906  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.177217  8766 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:36.094223 11428 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:36.179788  8732 leader_election.cc:400] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:36.060125 11449 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.103627 11819 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.158053 11890 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.180020  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.094513 11695 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.098187 11798 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:36.192982  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.195979  8732 leader_election.cc:403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:36.104081 11883 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:16:36.360581  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.100737 11841 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.181703 11871 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.190706 11168 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.105263 11880 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.381446  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.092270 11827 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:36.292560 11886 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:16:36.191102  9460 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 2 to 5, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:36.295729 11822 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:36.391700  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 212140us
I20260709 13:16:36.392731  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.358381 11890 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.399228 11695 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.404806  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1639) took 1655 ms. Trace:
I20260709 13:16:36.405820  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.405264  8838 rpcz_store.cc:276] 0709 13:16:34.757356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.768843 (+ 11487us) service_pool.cc:224] Handling call
0709 13:16:34.839519 (+ 70676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.839830 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.839868 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.870804 (+ 30936us) log.cc:844] Serialized 26 byte log entry
0709 13:16:35.825157 (+954353us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:35.825197 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:35.825270 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.404516 (+579246us) raft_consensus.cc:1685] finished
0709 13:16:36.404580 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.404738 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":370851,"threads_started":1,"wal-append.queue_time_us":1102302}
I20260709 13:16:36.408528  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.419170  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.427454 11852 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.395902 11798 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.262212 11364 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:16:36.246189 11736 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:16:36.432984 11168 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.451632 11364 consensus_queue.cc:1243] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:36.451570 11798 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.336447  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.452916 11887 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.453450  8836 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:36.340929  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:36.454066 11798 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.440798 11821 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:36.454632  8837 raft_consensus.cc:2376] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10. Re-sending same reply.
I20260709 13:16:36.452785 11364 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:36.455018 11821 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.455672 11364 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:36.437896 11638 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.456540 11364 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.457341 11638 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:36.353171  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 232372us
I20260709 13:16:36.330907 11903 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.464074  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1459) took 1730 ms. Trace:
I20260709 13:16:36.464526  8769 rpcz_store.cc:276] 0709 13:16:34.734111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.139754 (+1405643us) service_pool.cc:224] Handling call
0709 13:16:36.140058 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.140261 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.140285 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.140794 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.431517 (+290723us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:36.431572 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.431669 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.463855 (+ 32186us) raft_consensus.cc:1685] finished
0709 13:16:36.463877 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.464016 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":165950,"threads_started":1,"wal-append.queue_time_us":265286}
I20260709 13:16:36.466104  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:36.428829  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.466943  8769 raft_consensus.cc:2376] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10. Re-sending same reply.
I20260709 13:16:36.346813 11692 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.358958 11897 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:36.361449  8766 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:36.373075 11830 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:36.373975 11841 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.376662 11873 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:36.376930 11893 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:16:36.377882 10947 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:16:36.479458 10947 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.435853 11822 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:36.481617 11822 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.483212 10947 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.483611 11822 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.378614  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.379166  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1455) took 1656 ms. Trace:
W20260709 13:16:36.484768  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 106241us
I20260709 13:16:36.470279  8769 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:36.386236 11876 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:36.437461  8913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1654) took 5439 ms (client timeout 3656 ms). Trace:
W20260709 13:16:36.431948  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 313768us
W20260709 13:16:36.438089  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 88471.1us
I20260709 13:16:36.439548  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.433573 11695 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:36.424939 11870 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.453547 11887 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.457671 11364 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:36.423666 11789 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.459343  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:36.514305  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55043.5us
W20260709 13:16:36.350644  8808 leader_election.cc:336] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.834s (SENT)
I20260709 13:16:36.152617 11832 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.462934 11638 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.473372 11736 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.484261  8763 rpcz_store.cc:276] 0709 13:16:34.722663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.117517 (+1394854us) service_pool.cc:224] Handling call
0709 13:16:36.117830 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.118057 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.118082 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.123610 (+  5528us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.261081 (+137471us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.261137 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.261253 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.378947 (+117694us) raft_consensus.cc:1685] finished
0709 13:16:36.378966 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.379108 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":136667,"threads_started":1,"wal-append.queue_time_us":203530}
I20260709 13:16:36.485903  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:36.515625  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 165012us
W20260709 13:16:36.496618  8913 rpcz_store.cc:269] 0709 13:16:30.984776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.482160 (+497384us) service_pool.cc:224] Handling call
0709 13:16:36.415255 (+4933095us) spinlock_profiling.cc:243] Waited 3.02 s on lock 0x7b54004100d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:36.424410 (+  9155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6934798720}
W20260709 13:16:36.501657  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72963us
I20260709 13:16:36.496414  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1470) took 1759 ms. Trace:
I20260709 13:16:36.518023  8769 rpcz_store.cc:276] 0709 13:16:34.736551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.467724 (+1731173us) service_pool.cc:224] Handling call
0709 13:16:36.469473 (+  1749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.486541 (+ 17068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.496347 (+  9806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.512722 11695 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.523525  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:36.327251  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.497607 11384 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:36.552011  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.553349  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:36.580157  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56297us
I20260709 13:16:36.554144  9464 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:36.562849  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.485304 11903 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.523397 10947 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:36.581202  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 63232.9us
I20260709 13:16:36.593182  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:36.581590  8808 leader_election.cc:336] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.858s (SENT)
I20260709 13:16:36.526773 11638 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.528663 11819 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:36.589975  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:36.596273  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.593403  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.597287 11870 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:36.594291  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:36.595530  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 156038us
I20260709 13:16:36.476715 11897 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.599301  8844 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:36.599936  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:36.606122  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1476) took 1513 ms. Trace:
I20260709 13:16:36.606736  8763 rpcz_store.cc:276] 0709 13:16:35.092976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.515945 (+1422969us) service_pool.cc:224] Handling call
0709 13:16:36.516282 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.516530 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:36.527705 (+ 11175us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.605633 (+ 77928us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.605699 (+    66us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:36.605775 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.605874 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.606046 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14416,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"thread_start_us":77500,"threads_started":1}
I20260709 13:16:36.608903  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.609256  8763 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:36.609941  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1479) took 1456 ms. Trace:
W20260709 13:16:36.610204  8808 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.079s (SENT)
I20260709 13:16:36.610430  8763 rpcz_store.cc:276] 0709 13:16:35.154128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.608738 (+1454610us) service_pool.cc:224] Handling call
0709 13:16:36.609101 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.609684 (+   583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.609884 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.621752  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.624984  8763 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:36.591005 11730 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.626215  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:16:36.609040 11793 consensus_meta.cc:287] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.751s	user 0.012s	sys 0.000s
I20260709 13:16:36.599640 11819 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.609745 11798 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:36.631253 11798 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.631685 11798 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:36.633751  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1484) took 1436 ms. Trace:
I20260709 13:16:36.609395 11822 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:36.634163  8763 rpcz_store.cc:276] 0709 13:16:35.192489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.623666 (+1431177us) service_pool.cc:224] Handling call
0709 13:16:36.624723 (+  1057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.627320 (+  2597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.628351 (+  1031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.635538  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:36.635533  8763 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:36.609905 11692 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:36.640048  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1485) took 1149 ms. Trace:
I20260709 13:16:36.640302  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:36.617578 11827 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:36.642794 11732 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:36.644317 11897 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.645364 11695 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.645849  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.646446 11821 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.642849 11905 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:36.667950 11905 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:36.668427 11905 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.670100 11732 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:36.671239  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.671089 11732 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.671919  8761 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:36.633440 10947 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 8.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:36.599278 11364 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:16:36.664752  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 270) took 1685 ms. Trace:
I20260709 13:16:36.640489  8763 rpcz_store.cc:276] 0709 13:16:35.490395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.634994 (+1144599us) service_pool.cc:224] Handling call
0709 13:16:36.635315 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.639777 (+  4462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.639975 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:36.672915  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.675441  8761 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:36.673763  8916 rpcz_store.cc:276] 0709 13:16:34.978956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.979122 (+   166us) service_pool.cc:224] Handling call
0709 13:16:34.979515 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:35.727152 (+747637us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.727199 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:35.729297 (+  2098us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.057661 (+328364us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:36.485361 (+427700us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.485597 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.664293 (+178696us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54001d2c54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:36.664349 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.664405 (+    56us) raft_consensus.cc:1685] finished
0709 13:16:36.664512 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.664684 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151,"prepare.queue_time_us":552332,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":4087,"raft.queue_time_us":66015,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":26050,"spinlock_wait_cycles":1113852800,"thread_start_us":942731,"threads_started":3,"wal-append.queue_time_us":372823}
I20260709 13:16:36.629709 11449 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:36.678473  8808 leader_election.cc:336] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 3.334s (SENT)
I20260709 13:16:36.679092  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:36.676899 11364 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:36.680591 11449 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:36.680738 11364 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:36.681792 11449 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.681854 11364 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.683219 11364 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.676967 10947 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:36.685304 10947 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:36.688473  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.689431  8761 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:36.630357 11730 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.690733 11880 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.691785  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.692453  8761 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:36.693243 11723 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.524s	user 0.003s	sys 0.007s
I20260709 13:16:36.693361 11730 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.661015 11692 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:36.661427 11910 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:16:36.694478 11897 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:36.694947 11422 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:36.661504 11917 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:36.695725 11917 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:36.656529 11822 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:36.696280 11917 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:36.666102 11738 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.666635 11903 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.690791  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.636348 11819 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:36.693935 11723 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.697558  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.703118  8763 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:36.656926 11736 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.705610 11736 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.708209 11736 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.659922 11832 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.710737 11832 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.711412  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.712092  9466 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:36.702972  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:36.696967 11822 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.717965 11897 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:36.708473 11863 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 1.769s	user 0.006s	sys 0.005s
I20260709 13:16:36.704388  8761 raft_consensus.cc:2410] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:36.725767  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:36.719929  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.705066 11638 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:36.729311  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.730804  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:36.724385 11829 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.940s	user 0.005s	sys 0.007s
W20260709 13:16:36.658761  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58768.4us
I20260709 13:16:36.704342 11887 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:36.745554 11897 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:36.747910 11890 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.740190 11903 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:36.749181 11903 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:36.749617 11903 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:36.749853 11885 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.888s	user 0.001s	sys 0.001s
I20260709 13:16:36.753635  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.754357  8763 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:36.755249  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:36.756300  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.756438  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.757637  8766 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:16:36.777294 11890 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.779309 11692 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:36.779363  8762 raft_consensus.cc:2410] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:36.781239 11788 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:36.783205  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.758834  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:36.739019 11832 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.830338 11897 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.830139 11692 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:36.830191  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:36.825875  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60534.6us
I20260709 13:16:36.795647  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1614) took 2418 ms. Trace:
I20260709 13:16:36.801926 11723 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:36.943882  8841 rpcz_store.cc:276] 0709 13:16:34.377446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.469202 (+ 91756us) service_pool.cc:224] Handling call
0709 13:16:34.469550 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:34.477608 (+  8058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:34.477633 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:34.478070 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:16:34.598238 (+120168us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:34.598286 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:34.598355 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:36.707755 (+2109400us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:36.786377 (+ 78622us) raft_consensus.cc:1685] finished
0709 13:16:36.786400 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:36.795546 (+  9146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7687,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7753,"spinlock_wait_cycles":10645376,"thread_start_us":119704,"threads_started":1,"wal-append.queue_time_us":460930}
I20260709 13:16:36.786372 11850 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.760957  8763 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:36.744302 10947 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.769371  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:36.954850  8761 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:36.809827  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 286350us
I20260709 13:16:36.958241  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.960381  8835 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:36.932652 11929 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:36.802539 11917 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.965510  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:36.966326  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:36.931012 11819 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:36.804409 11905 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:36.811302 11882 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:16:36.941545  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.781744 11788 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:36.946924  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 116824us
I20260709 13:16:36.951930  8837 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:36.937690  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:36.969481  8836 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:16:36.970412  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 369305us
I20260709 13:16:36.952679 11692 consensus_queue.cc:1243] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:36.973649  8841 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:36.983278  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.984478  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.985097  8841 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:36.985831  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.980165  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:36.986785  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.981179  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:36.988611  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:36.986785  8761 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:36.991117  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:36.991596  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.965391 11698 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:36.992481  8761 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:36.994897  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.005441  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 255) took 3539 ms. Trace:
I20260709 13:16:37.006052  8764 rpcz_store.cc:276] 0709 13:16:33.448328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:33.449438 (+  1110us) service_pool.cc:224] Handling call
0709 13:16:33.461550 (+ 12112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:34.380317 (+918767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.987783 (+2607466us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54000bb3d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:36.987986 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108674816}
I20260709 13:16:37.009059  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:36.973577 11870 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.011276  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.011425  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.016742  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.017606  8841 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:37.018743  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.979423 11850 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:37.025336  8838 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:36.998520 10947 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:36.936806 11638 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.030659  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:37.045285  8761 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:37.032255  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:37.046715  8764 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:36.989984 11723 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:36.972002 11827 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:16:36.969287 11903 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.048534  8841 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:37.012705 11760 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:37.057483  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:37.027086 11882 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:36.978657 11931 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:37.042482 11776 consensus_queue.cc:1048] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:16:37.059900 11821 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:37.060247  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:36.993749 11364 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:16:37.061869 11692 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.062640 11917 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.065184  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:37.407622  8763 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:37.066825 11834 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.970551 11929 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:37.234011  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 242960us
I20260709 13:16:37.226166 11932 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.367635 11449 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:37.400817 11695 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:37.410426  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:37.412058 11692 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.415227 11692 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.415288 11917 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:37.415848  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.008798 11798 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.076231 11697 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:16:37.025452 11730 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:16:37.369513 11905 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.419471  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:37.229812 11732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.043s	sys 0.054s
W20260709 13:16:37.167048  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.367717 11832 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.230217 11787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.033s	sys 0.064s
I20260709 13:16:37.374934 11884 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:37.049536 11850 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.045758 11928 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:37.026268 11881 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:16:37.415987 11172 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:37.379220 11897 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:37.380275 11903 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.079353 11882 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.455763  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.446200 11897 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:37.455874 11882 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.394569  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1474) took 1410 ms. Trace:
I20260709 13:16:37.458051  8910 rpcz_store.cc:276] 0709 13:16:35.984391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.984651 (+   260us) service_pool.cc:224] Handling call
0709 13:16:35.985068 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.758264 (+773196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.758309 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.758366 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:36.758419 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.394296 (+635877us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b540026d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:37.394357 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.394502 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18401,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":1777296256}
I20260709 13:16:37.398176  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.402654  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 281) took 3047 ms. Trace:
I20260709 13:16:37.460819  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:37.055096 11818 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:16:37.461406  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:37.423703 11732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.043s	sys 0.066s
I20260709 13:16:37.462350  8837 raft_consensus.cc:2410] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:37.424192  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 257) took 1269 ms. Trace:
I20260709 13:16:37.463281  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.462913  8763 rpcz_store.cc:276] 0709 13:16:36.154942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.408349 (+1253407us) service_pool.cc:224] Handling call
0709 13:16:37.423705 (+ 15356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.423864 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.423888 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.423929 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.423968 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.424027 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.424126 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:37.431020  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.410245 11760 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:37.146621  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:37.415951 11917 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.432722 11884 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:37.427228 11787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.036s	sys 0.068s
I20260709 13:16:37.437727 11928 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:37.474014  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.477034  8761 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:37.442122 11850 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:37.442111  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.448495 11819 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:37.448783 11364 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:37.450609  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54286 (request call id 476) took 1448 ms. Trace:
I20260709 13:16:37.451793  8764 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:37.453606  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1477) took 2301 ms. Trace:
I20260709 13:16:37.500732  8769 rpcz_store.cc:276] 0709 13:16:35.152428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.519635 (+1367207us) service_pool.cc:224] Handling call
0709 13:16:36.579693 (+ 60058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.580271 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:36.580303 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:36.611675 (+ 31372us) log.cc:844] Serialized 26 byte log entry
0709 13:16:36.972107 (+360432us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:36.972147 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:36.972308 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.453395 (+481087us) raft_consensus.cc:1685] finished
0709 13:16:37.453416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.453544 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":223,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8434,"thread_start_us":338719,"threads_started":1,"wal-append.queue_time_us":809192}
I20260709 13:16:37.456094  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.383867  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:37.504344  8760 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:37.464618  8838 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:37.431665 11832 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.460789  8839 rpcz_store.cc:276] 0709 13:16:34.355242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.381870 (+ 26628us) service_pool.cc:224] Handling call
0709 13:16:34.409489 (+ 27619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:35.792803 (+1383314us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:35.902932 (+110129us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.360425 (+457493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:36.360475 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:36.360526 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.400820 (+1040294us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540006b654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:37.402402 (+  1582us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.402579 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28376,"prepare.queue_time_us":310997,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":30300,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":17827,"spinlock_wait_cycles":3180817152,"thread_start_us":538516,"threads_started":2,"wal-append.queue_time_us":483069,"wal-append.run_cpu_time_us":1086,"wal-append.run_wall_time_us":1001098}
I20260709 13:16:37.474049  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1475) took 2438 ms. Trace:
I20260709 13:16:37.510563  8766 rpcz_store.cc:276] 0709 13:16:35.036244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.477561 (+1441317us) service_pool.cc:224] Handling call
0709 13:16:36.477917 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.776823 (+298906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.473815 (+696992us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b5400338954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:37.473992 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642731392}
I20260709 13:16:37.474608  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 290) took 1131 ms. Trace:
W20260709 13:16:37.475121  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1444) took 2777 ms (client timeout 1834 ms). Trace:
I20260709 13:16:37.512522  8844 rpcz_store.cc:276] 0709 13:16:36.343044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.345328 (+  2284us) service_pool.cc:224] Handling call
0709 13:16:36.345733 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:36.599849 (+254116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.474395 (+874546us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540006b154. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:37.474553 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582713728}
W20260709 13:16:37.477356  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67024.9us
I20260709 13:16:37.484627  8842 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 3.
W20260709 13:16:37.477833  8767 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1469) took 2741 ms (client timeout 3334 ms). Trace:
I20260709 13:16:37.513856  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:37.442267 11949 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.487051 11884 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.472281 10947 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:37.494655 11788 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.450538 11798 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:37.494524 11655 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.485806 11903 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:37.508534  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:16:37.472390 11925 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 13:16:37.514103  8767 rpcz_store.cc:269] 0709 13:16:34.736338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.892645 (+1156307us) service_pool.cc:224] Handling call
0709 13:16:37.477635 (+1584990us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5400198554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:37.477779 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28244352}
I20260709 13:16:37.535048  8760 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:37.484850  8837 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:37.531877 11903 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:37.541626 11903 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:37.546597 11882 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.528944 11827 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:37.529935 10947 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.555609 10947 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:37.567059  8735 connection.cc:256] RPC call timeout handler was delayed by -1.1633569440000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 13:16:37.471576 11870 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:37.500207 11364 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:37.577656  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:37.517598 11949 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.476080 11737 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:37.483556 11928 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.475906 11760 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.584761  8841 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:37.585104  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.593464  8844 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:37.584781  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.586242  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.568830 11832 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.577031 11882 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.581453 11875 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.599248 10947 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.602254 10947 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.587306 11902 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:37.593887 11827 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.596968 11692 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.591780 11737 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.595085 11798 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:37.567128 11897 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.607378 11875 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.613333 11902 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.618631 11827 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.649714 11949 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.654539 11902 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:37.718137  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 140457us
I20260709 13:16:37.721580  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:37.724642  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:37.512594  8762 rpcz_store.cc:269] 0709 13:16:34.697185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:34.787253 (+ 90068us) service_pool.cc:224] Handling call
0709 13:16:37.474911 (+2687658us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b5400338e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:37.475023 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4578131712}
I20260709 13:16:37.727463  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:37.749001  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1439) took 3619 ms. Trace:
I20260709 13:16:37.749773  8765 rpcz_store.cc:276] 0709 13:16:34.129393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:35.905014 (+1775621us) service_pool.cc:224] Handling call
0709 13:16:35.905469 (+   455us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:35.906282 (+   813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:35.906310 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:35.907796 (+  1486us) log.cc:844] Serialized 52 byte log entry
0709 13:16:36.066971 (+159175us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:36.354872 (+287901us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.371070 (+ 16198us) log.cc:844] Serialized 14 byte log entry
0709 13:16:36.801893 (+430823us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b1800389140. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:37.433206 (+631313us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b1800389140. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:37.558132 (+124926us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800389140. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:37.748047 (+189915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.748260 (+   213us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.748402 (+   142us) raft_consensus.cc:1685] finished
0709 13:16:37.748433 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.748716 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35985,"prepare.queue_time_us":110732,"prepare.run_cpu_time_us":206,"prepare.run_wall_time_us":208,"raft.queue_time_us":4525,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":29189,"spinlock_wait_cycles":96911360,"thread_start_us":683110,"threads_started":3,"wal-append.queue_time_us":253807,"wal-append.run_cpu_time_us":3370,"wal-append.run_wall_time_us":1194752}
I20260709 13:16:37.749003  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1453) took 1032 ms. Trace:
I20260709 13:16:37.760365  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.763356  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:37.763918  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.764591  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.765090  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.765547  8841 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:37.766038  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.766675  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.766894  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.594551  8843 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:37.769272  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:37.770546  8844 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 10 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:37.764815  8836 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:37.762874  8766 rpcz_store.cc:276] 0709 13:16:36.716444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.511654 (+795210us) service_pool.cc:224] Handling call
0709 13:16:37.511982 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.517505 (+  5523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.517534 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.518040 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.748114 (+230074us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:37.748217 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.748321 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.748402 (+    81us) raft_consensus.cc:1685] finished
0709 13:16:37.748432 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.748716 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9538,"thread_start_us":229264,"threads_started":1,"wal-append.queue_time_us":151251}
W20260709 13:16:37.595712  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 538299us
I20260709 13:16:37.782889  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:37.611491 10947 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.786964 10947 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.787928 10947 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.788241  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:37.808068 11737 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:37.808281  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:37.809316 11884 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:37.810918 11884 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:37.811374 11875 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:37.621809 11692 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.811403 11884 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:37.834285 11902 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:37.835089  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47296.4us
I20260709 13:16:37.835813 11732 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:37.841539 11732 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.842046 11732 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:37.847023 11954 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:37.852638  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1457) took 1131 ms. Trace:
I20260709 13:16:37.853156 11951 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.853924 11951 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:37.854557 11951 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.855803 11827 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.857450 11655 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:37.858095 11655 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.858141 11723 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:37.858812 11655 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.859375  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:37.858899 11723 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.841226 11902 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:37.884172  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 156990us
I20260709 13:16:37.623162 11798 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.890326  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:37.892846  8842 raft_consensus.cc:2410] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:16:37.510131  9460 rpcz_store.cc:276] 0709 13:16:36.002238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.059910 (+ 57672us) service_pool.cc:224] Handling call
0709 13:16:36.101440 (+ 41530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:36.181510 (+ 80070us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:36.648164 (+466654us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.077287 (+429123us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.419225 (+341938us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.434220 (+ 14995us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:37.436885 (+  2665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.445776 (+  8891us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.450390 (+  4614us) raft_consensus.cc:1685] finished
0709 13:16:37.450411 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.450548 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89550,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":17953,"thread_start_us":395030,"threads_started":1,"wal-append.queue_time_us":788229}
I20260709 13:16:37.894524 11692 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.842092 11903 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.618117 11364 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.830431 11789 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:37.902916 11832 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:37.900116 11922 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:37.909960  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 127799us
I20260709 13:16:37.910562 11922 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.911404  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:37.912793 11827 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:37.913774 11827 consensus_queue.cc:1243] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:37.853214  8761 rpcz_store.cc:276] 0709 13:16:36.721496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.532941 (+811445us) service_pool.cc:224] Handling call
0709 13:16:37.538717 (+  5776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.539125 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:37.539168 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.539664 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.805020 (+265356us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:37.805162 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.805306 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:37.852014 (+ 46708us) raft_consensus.cc:1685] finished
0709 13:16:37.852034 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.852367 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1571,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":251724,"threads_started":1,"wal-append.queue_time_us":309212}
I20260709 13:16:37.885037 11902 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:37.902968 11929 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:37.938917 11905 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:37.939689  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 60331.2us
I20260709 13:16:37.941169 11944 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:37.942698 11944 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:37.943182 11944 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:37.944473  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 265) took 1264 ms. Trace:
I20260709 13:16:37.945011  8764 rpcz_store.cc:276] 0709 13:16:36.679942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.509883 (+829941us) service_pool.cc:224] Handling call
0709 13:16:37.516112 (+  6229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.516357 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:16:37.825642 (+309285us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.943763 (+118121us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.943842 (+    79us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:37.943972 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.944099 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.944273 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24897,"prepare.queue_time_us":42013,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"thread_start_us":362087,"threads_started":2}
W20260709 13:16:37.949074  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90035.5us
I20260709 13:16:37.950656  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:37.862365 11928 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.958997 11884 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:37.961491 11957 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:37.965715  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:37.968327 11712 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:37.971503 11712 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:37.973734 11936 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:37.953929 11905 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:37.961550 11922 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:37.970134 11793 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:37.944429 11944 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.017021 10947 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:38.023705  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.024657 11969 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.118s	user 0.000s	sys 0.002s
I20260709 13:16:38.013252 11798 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:38.016315 11905 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:38.014238 11793 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:38.026388  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 263) took 1284 ms. Trace:
W20260709 13:16:38.036653  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.037364  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.037580 11966 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.038338 11966 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.041339 11966 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.042132 11966 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:38.043015 11966 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.045946  8735 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:38.046147 11966 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.047305 11966 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:35.826285  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:38.048512 11966 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.049153 11875 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:38.049734 11875 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.050228 11875 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.051765 11966 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.023748  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:38.053545  9467 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:38.048358  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:38.053566  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:38.056710  8665 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:38.063519  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.064741  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:38.065094 11966 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:38.065904  9467 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:38.066210  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.069569 11905 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:38.072921  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:38.086593  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 175441us
I20260709 13:16:38.033986  8769 rpcz_store.cc:276] 0709 13:16:36.679359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.502872 (+823513us) service_pool.cc:224] Handling call
0709 13:16:37.503266 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.503543 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:16:37.795869 (+292326us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.960802 (+164933us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:37.960949 (+   147us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:37.961108 (+   159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.962757 (+  1649us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:37.963312 (+   555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21165,"prepare.queue_time_us":54579,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":22683,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":177,"thread_start_us":412535,"threads_started":2}
I20260709 13:16:38.065590  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.106179  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.100342 11827 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.102433 11944 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.123145  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.124183  9467 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:38.130112  8762 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:38.132972  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1458) took 1339 ms. Trace:
I20260709 13:16:38.133576  8767 rpcz_store.cc:276] 0709 13:16:36.721794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.534099 (+812305us) service_pool.cc:224] Handling call
0709 13:16:37.547679 (+ 13580us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:37.548094 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:16:37.904605 (+356511us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.008966 (+104361us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:38.011736 (+  2770us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:38.020968 (+  9232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.028402 (+  7434us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.061344 (+ 32942us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10502,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":12270,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":13380,"thread_start_us":409170,"threads_started":2,"wal-append.queue_time_us":148654}
I20260709 13:16:38.135938  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:38.137389 11760 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:38.137508  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:38.137929 11760 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.138348 11760 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:38.141312 11779 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:16:38.141870  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 93900.1us
I20260709 13:16:38.141965 11779 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:38.143307 11779 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.147948  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:38.152554 11966 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:38.153065 11966 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:38.153489 11966 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:38.154690  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:38.163071 11966 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.165768 11966 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:38.169137 11973 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:16:38.169368 11949 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:38.169956 11949 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:38.170387 11949 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.173470 11917 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.175113  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.179188 11903 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.121372 11712 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:38.180354  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.181414 11827 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.183979 11827 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:38.186802 11958 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.352s	user 0.004s	sys 0.000s
I20260709 13:16:38.190582  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 262) took 1511 ms. Trace:
I20260709 13:16:38.191071 11835 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:38.192445 11835 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:38.190979  8763 rpcz_store.cc:276] 0709 13:16:36.679071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.464159 (+785088us) service_pool.cc:224] Handling call
0709 13:16:37.478980 (+ 14821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:37.479290 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:37.479316 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:37.483985 (+  4669us) log.cc:844] Serialized 26 byte log entry
0709 13:16:37.913109 (+429124us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:37.914077 (+   968us) log.cc:844] Serialized 14 byte log entry
0709 13:16:37.943596 (+ 29519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:37.943745 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:38.185976 (+242231us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:38.188262 (+  2286us) raft_consensus.cc:1685] finished
0709 13:16:38.188367 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:38.190272 (+  1905us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b5400198550. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:38.190410 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23639,"prepare.queue_time_us":256,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":43895,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":368,"spinlock_wait_cycles":79837440,"thread_start_us":382624,"threads_started":1,"wal-append.queue_time_us":347851}
I20260709 13:16:38.192830 11835 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:38.194480 11835 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:38.195937 11835 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.198401 11832 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.195804 11932 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:38.199059 11832 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.199587 11932 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.201283  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:38.203704 11793 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.204810 11793 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:38.208148  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.207908  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53310.9us
W20260709 13:16:38.219517  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.224586  8761 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.254184  8766 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:16:38.265389  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.275230  8766 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:38.257444  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.277436  8918 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:38.289259  8918 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:38.290961 11928 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.297839  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.298147  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.298851  8918 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:38.300835  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.301422  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.301560  8912 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.303864  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.304286 11884 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:38.305505  9459 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:16:38.305868  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.306805 11902 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.307093  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.308391  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.298863  8764 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:38.309456 11655 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.255771 11949 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.314121  9460 raft_consensus.cc:2410] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:38.313665  8912 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:38.326272  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.228315 11951 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:38.329674  8918 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:38.220961 11760 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.266930 11827 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.344172  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.345760  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:38.350098  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.352104  8767 pending_rounds.cc:85] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 2
I20260709 13:16:38.360519  8918 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:38.373799  8916 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:38.377130  8918 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:38.340202 11902 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.357977  8767 pending_rounds.cc:107] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:38.389959 11698 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.131s
W20260709 13:16:38.391782  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 194651us
I20260709 13:16:38.392854  8912 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:38.395516 11760 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:38.396031 11827 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.397495  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.398260  8766 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:38.399333 11827 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.391805 11723 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.406314 11951 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:38.407891 11655 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.409476  8764 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:38.409937  8764 pending_rounds.cc:85] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 4
I20260709 13:16:38.410207  8764 pending_rounds.cc:107] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:38.410467  8764 raft_consensus.cc:2889] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.410326 11723 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.419811 11732 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:38.400597  8917 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:38.396653 11364 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.346506 11832 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:38.430122  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:38.382512  8767 raft_consensus.cc:2889] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:38.413498  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:38.414018 11949 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:38.466383  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.471460  8766 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:38.476814  9461 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:38.479414  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:38.480507  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.490592  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 77228.7us
I20260709 13:16:38.496603  8766 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:38.501228  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.513310  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.514361  8764 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:38.518047  8761 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:38.533974  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.534900  8766 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:38.537478  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.509850 11832 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:38.543030  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.545208  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.546123  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.549444  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.550045  8761 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:38.534997  8665 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 2 to 4, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:38.551038  8768 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:38.551229 11725 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.552016 11887 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:38.552192 11725 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:38.553395 11887 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:38.553777 11887 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:38.554705 11887 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:38.556077 11887 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:38.563982  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:38.578037  8766 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:38.562021 11725 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:38.593724  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:38.575445  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:38.595059  8914 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:38.546790 11832 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:38.546501 11944 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:38.608076 11655 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:38.608438  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.609508  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:38.624301 11979 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:38.610000  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.625967  8916 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:38.620888  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.660204  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.613032 11832 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:38.678201  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.563642 11932 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:38.721412 11968 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 13:16:38.723083 11982 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:16:38.727507 11932 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:38.730377 11984 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:16:38.732951 11944 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.735445 11944 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:38.736992  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.773849  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:38.814003 11875 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.762s	user 0.008s	sys 0.008s
W20260709 13:16:38.880541  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.902257  8761 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:16:38.914146  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:38.936797  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:38.948591  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:38.937968  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 409068us
I20260709 13:16:38.948539  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.956305  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:38.958631  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 277846us
I20260709 13:16:38.863487 11875 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:38.966820  8761 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:38.973546  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.975075  8836 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:38.981215  8762 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:38.987800  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.992476  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:38.993978  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.994782  8764 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:38.997255  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:38.986549 11364 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:39.006351 11364 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.009250  8761 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:39.010782  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.012318  8761 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:39.013156  8835 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:39.014626  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.016158  8761 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:39.017655 11364 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.017896  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.020430  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.020954  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.027882  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.028482  8762 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:39.027887  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.031519  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.033814  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.034274  8767 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.032197  8836 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:39.036557  8841 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.044199  8764 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:39.036343  8844 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:39.043628  8769 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:39.047304  8838 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:39.047747  8761 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:39.049976  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.050585  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.050659  8841 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:39.052824  8838 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.053426  8761 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:39.050704 11932 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.059665  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.059867  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.060983  8769 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:39.050849 11949 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:39.059114  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.066233 11698 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:39.086742 11698 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.088933 11932 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.089684  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.091150 11932 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.093158  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.093854  8838 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:39.094792  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.048454 11364 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:39.095367  8838 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.095798 11364 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.055796 11655 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:39.096063 11732 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.098798  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.099958  8764 pending_rounds.cc:85] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 3
I20260709 13:16:39.104334  8764 pending_rounds.cc:107] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:39.099280  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.103018 11949 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.106245  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.105907  8915 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.105098  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.107311  8768 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:39.104683  8764 raft_consensus.cc:2889] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.108984  8841 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:39.109097  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.122254  8760 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.127643  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.114436 11932 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:39.126447  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.130064  8915 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.116758 11897 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.136684  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:39.134181  9431 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.668s (SENT)
I20260709 13:16:39.115505 11655 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:39.138633 11992 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:16:39.119974 11698 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:39.133325  8844 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:39.137331  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:39.138173  8768 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:16:39.139870  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.130453 11875 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.149101  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.134538  9459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 359) took 1149 ms. Trace:
I20260709 13:16:39.150668  8844 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.151522  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.152174  8912 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:39.144913 11967 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.816s	user 0.016s	sys 0.008s
I20260709 13:16:39.153584  8841 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:16:39.131616 11932 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.160089 11638 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.150540 11996 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:39.164003  8915 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:39.165246  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.167696  8839 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:39.167979  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.169239  8844 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.169876  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.158859 11655 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.171627  8767 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:39.172663  8909 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.173931  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.170485 11364 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.174875  8910 raft_consensus.cc:2368] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10.
I20260709 13:16:39.175582  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.179034  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.180183  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.180984  8841 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.185403  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.187373  8912 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:16:39.151187  9459 rpcz_store.cc:276] 0709 13:16:37.979508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.983381 (+  3873us) service_pool.cc:224] Handling call
0709 13:16:38.021310 (+ 37929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:38.305973 (+284663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.118413 (+812440us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b540012d9d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:39.128257 (+  9844us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":539537280}
I20260709 13:16:39.174767 11655 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:39.160801 11638 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.193817  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:39.195487  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.197363  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.198186  8766 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:39.188828 11988 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:16:39.199283  8839 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.200806  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.202626  8767 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:39.205950  8762 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:39.209838  8769 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:39.211782  8841 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:39.214643  8838 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:39.228590  8766 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:39.243064  8766 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:39.246115  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.245810  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:39.244820 11987 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:16:39.263384  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.264070  8912 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:39.268301  8762 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:39.265211  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 139414us
W20260709 13:16:39.270836  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.273141  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 175962us
W20260709 13:16:39.279300  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.281159  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.285085  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.287537  8767 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:16:39.288381  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 183321us
I20260709 13:16:39.289274  8735 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:39.289961  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58933.9us
I20260709 13:16:39.294262  8767 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:16:39.292472  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 164429us
I20260709 13:16:39.290412  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:39.297945  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 122837us
I20260709 13:16:39.298383  8762 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:39.297122 11701 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:39.303005  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.305262 12002 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:39.305063 11701 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.305761 11998 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:39.305786 12002 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:39.305213  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.633s (SENT)
I20260709 13:16:39.307480 11701 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:39.308147  8843 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:39.308544  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.309790  8843 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:39.306735 11725 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:39.306504 12002 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.311709  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.317438  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:39.319820 11698 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:39.306671 11990 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:16:39.320981 11732 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:39.321560 11732 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.321923 11698 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:39.322813 11698 consensus_queue.cc:1243] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:16:39.324463  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.306399 11364 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.326967 11732 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:39.327270 11931 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:39.327769 11931 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:39.301851 11655 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:39.327154  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:39.306450 11998 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:39.336706  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.326967 11364 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.338380  8837 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:39.328751 11931 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.339787 11931 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:39.340076  8837 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:39.340186 11364 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.349210  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:39.350056  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48804.1us
I20260709 13:16:39.351866  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.342973 12002 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.359078 12002 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:39.359807 11832 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.002s
I20260709 13:16:39.359375  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.359671  8762 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:39.338512  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:39.343192 11701 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:39.362493  8760 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:39.375540  8844 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:39.371379  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.376484  8837 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:39.334861 11655 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.377743  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:39.379859  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.380810  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.387080  8760 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.377779  8763 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:39.391280  8769 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.400822 12005 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:39.402108 12005 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.402531 12005 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.403003  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.404065  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:39.404320  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.377828 11832 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.404974  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.405704  8765 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:39.406107  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.404434  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1491) took 1106 ms. Trace:
I20260709 13:16:39.409668  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.410624  8763 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:39.411619  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.412343  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.412591  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.411620  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.413033  8914 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:39.413363  8918 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.414013  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.414083  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.414348  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:39.414834  8914 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:39.415035  8917 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.415534  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.416291  8763 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:39.417109  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.417200 11998 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.419590  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.417104  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.421629  8915 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 13:16:39.406611  8911 rpcz_store.cc:276] 0709 13:16:38.297938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:38.298151 (+   213us) service_pool.cc:224] Handling call
0709 13:16:38.298545 (+   394us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:38.299092 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:38.299182 (+    90us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:38.299883 (+   701us) log.cc:844] Serialized 52 byte log entry
0709 13:16:38.806278 (+506395us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:38.842022 (+ 35744us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.996650 (+154628us) log.cc:844] Serialized 14 byte log entry
0709 13:16:38.999404 (+  2754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:38.999472 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:39.088323 (+ 88851us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b18003be360. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:39.342355 (+254032us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4800060cd8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:16:39.359037 (+ 16682us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b18003be360. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:39.404096 (+ 45059us) raft_consensus.cc:1685] finished
0709 13:16:39.404119 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:39.404253 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149550,"prepare.queue_time_us":36573,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":95,"raft.queue_time_us":156414,"raft.run_cpu_time_us":4955,"raft.run_wall_time_us":343743,"spinlock_wait_cycles":30732288,"thread_start_us":488370,"threads_started":1,"wal-append.queue_time_us":798896}
W20260709 13:16:39.424790  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73225.1us
I20260709 13:16:39.425869  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:39.388576 11655 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.428249  8763 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.431614  8763 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:39.378592 11999 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:39.437250  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.428119  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 85278.5us
I20260709 13:16:39.406165  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.441464  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:39.443415 12006 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:39.443884 11932 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.444463 12002 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:39.444975 12002 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.445366 12002 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.428989 11638 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:39.428535  8665 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.450284  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.451327  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.404322 11949 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:39.453094  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.439092 11999 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.457053 11999 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.435151  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.434321 11996 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:16:39.466759  8768 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:39.473029 11832 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.478199  8665 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 9, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:39.479399  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.480118  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.480831  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.480332  8665 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 6, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 6 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.481206  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.482864  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.482349  8665 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 8, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 8 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:39.480890  8911 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:39.493263  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89562.4us
I20260709 13:16:39.493929  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.495666 12009 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:39.500469  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 96528.3us
I20260709 13:16:39.501432  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:39.500459 11364 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:39.502573 11364 consensus_queue.cc:1243] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:39.503065  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:39.496165 11793 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:39.505954  8884 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.509663  8769 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:39.528196  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.514433  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:39.531910  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124819us
I20260709 13:16:39.534435  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.509065 11932 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:39.535322  8911 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.537096 11638 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:39.506891  8665 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 6, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68), now has a pending config: VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65), VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66), VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67), VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 6 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:39.553297  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.529712 12008 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:39.552804  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.541797 12009 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:39.561318  8915 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:39.555007  8665 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 7, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.564155  8665 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 5, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 5 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.566267  8665 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 7, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.567641 12005 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.567981  8665 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 7 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:39.571424  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.578599  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:39.578761  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 51507.2us
I20260709 13:16:39.580284  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.585247  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:39.585793  8732 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 3.656s (SENT)
I20260709 13:16:39.561453 12009 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:39.586283  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:39.587679  8665 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 3 to 4, term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68), VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 3 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.572377 11998 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:39.587225  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:39.596808 12002 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.599120 12002 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.591784 12021 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:39.599882 12021 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:39.600278 12021 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:39.601231  8663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 217) took 32719 ms (client timeout 15000 ms). Trace:
I20260709 13:16:39.592244 12009 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.590400 12014 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:39.594455  8840 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:39.573768 11999 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.628484  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.612634  8918 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:39.612201  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.602995  8766 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:39.619741  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.632218  8912 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:39.622037  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.612270  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.628422  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.635108  8917 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:39.633778  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:39.637251  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:39.589792 11949 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:39.632583  8909 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:39.643074  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:39.640909 11701 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:39.644941 12000 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:39.651244 11999 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.652205 11999 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:39.642345  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.671557  8916 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:39.671898  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.672206  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.673026  8911 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:39.621269 12014 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:39.682454  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45289.8us
I20260709 13:16:39.628710 11832 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:39.599134 11998 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:39.659898  8914 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:39.641815 11944 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.638465 11931 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:39.693272  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.745321 12016 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:39.910904  8914 raft_consensus.cc:2376] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8. Re-sending same reply.
I20260709 13:16:39.911336 12016 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.913846 12016 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:39.738742  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.652822 11999 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:39.601691  8663 rpcz_store.cc:269] 0709 13:16:06.881418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.910541 (+ 29123us) service_pool.cc:224] Handling call
0709 13:16:39.595903 (+32685362us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:30.025542 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:30.282536 (+256994us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:30.282602 (+    66us) write_op.cc:435] Acquired schema lock
0709 13:16:30.282630 (+    28us) tablet.cc:662] Decoding operations
0709 13:16:30.284519 (+  1889us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:30.284642 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:30.284683 (+    41us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:16:30.379359 (+ 94676us) tablet.cc:701] Row locks acquired
0709 13:16:30.379426 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:16:30.379665 (+   239us) write_op.cc:270] Start()
0709 13:16:30.379854 (+   189us) write_op.cc:276] Timestamp: P: 1783602990379572 usec, L: 0
0709 13:16:30.379885 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:16:30.381088 (+  1203us) log.cc:844] Serialized 5971 byte log entry
0709 13:16:31.208520 (+827432us) op_driver.cc:464] REPLICATION: finished
0709 13:16:31.331252 (+122732us) write_op.cc:301] APPLY: starting
0709 13:16:31.331381 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:31.331620 (+   239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:31.331789 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:31.333571 (+  1782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:31.417044 (+ 83473us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:16:31.417094 (+    50us) write_op.cc:312] APPLY: finished
0709 13:16:31.417512 (+   418us) log.cc:844] Serialized 106 byte log entry
0709 13:16:31.417883 (+   371us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.418030 (+   147us) write_op.cc:454] Released schema lock
0709 13:16:31.418102 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:31.418625 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.418843 (+   218us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":352631,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":122470,"apply.run_cpu_time_us":4694,"apply.run_wall_time_us":87329,"num_ops":15,"prepare.queue_time_us":422412,"prepare.run_cpu_time_us":18062,"prepare.run_wall_time_us":775876,"raft.queue_time_us":31906,"raft.run_cpu_time_us":82409,"raft.run_wall_time_us":115553,"replication_time_us":828448,"thread_start_us":623980,"threads_started":4,"wal-append.queue_time_us":507738,"wal-append.run_cpu_time_us":6592,"wal-append.run_wall_time_us":1528891}]]}
W20260709 13:16:39.692549  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 189607us
I20260709 13:16:39.784435  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.924744  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.636428 12002 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:39.743790  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:39.729012  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.659775 11949 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:39.745154  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:39.744557  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.783912  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.745078  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:39.936551  8841 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:39.936852  8917 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:16:39.692953  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 110473us
W20260709 13:16:39.761873  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.742254  8840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1650) took 2774 ms (client timeout 3239 ms). Trace:
I20260709 13:16:39.784883  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:39.915254  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 277377us
I20260709 13:16:39.933542  8837 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:39.938903  8835 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:39.940307  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:39.910980 12024 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.195s	user 0.004s	sys 0.000s
W20260709 13:16:39.938663  8840 rpcz_store.cc:269] 0709 13:16:36.968164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:37.455839 (+487675us) service_pool.cc:224] Handling call
0709 13:16:39.741840 (+2286001us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b540006bb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:39.742103 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4806576000}
I20260709 13:16:39.687690 11897 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:39.942430  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 241678us
I20260709 13:16:39.692107 11701 raft_consensus.cc:2764] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:39.689371 12014 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.945019  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.946285  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:39.952234  8767 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:39.955217  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:39.953766  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.947980  8839 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.912503 12021 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:39.920732 12005 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.954137  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:39.915079 12009 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:39.937304 11949 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:39.947430 11725 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:39.953174  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:39.727030 11832 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:39.945714 12002 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:39.963994  8917 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:39.714694 12003 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.312s
I20260709 13:16:39.724462 11655 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.962708  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:39.925305 11944 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.961841 11996 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.985430  8911 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:16:39.985834  8911 pending_rounds.cc:85] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 8
I20260709 13:16:39.986135  8911 pending_rounds.cc:107] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:39.986404  8911 raft_consensus.cc:2889] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:39.955727 11897 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.715310 11998 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:39.956303 12001 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:16:39.974429 11698 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:39.993619  8760 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:39.989868  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:39.978937 12029 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:39.999713  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:40.001989  8836 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:40.006502  8911 raft_consensus.cc:2410] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:39.988756 11701 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:39.976523 11725 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:40.008605 12029 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.018595 12021 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:40.019037 12029 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:39.984898 11832 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:40.001391 12022 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:40.030642  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:40.031137  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.024621 11725 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:39.991865 11996 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:40.079083  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47993.2us
I20260709 13:16:40.031659 12000 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:40.081544  8839 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:40.083396  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:40.078219 11887 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:16:40.087155  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:40.080710 11951 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:16:40.087988  8843 raft_consensus.cc:606] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:40.035072 12021 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:16:40.078516 12003 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:40.084074  8917 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
W20260709 13:16:40.092903  9431 leader_election.cc:336] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.536s (SENT)
W20260709 13:16:40.094512  8732 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.572s (SENT)
I20260709 13:16:40.095229  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.074908 12023 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:40.100397 12023 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:40.105250 12023 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.107502  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:40.108184  8914 raft_consensus.cc:2376] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8. Re-sending same reply.
I20260709 13:16:40.109084  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.105144 12036 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.110383 12036 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:40.113095 12005 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:40.113606 12005 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:40.116518  8835 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:40.118397  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:40.113996 12005 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.119959 12036 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:40.071305 12022 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:40.122152 12030 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.122279 12022 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:40.124122 11832 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:40.084717  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:40.137125  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44256.1us
I20260709 13:16:40.076900 11701 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:16:40.140849  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:40.098075 12029 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:40.026084 11999 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.143491  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:40.141886  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:40.145045  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50646.7us
W20260709 13:16:40.149174  8732 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.632s (SENT)
I20260709 13:16:40.149669  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.151782  8761 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:40.153036  8735 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:40.153864  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:40.160097 11655 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.160787 12000 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:40.161806 12000 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.166496 11875 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:40.166978 11875 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:40.167387 11875 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:40.168414  8911 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:16:40.154484  8768 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:40.140733 11897 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.170009  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:40.147527  9459 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:40.141556 12034 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:16:40.171906 12034 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:40.172282 12034 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:40.173234 12034 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.174477 12034 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:40.145797 12028 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:16:40.185827  8839 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:40.186355  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:40.178452  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1659) took 1086 ms. Trace:
I20260709 13:16:40.191087  8841 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:40.077623 12002 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.169939 11638 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:40.206624  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:40.208237  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:40.207691  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:40.214576  8835 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:40.214682  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 87800.2us
I20260709 13:16:40.216929  8844 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:16:40.216709  8837 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:40.187139  8842 rpcz_store.cc:276] 0709 13:16:39.100644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.328197 (+227553us) service_pool.cc:224] Handling call
0709 13:16:39.328554 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:39.538135 (+209581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:39.538184 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:39.572566 (+ 34382us) log.cc:844] Serialized 26 byte log entry
0709 13:16:39.713755 (+141189us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:39.713811 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:39.713917 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:40.178236 (+464319us) raft_consensus.cc:1685] finished
0709 13:16:40.178256 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:40.178394 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33445,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":160,"thread_start_us":330972,"threads_started":2,"wal-append.queue_time_us":410735}
I20260709 13:16:40.211432  8840 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:40.223483  8837 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:40.199379 11655 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:40.235193  8843 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:16:40.237593  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 84642us
I20260709 13:16:40.230315  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:40.239761  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53512.4us
I20260709 13:16:40.239917  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:40.241078  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:40.231037  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.199513 11832 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:40.243554  8839 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:40.248131  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.206745 12021 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:40.210762 11638 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:40.217953 11897 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:40.273669  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1485) took 1029 ms. Trace:
I20260709 13:16:40.274693  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:40.265244 12006 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:40.168450 11949 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.275545  8839 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 11 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:40.274147  8760 rpcz_store.cc:276] 0709 13:16:39.244051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:39.388060 (+144009us) service_pool.cc:224] Handling call
0709 13:16:39.400396 (+ 12336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.001190 (+600794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.273379 (+272189us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400198054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:40.273603 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363762560}
I20260709 13:16:40.288743  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:40.273996  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:40.208742 12029 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.294683  8843 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:40.294968  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 145801us
W20260709 13:16:40.299283  8732 leader_election.cc:336] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.647s (SENT)
W20260709 13:16:40.295704  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.242862 12015 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:40.261183 12025 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:40.261931 12021 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:40.320782  8767 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:40.334908  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.293677 11932 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:40.344343  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55753.6us
I20260709 13:16:40.345419  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.300038 11999 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:40.351999  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54034.1us
I20260709 13:16:40.348598  8839 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.5-9.5]
W20260709 13:16:40.355430  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101729us
I20260709 13:16:40.294073 12006 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:40.319605 12025 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:40.340019 12021 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.318879 11897 raft_consensus.cc:2764] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:16:40.395345  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155497us
W20260709 13:16:40.400107  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 128575us
I20260709 13:16:40.401300  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:40.402875  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.404455  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.292177 12037 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:16:40.405822  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:40.390254 12025 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.415518  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:40.418762  8732 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.900s (SENT)
I20260709 13:16:40.390079 12001 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:40.425263  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:40.391225 12046 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:40.434482  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.436396  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.396277 12005 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.377521 11999 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.445189 12006 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.341003 12015 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.394755 12036 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:16:40.474882  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:40.477877  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 229866us
I20260709 13:16:40.441298 11725 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.435854 12022 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:40.468626 12019 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.770s	user 0.000s	sys 0.004s
I20260709 13:16:40.448325 11793 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:40.447126 12045 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.429457 11655 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:40.504846  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:40.455829  9459 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:40.473491 11897 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:40.401337 11638 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.500836 12022 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.527570  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:40.554141  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:40.569334  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 66155.7us
W20260709 13:16:40.597098  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 191344us
I20260709 13:16:40.513069 12051 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:40.601763  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 205763us
I20260709 13:16:40.619359  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:40.527146 12022 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.526038 12061 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:40.466017 12046 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.643524 12071 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:40.644402 12071 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:40.644958 12071 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.516247 11725 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:40.650066 12054 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
W20260709 13:16:40.652819 12053 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:16:40.654577 12015 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:40.655395 12044 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 13:16:40.639079 12051 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:40.658222 12051 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.597952 11996 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.661036 12063 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.661913 12063 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.624409 12062 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:40.673775 12029 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.674217  8763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:16:40.674921  8763 raft_consensus.cc:606] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:40.674770 12029 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:40.675403  8763 raft_consensus.cc:614] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:40.675697  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:40.677513  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58300.8us
I20260709 13:16:40.678743  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:40.681452 12059 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:40.682292 12059 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:40.687103 12046 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:40.687968 12046 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:40.524489 12045 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:40.677531 12042 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:16:40.693723  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:40.694578 12045 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.643730 12005 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.695677 11949 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.696341 12005 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.697088 12052 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.737080  8843 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
W20260709 13:16:40.739287  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 98333us
I20260709 13:16:40.630751 11638 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.740172  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.633493 11698 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.728484 12046 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:40.701213 11725 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:40.625929 12023 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:40.774094  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.713632 12029 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:40.627347 11793 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:40.763618 12059 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:40.739506 11932 raft_consensus.cc:2764] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:40.648274 12025 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.801928  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.775472 12046 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.806203 12063 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:40.781760 12023 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.784550 12029 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:40.611999 11655 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:40.797509 12009 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:40.939798  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 102836us
W20260709 13:16:40.812785 12034 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.638s	user 0.007s	sys 0.004s
I20260709 13:16:40.792196 12062 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:40.945972  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.813771 12036 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:40.827000 12046 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.956146  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.825970 12045 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:40.943542 12000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.045s	sys 0.070s
I20260709 13:16:40.962143  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:40.961293  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 259486us
I20260709 13:16:40.857030 12023 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.940004 12029 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:40.787039 12057 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:16:40.944257 11999 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:40.970306  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:40.969672  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.974334  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:40.965045  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:40.966619  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:40.965832  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:40.819536 12059 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.138s
W20260709 13:16:40.966034  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:40.982353  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:40.982582  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.018523  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:41.033468  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.040361  8910 raft_consensus.cc:2376] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:16:40.958061 12061 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:41.034304  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.045398  8912 raft_consensus.cc:2410] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:16:40.971547 12000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.045s	sys 0.070s
W20260709 13:16:41.034416  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 270953us
I20260709 13:16:41.034582  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.014782  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.036471  8915 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:41.054690  8843 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
W20260709 13:16:41.041513  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67243.6us
I20260709 13:16:41.042831  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:41.067656  9431 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.647s (SENT)
W20260709 13:16:41.038729 11875 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.871s	user 0.012s	sys 0.010s
I20260709 13:16:40.974895 12036 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.180447  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:41.173951  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 87358.2us
I20260709 13:16:41.056200  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.088397  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:41.190533  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:41.153460  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110710us
W20260709 13:16:41.217180  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 149571us
W20260709 13:16:41.217532 12064 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.396s	user 0.000s	sys 0.000s
W20260709 13:16:41.183378  9434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.828s (SENT) [suppressed 51 similar messages]
I20260709 13:16:41.187209  8763 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:41.086213 12063 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.160s
I20260709 13:16:41.051015 12041 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.165s
I20260709 13:16:41.214939 12083 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:41.042428 11999 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:41.222680  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:41.223716  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:41.037420 12065 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:41.228225  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.233999  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.234375  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:40.972316 12062 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.167528 12057 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.241367  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.194553 12015 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:16:41.225013 12014 consensus_meta.cc:287] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.257s	user 0.015s	sys 0.000s
I20260709 13:16:41.278232  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:41.268797  8911 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:41.272814  8839 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:41.281761  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.282724  8915 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:41.273237  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:41.284475  8837 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:41.218653 12030 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:41.050560 12058 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.388s
I20260709 13:16:41.288697  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.279227  8914 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:41.242633 12037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.012s	sys 0.029s
W20260709 13:16:41.292024  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 68601.9us
I20260709 13:16:41.040452 11793 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.242218 11951 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:41.213992 11875 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:41.274572 12021 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.007s
I20260709 13:16:41.292279  8843 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:41.308323  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:41.240782 11897 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.056s
I20260709 13:16:41.298715  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:41.301721  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 118370us
I20260709 13:16:41.303254  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.303368  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:41.294749 12058 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:41.304301  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.298182 11887 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:41.273041 12050 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:41.305138  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:41.309011  8761 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:41.293727 12037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.012s	sys 0.030s
I20260709 13:16:41.311396  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1497) took 1194 ms. Trace:
I20260709 13:16:41.311622  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:41.294977 12064 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:16:41.303653  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.321916  8763 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:41.266350 12083 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:41.322535 12077 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:16:41.321357  8769 rpcz_store.cc:276] 0709 13:16:40.116853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.117024 (+   171us) service_pool.cc:224] Handling call
0709 13:16:40.139445 (+ 22421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.344789 (+205344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.344834 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.354191 (+  9357us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.414924 (+ 60733us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:40.414963 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:41.303948 (+888985us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400377b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:41.304002 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.304050 (+    48us) raft_consensus.cc:1685] finished
0709 13:16:41.304069 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.311311 (+  7242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471431936,"thread_start_us":60396,"threads_started":1,"wal-append.queue_time_us":81308}
I20260709 13:16:41.323369  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:41.323632 12000 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:41.286751 12061 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.324573  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:41.324909 12079 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:41.325357  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.319052  8767 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:41.325977 12056 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.619s	user 0.003s	sys 0.000s
I20260709 13:16:41.327224  8767 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:41.327528  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.314134  8760 raft_consensus.cc:2376] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11. Re-sending same reply.
I20260709 13:16:41.325295  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:41.318099  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:41.295045 12016 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.304404  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.301672 11951 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:41.329358  8765 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:41.336275  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:41.324129  8763 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:41.317968  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:41.326061  8911 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:41.315912  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:41.312294 11897 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.014s	sys 0.057s
I20260709 13:16:41.337724  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1676) took 1143 ms. Trace:
I20260709 13:16:41.338027  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.341902 12087 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:41.343359  8807 leader_election.cc:336] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.506s (SENT)
I20260709 13:16:41.338315 12089 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:41.343870  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:16:41.355139 12078 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:16:41.377657 12076 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:41.361232 12059 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:41.327551 11931 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:16:41.378479  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:41.378858 11931 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:41.379464 11931 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:41.362787  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45026.4us
I20260709 13:16:41.291772 12014 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.295142 12015 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.321821 12048 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:41.370548  8841 rpcz_store.cc:276] 0709 13:16:40.184825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.204995 (+ 20170us) service_pool.cc:224] Handling call
0709 13:16:40.224826 (+ 19831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:40.235415 (+ 10589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.235446 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:40.298575 (+ 63129us) log.cc:844] Serialized 26 byte log entry
0709 13:16:40.788038 (+489463us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:40.788167 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.788369 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.328460 (+540091us) raft_consensus.cc:1685] finished
0709 13:16:41.328477 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:41.328592 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3420,"raft.queue_time_us":3734,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":15183,"thread_start_us":449184,"threads_started":1,"wal-append.queue_time_us":606299}
I20260709 13:16:41.346939 12066 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:41.373201  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 57421us
I20260709 13:16:41.320515 11887 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:41.308985 12030 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.313747 12063 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:16:41.384196  8807 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.575s (SENT)
I20260709 13:16:41.384187  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.389358  8914 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:41.376387 11897 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:41.390798  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:41.316505 12075 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:41.397518  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:41.401710  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:41.310905 12021 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.405462 12102 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:41.388938 12002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.002s	sys 0.005s
W20260709 13:16:41.461949  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.343525 12016 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.473073  8917 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:41.400275 12071 consensus_meta.cc:287] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.007s
W20260709 13:16:41.497917  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 119525us
W20260709 13:16:41.498303  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 96693.7us
W20260709 13:16:41.522006  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.361588 11951 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.402621 12066 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.384635 12059 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:41.395876 12048 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:41.581554  8844 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:41.494931 12001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.015s	sys 0.026s
I20260709 13:16:41.588707  8761 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:41.406306 11998 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:41.600674  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 197136us
I20260709 13:16:41.543316 12076 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:41.590178  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 206004us
I20260709 13:16:41.603636  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:41.546636  8768 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:41.497666 12002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.002s	sys 0.005s
W20260709 13:16:41.592120 12001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.015s	sys 0.027s
W20260709 13:16:41.619294  8807 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.587s (SENT)
I20260709 13:16:41.587663 12066 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:41.473073 12102 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:41.650379  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 144003us
I20260709 13:16:41.584156 11701 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:41.633836  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:41.651353  8732 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.642s (SENT)
I20260709 13:16:41.651901  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:41.407115 12079 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.205s
W20260709 13:16:41.660650  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52676.8us
I20260709 13:16:41.604075 12000 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:41.685325  8807 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.644s (SENT)
W20260709 13:16:41.687392  8807 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.739s (SENT)
I20260709 13:16:41.687911  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:41.688974 12089 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.690398 12085 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:41.641815 12001 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:41.700584  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 48032.5us
I20260709 13:16:41.650607 12036 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:41.701720  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 92605.6us
W20260709 13:16:41.704710  8732 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.738s (SENT)
I20260709 13:16:41.657428 11701 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:41.702768  8761 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:41.731725  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:41.673146 11944 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:41.658674 12102 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:41.500698 11931 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.717155  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:41.666388 12074 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:41.582386 12071 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.669094 12058 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:16:41.724069 11951 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:41.697204 12002 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:41.765588  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:41.792348  8761 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:41.690987 12085 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:41.765532  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 59512.5us
I20260709 13:16:41.699715 12069 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.362s
I20260709 13:16:41.732431 12021 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:41.776539 12097 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.119s	user 0.002s	sys 0.000s
I20260709 13:16:41.776953 12104 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:41.778147 12071 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:41.692652 11887 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.781023 12108 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 13:16:41.768654 12076 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.781307 12091 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:41.750850 12090 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:41.781906 12086 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:41.750914 11701 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:41.783458 11931 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:41.881561  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:41.883895  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.785804 12068 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:41.885720 12068 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.887310  8761 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
W20260709 13:16:41.787228 12022 consensus_meta.cc:287] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.117s	user 0.010s	sys 0.000s
I20260709 13:16:41.753609 12048 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.788758 12016 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:41.789515 12084 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:16:41.773118 12074 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.701426 11875 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:41.766228 11655 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:41.830294  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101653us
I20260709 13:16:41.770313 12003 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:41.700002 12000 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.764955 11944 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:41.695861 11897 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.852064 12030 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:41.854801 12015 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:41.841444 12104 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.101972 12104 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:41.849849 12073 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:16:42.105266 12034 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.105734 12034 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:42.106609 12034 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.108006 12034 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:41.858265 12005 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.161s	user 0.013s	sys 0.000s
I20260709 13:16:41.858717 12085 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.109448 12005 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:41.858574 12001 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:41.860498 11638 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.094s	user 0.009s	sys 0.002s
I20260709 13:16:41.864274 11887 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:41.869029 12091 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:41.875893 12086 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:41.877866  8768 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:41.879122  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.868362  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.906956  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.117652  8841 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:42.118884  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.119498  8841 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:42.120323  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:41.911839  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:42.120760  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.121176  8761 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:42.122081  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.751302 12059 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.093207 11949 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:41.917258  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 398751us
I20260709 13:16:41.943977 12057 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:16:42.125345 12000 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.125996 12057 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.126541 12057 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:42.127353 12057 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.127879  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.034111 12062 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.129217  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.129376  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.128605 12057 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.129490  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.093670 11944 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:42.130765 11944 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:42.036705 12117 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:42.044718  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:42.133267  8769 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.133594  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.134742  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.135716  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:41.907783 12068 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:41.963099 12066 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.053143  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:41.986939  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:42.023999  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.062376 12128 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:41.982694 12029 consensus_meta.cc:287] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.947s	user 0.010s	sys 0.002s
W20260709 13:16:41.985059  8732 leader_election.cc:336] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.551s (SENT)
I20260709 13:16:41.942173  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:42.116324 12030 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.200904 12066 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.201534 12030 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.203579 12025 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.171373 11875 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.206581 11875 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.207123  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.208192  8835 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:42.171569 12072 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:42.209038  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 224026us
I20260709 13:16:42.209281 12072 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.974221 12074 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:41.949043  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.231s (SENT)
I20260709 13:16:42.211608  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:41.969305 11698 consensus_meta.cc:287] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.192s	user 0.011s	sys 0.002s
W20260709 13:16:41.971153 12052 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.273s	user 0.007s	sys 0.005s
I20260709 13:16:41.906062 12079 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:16:41.981658 12046 consensus_meta.cc:287] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.000s
I20260709 13:16:41.943305 12106 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:42.235603 12046 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.236680 11996 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.237128 11996 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:42.237969 12046 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:41.909251 12014 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:41.914716 12022 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:41.982331 12089 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:42.030069 12065 consensus_meta.cc:287] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.738s	user 0.011s	sys 0.000s
I20260709 13:16:42.246717 12065 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.090314  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1496) took 1974 ms. Trace:
I20260709 13:16:42.247972  8917 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
I20260709 13:16:42.247545  8766 rpcz_store.cc:276] 0709 13:16:40.116267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.116427 (+   160us) service_pool.cc:224] Handling call
0709 13:16:40.117106 (+   679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:40.139910 (+ 22804us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:40.315744 (+175834us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.059454 (+1743710us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18003388c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287
0709 13:16:42.059871 (+   417us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.089895 (+ 30024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.089967 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:42.090027 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.090101 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.090256 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48019,"prepare.queue_time_us":37588,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":87,"raft.queue_time_us":149054,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":58967,"spinlock_wait_cycles":5694720,"thread_start_us":300965,"threads_started":4,"wal-append.queue_time_us":176366,"wal-append.run_cpu_time_us":2620,"wal-append.run_wall_time_us":1184956}
I20260709 13:16:42.092301 12076 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.250058  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.250468 12055 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.250329 12076 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.251338  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.211818 12062 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.252142  8918 raft_consensus.cc:2410] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:42.211440 12002 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.110276 12075 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:41.988623  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.133283  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.118908  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:42.139744  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.009984 11701 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.165488  8769 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:42.088984 12003 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:42.139108  8841 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:42.172778  8909 raft_consensus.cc:2410] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:42.176335 12073 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.184291 12104 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:42.136921  9432 connection.cc:256] RPC call timeout handler was delayed by -1.1404197819999808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 13:16:42.032974 12102 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:42.195360  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 253291us
I20260709 13:16:42.197716 12029 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.199095 12128 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.199982  8767 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:42.216832  8732 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.961s (SENT)
I20260709 13:16:42.217387  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.208628 11875 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:42.209004 12023 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.175s	user 0.011s	sys 0.001s
I20260709 13:16:42.224566  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.234686  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.224190  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:42.239311  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 290321us
I20260709 13:16:42.242653  8916 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:42.213917 11887 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.230471 12052 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.245662 12089 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.249374  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.203585 12030 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.099174 12009 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:42.251969 12062 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.238233 11944 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.442468  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.444289  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:42.445304  9431 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.481s (SENT)
I20260709 13:16:42.446882  8917 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
W20260709 13:16:42.448756  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 224590us
W20260709 13:16:42.362002  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.451318  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.455224  8843 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.457195  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:42.222787 11698 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.458861  8762 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:42.464318 12065 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:42.459724 11897 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:42.464882  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.465457  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.473784  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.449821  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:42.504995  8913 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:42.493057  9432 connection.cc:256] RPC call timeout handler was delayed by -1.0352361320001364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
W20260709 13:16:42.495934  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 279133us
I20260709 13:16:42.500320  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 314) took 1347 ms. Trace:
W20260709 13:16:42.509367  8732 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.973s (SENT)
I20260709 13:16:42.509956  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.510483  8915 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:42.510910  8838 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:42.223292 12079 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:42.514647  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.483603  8912 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:42.321504 12134 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:16:42.511781  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 62086.4us
I20260709 13:16:42.516724  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.512243  8764 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:42.512163  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:42.515769  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 291219us
I20260709 13:16:42.380520 11793 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.446496 11887 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:42.460207 12009 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.500424 12059 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:42.503294  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.321504 12072 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.520929  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.521970  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:42.523281  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1697) took 1251 ms. Trace:
I20260709 13:16:42.537770  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.540251  8917 raft_consensus.cc:2376] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5. Re-sending same reply.
I20260709 13:16:42.541108  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:42.538622  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.509171  8844 rpcz_store.cc:276] 0709 13:16:41.152762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.174248 (+ 21486us) service_pool.cc:224] Handling call
0709 13:16:41.216709 (+ 42461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.586593 (+369884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.500069 (+913476us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b540006b654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:42.500260 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":838595328}
I20260709 13:16:42.324295 12091 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.520282 11998 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.537153 12130 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.237936 11996 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.525542 12061 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:42.525935  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.524622  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:42.499531 12075 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.510095 12100 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:42.532080 12128 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.543264 12021 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:42.544353 11996 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.509876 12065 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:42.530352 11944 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.511654 12073 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.508112 12002 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.538731  8840 rpcz_store.cc:276] 0709 13:16:41.271756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.272018 (+   262us) service_pool.cc:224] Handling call
0709 13:16:41.294165 (+ 22147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.503738 (+209573us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:16:41.728263 (+224525us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.189874 (+461611us) log.cc:844] Serialized 14 byte log entry
0709 13:16:42.190068 (+   194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:42.190132 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:42.190196 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.516841 (+326645us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b18004007e0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419
0709 13:16:42.523037 (+  6196us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540039c1d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:42.523092 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.523228 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31190,"prepare.queue_time_us":102639,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":77,"raft.queue_time_us":195,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":24238,"spinlock_wait_cycles":570797440,"thread_start_us":604769,"threads_started":2,"wal-append.queue_time_us":503144}
I20260709 13:16:42.575917 12062 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.576527  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.578079  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.579622  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.561909 12091 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:42.549106  8732 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.984s (SENT)
W20260709 13:16:42.581053  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.552140  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.581168 12091 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:42.581715 12091 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.581485  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.582322  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.510344 11638 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:16:42.583427  8732 leader_election.cc:336] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.611s (SENT)
I20260709 13:16:42.547924 12030 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.553550 12079 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.554188  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.585254 12079 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.585367  9460 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:42.554388 12100 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.589344 12030 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.534112 12104 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:42.533811 11701 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:42.520053 11875 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:42.540980  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:42.600538  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 59653.1us
I20260709 13:16:42.601788  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.602138 12009 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.535223 11887 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.572382 12003 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.603564 12003 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.604408 12061 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.565958  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.566412  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.506042 12023 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.551426  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.583468  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.555220  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:42.584635  8732 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.124s (SENT)
I20260709 13:16:42.591228  8844 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:42.593106  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.509974 11897 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.600329  8767 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:42.602502  8761 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:42.636260  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.635375  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.637012  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1702) took 1361 ms. Trace:
I20260709 13:16:42.635104  8840 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
W20260709 13:16:42.638391  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.638871  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.639067 12102 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.639412 11701 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.640081 11701 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.534847 11793 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.570312 12021 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:42.642061 12021 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.642786 11793 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:42.643607  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.644352 12073 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:42.644645 12034 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.536s	user 0.006s	sys 0.007s
I20260709 13:16:42.644943 11701 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:42.639225  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.646011 11638 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:42.646844 11897 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.647415 12128 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:42.648566 12128 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:42.648950 12128 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:42.649223  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:42.649672  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:42.649780 12128 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.650801  9467 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:42.651104 12128 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.651746 12059 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.652232 12059 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.652531  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.652776  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.653283  9460 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:42.588689 12100 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:42.654057  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.654168  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:42.655397  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.655637  8763 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:42.635792 12025 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.656764  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.657449  9465 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:42.659070 12002 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.653301  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:42.661653 12029 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.662164  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.662844  8912 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:42.663852  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.281996 12086 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.665360  8914 raft_consensus.cc:2410] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:42.639321  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:42.665644 12086 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:42.666329  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.666709  8840 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.667037  8917 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:42.667769  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.667936  8840 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:42.654302 12059 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:42.669137  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.669445  8841 raft_consensus.cc:1813] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Handling vote request from an unknown peer bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.669265 12065 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.670029  8841 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:42.670440 12029 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.671079  8835 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:42.671401  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 86823.3us
I20260709 13:16:42.671732  8840 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:42.672161  8732 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.156s (SENT)
I20260709 13:16:42.672191 12023 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.669957  8918 raft_consensus.cc:2410] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:16:42.604907 12061 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.672942  8840 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:42.673219 12061 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.673657  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.674118  8840 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.674768  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.674911 12075 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:42.672706  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:42.675995 12014 consensus_queue.cc:1175] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "773340b2958e4af5b2010b902b9e9c04" responder_term: 5 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.4-4.4]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:42.676664 12029 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.606348  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:42.676836  8840 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.637578  8844 rpcz_store.cc:276] 0709 13:16:41.276093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.556990 (+1280897us) service_pool.cc:224] Handling call
0709 13:16:42.572806 (+ 15816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.636729 (+ 63923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.636947 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:42.677047  8762 raft_consensus.cc:1813] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Handling vote request from an unknown peer bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.680315  8762 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:16:42.668756  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.681493  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:42.605686  9461 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:42.682320  8917 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:42.687672  8769 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.563376  8843 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:42.690476  8844 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:42.691246 12009 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.691591  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.692936  8844 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
W20260709 13:16:42.613860  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47961us
I20260709 13:16:42.694720  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:42.677847  8732 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.157s (SENT)
I20260709 13:16:42.696539  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.637250  8766 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:42.704922  8843 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:42.605152 12062 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:42.717363  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.607836 11998 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.726804  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:42.729921  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.731742  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:42.720949 12029 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.736742  8843 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.741823  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.733189 11998 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.733464 11875 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:42.736089 12050 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:16:42.736227 12030 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:42.747607 12030 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:42.710536 12111 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:42.677342 12104 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:16:42.749550  8840 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.750062  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.755055  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.749821  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1683) took 2450 ms. Trace:
I20260709 13:16:42.748663 12030 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.753233 12005 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:42.759989 12072 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:42.769618  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.770569  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:42.756243  8836 rpcz_store.cc:276] 0709 13:16:40.286330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.291248 (+  4918us) service_pool.cc:224] Handling call
0709 13:16:40.296308 (+  5060us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:40.717472 (+421164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:40.717511 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:40.763847 (+ 46336us) log.cc:844] Serialized 52 byte log entry
0709 13:16:40.970337 (+206490us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:40.970379 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:40.970445 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:41.954654 (+984209us) raft_consensus.cc:1685] finished
0709 13:16:41.954686 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:42.726143 (+771457us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b54003a6450. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:42.736132 (+  9989us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44432,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":31039,"spinlock_wait_cycles":10328320,"thread_start_us":602246,"threads_started":2,"wal-append.queue_time_us":560963}
I20260709 13:16:42.782095  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.784847  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:42.719511 12075 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:16:42.791538  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.793540  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.794399  8918 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.763305 12061 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.773258 12005 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:42.810089 12075 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.810846 12075 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:42.811977 12061 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.812048 12075 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.816016  8912 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:42.816762 12075 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.826011  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:42.827206 12003 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.827642 12003 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:42.828218 12079 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:42.828253 12003 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.831211  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:42.832072  8763 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.834838  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.836081  8761 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:16:42.835877  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:42.840950  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.842166  8769 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:42.843187  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:42.846400  8909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1518) took 1881 ms (client timeout 1575 ms). Trace:
I20260709 13:16:42.846896  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1527) took 1625 ms. Trace:
W20260709 13:16:42.847011  8909 rpcz_store.cc:269] 0709 13:16:40.964959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.965551 (+   592us) service_pool.cc:224] Handling call
0709 13:16:42.846029 (+1880478us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400259754. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:42.846237 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2612440320}
I20260709 13:16:42.847553  8916 rpcz_store.cc:276] 0709 13:16:41.221607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.221766 (+   159us) service_pool.cc:224] Handling call
0709 13:16:41.241170 (+ 19404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.461121 (+1219951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:42.846560 (+385439us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54003af054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:42.846819 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294381824}
I20260709 13:16:42.850425  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:42.852448  8768 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1543) took 1559 ms (client timeout 2018 ms). Trace:
I20260709 13:16:42.853367  8762 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:42.853788  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.854975  8909 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:42.738662 12062 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.844507  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:42.858434  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.859308  8761 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:16:42.853034  8768 rpcz_store.cc:269] 0709 13:16:41.292498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.316645 (+ 24147us) service_pool.cc:224] Handling call
0709 13:16:42.852207 (+1535562us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400299d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:42.852341 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509176704}
I20260709 13:16:42.861824  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.858625  8769 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:42.864059  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.798869  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:42.865530  8765 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:42.800516 12023 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:42.868993  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.873451  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.874043  8909 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:16:42.786537 12002 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:16:42.869815  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.877305  8841 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:42.877605  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:42.877699  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 263007us
I20260709 13:16:42.877837  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:42.878196  8765 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:42.878996  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:42.879768  9431 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.834s (SENT)
I20260709 13:16:42.874866  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:42.881806 12034 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:42.880553  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.882236  8843 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:42.882454  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:42.827638 12089 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.883294  8761 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:42.883682  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.861148 12015 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:42.894119  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:42.894315 12015 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.895447  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.896787  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:42.897120  8839 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:16:42.896588 12015 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:42.880411  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.885453  8918 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:42.882577  8916 raft_consensus.cc:2376] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:16:42.879041 12071 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:42.893555  8843 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:42.893905  8761 pending_rounds.cc:85] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 2
I20260709 13:16:42.906870  8761 pending_rounds.cc:107] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:42.907151  8761 raft_consensus.cc:2889] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:42.903936  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:42.902653  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.908062  8842 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:42.861009 11701 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:42.862363 12091 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:42.909402  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:42.911154  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.912911  8844 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:42.914878  8909 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:16:42.914892  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:42.916189  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:42.918313  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.918545  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:42.919072  8909 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:42.919404  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:42.920076  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.882673 12023 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:42.890472 12034 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.925197  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:42.906705 12059 raft_consensus.cc:2764] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:42.909840 12029 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:42.927994  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.941250  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.916682 12089 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.925014 12005 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:42.926115 12100 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.925369 12072 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:42.923765 12015 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:42.951228  8769 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:42.953528  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:42.954248  8769 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:42.950373  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.931113 12034 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:42.963325  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 254028us
I20260709 13:16:42.959738  8909 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
W20260709 13:16:42.965678  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 241735us
I20260709 13:16:42.965155  9432 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:42.975082  8769 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:42.977824  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.913381 12071 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:42.980948  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:42.957906 11701 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:42.948561 12089 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.952809 12015 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:42.948410 12072 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:42.961223 12005 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:42.961016 12100 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:42.997790  8766 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:16:42.949079 12029 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.022976 11638 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:43.049109  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:43.057575  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.059269  8769 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.059854  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:43.061600  8909 raft_consensus.cc:2368] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
W20260709 13:16:43.062656  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 262895us
I20260709 13:16:43.066330  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.068087  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.069051  8909 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:43.073800  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:43.075450  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110405us
I20260709 13:16:43.047520 12089 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.050298 12015 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.041580 12145 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.083139  8807 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:43.059247 12072 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:43.083756  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 117041us
W20260709 13:16:43.087460  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 180903us
I20260709 13:16:43.047853 12062 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.090752  8769 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:43.092227  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:43.093150  8769 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:43.093207  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:43.093145  8883 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:43.094395  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:43.095952  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:43.097401  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:43.101263  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.103508  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:43.106526  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:43.026252 12023 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.085299  8809 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:43.063056 12144 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:43.121254  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:43.116282  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:43.084393 12009 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:43.143026  8841 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:43.135336  8765 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:43.049923 11701 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.145222  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:43.141398  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 90203us
W20260709 13:16:43.147743  8732 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.307s (SENT)
I20260709 13:16:43.082018 12021 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:16:43.167320  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:43.100695  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.087092 12030 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.072115 11638 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.158437  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.174129  8909 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:43.169531  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 69038.2us
I20260709 13:16:43.177088  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:43.120393 12144 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:43.132978 12091 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.143666 12073 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.179447  8765 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:43.135124 11944 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:43.172437  8763 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:43.184067 11701 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:43.183054 12046 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:43.183463  8732 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.428s (SENT)
I20260709 13:16:43.189173 12071 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.148476 12006 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.144064 11793 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:43.196508 12057 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.204330  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:43.160673 12025 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.210474  8768 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:43.222569 11698 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.221468  8765 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:16:43.233805 12086 consensus_meta.cc:287] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.568s	user 0.013s	sys 0.000s
W20260709 13:16:43.236038  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52599.9us
I20260709 13:16:43.149518 12009 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:43.195655 12144 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.178249 12030 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:43.217991  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124893us
I20260709 13:16:43.180887 12145 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:43.228935 12130 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:43.265940  8732 leader_election.cc:336] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.501s (SENT)
W20260709 13:16:43.267246  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 151039us
I20260709 13:16:43.287509  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:43.292696  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.223896 12073 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:43.235615 12062 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.302402 12029 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.241940 11701 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:16:43.190287 12100 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:43.304343 12143 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:16:43.305127 12139 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:16:43.307613 12030 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.285120 12009 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:43.259290 11698 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:43.190694 12005 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.309545 11698 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.310541 11698 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.279151  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1540) took 1987 ms. Trace:
I20260709 13:16:43.240855 11793 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:43.287513  8763 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:43.219550 12074 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:16:43.298471  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.312556  8760 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:43.312139  8764 rpcz_store.cc:276] 0709 13:16:41.291426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.291788 (+   362us) service_pool.cc:224] Handling call
0709 13:16:41.308516 (+ 16728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.517724 (+1209208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.278831 (+761107us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400338e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:43.279083 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2767744384}
W20260709 13:16:43.337908  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72158.1us
I20260709 13:16:43.252533 12150 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.265062 12057 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:43.319324  8837 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:43.347482  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:43.350078  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 204965us
I20260709 13:16:43.352507  9461 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:43.297631 12130 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:43.358662  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 50668.2us
I20260709 13:16:43.363591  8764 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.363588  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:43.365861  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:43.312095 12086 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:43.350858 12154 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:16:43.337327 11793 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.367390  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.360157 12074 consensus_queue.cc:1243] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:43.364143 12130 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:43.361500 12029 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:43.398041  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:43.376317  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 256091us
I20260709 13:16:43.363210 12052 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:43.389274 11638 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:43.389552 12169 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:16:43.391952 11887 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.789s	user 0.009s	sys 0.001s
I20260709 13:16:43.392787 12073 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:43.394325 12003 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.004s
I20260709 13:16:43.384454  8765 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:43.400559  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:43.407950  8809 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:16:43.409437  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 217559us
I20260709 13:16:43.364784 12091 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:43.416225  9461 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:43.428534  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:43.429548  9459 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:43.439607 12144 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:43.461575  8913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1525) took 2308 ms (client timeout 2190 ms). Trace:
I20260709 13:16:43.425961 12057 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:43.462046  8913 rpcz_store.cc:269] 0709 13:16:41.153267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.153804 (+   537us) service_pool.cc:224] Handling call
0709 13:16:43.461367 (+2307563us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002aadd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:43.461475 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3021339392}
I20260709 13:16:43.463135  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.464352  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:43.465386 12075 consensus_meta.cc:287] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
W20260709 13:16:43.465615  8915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1750) took 1337 ms (client timeout 1642 ms). Trace:
I20260709 13:16:43.465533 12046 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:16:43.466132  8915 rpcz_store.cc:269] 0709 13:16:42.128428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.129172 (+   744us) service_pool.cc:224] Handling call
0709 13:16:43.465412 (+1336240us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b540031a454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:43.465557 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873697152}
I20260709 13:16:43.466902 12046 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.467283  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.468050  8915 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:43.468565  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1769) took 1036 ms. Trace:
W20260709 13:16:43.469934  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.470317 12050 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:43.470709 12050 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:43.421583 11638 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:16:43.414884 11887 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.474613  8760 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:43.474828 11887 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.475884  8760 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:43.421878 12003 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.448071 12002 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.425798 12065 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.477705 12003 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:43.478559  8916 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:43.431281 12029 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:43.452426 12051 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.400036 12086 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:16:43.455557  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:43.456020  8807 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.630s (SENT)
I20260709 13:16:43.495850  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:43.457463 12168 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.457881  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:43.458387 12146 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:43.414955 12052 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:43.467290 12046 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:43.470785  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.448802 12006 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:43.479264  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44398.3us
I20260709 13:16:43.479329  8915 rpcz_store.cc:276] 0709 13:16:42.432173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.466998 (+1034825us) service_pool.cc:224] Handling call
0709 13:16:43.468503 (+  1505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.480029  8913 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:43.443785 12009 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.481652  8760 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:43.411108 11944 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:43.506739  8912 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.496137  8917 raft_consensus.cc:2410] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:16:43.508495  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52499.8us
I20260709 13:16:43.526628  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:43.511155  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.527643  8915 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:43.427270 12153 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:43.476501 12002 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.511621 12052 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:43.439607 12034 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.533310  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.534793  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.535715  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1768) took 1103 ms. Trace:
I20260709 13:16:43.535818  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.513290 12100 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.496025 12176 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:43.495095 12148 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.480917 12072 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.531266  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.574352  8915 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:43.495102 12014 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:43.487139 12015 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.496335 12059 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:16:43.537724  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.572777  8912 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:43.536163  8917 rpcz_store.cc:276] 0709 13:16:42.431898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.534496 (+1102598us) service_pool.cc:224] Handling call
0709 13:16:43.535618 (+  1122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.511526 12168 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.524748 11887 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.616142  8760 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:16:43.636353  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:43.637377  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101691us
I20260709 13:16:43.637812  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1764) took 1229 ms. Trace:
I20260709 13:16:43.622354  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.528911 11638 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:16:43.633292  8913 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:43.634680  8842 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.638134  8912 rpcz_store.cc:276] 0709 13:16:42.408948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.636076 (+1227128us) service_pool.cc:224] Handling call
0709 13:16:43.637760 (+  1684us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.633860  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af7776ba20a14a499de5919550fdada6"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:43.642848  8917 raft_consensus.cc:606] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.643411  8917 raft_consensus.cc:614] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:43.526582 12163 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:16:43.645656  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1765) took 1236 ms. Trace:
I20260709 13:16:43.646451  8913 rpcz_store.cc:276] 0709 13:16:42.409363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.523778 (+1114415us) service_pool.cc:224] Handling call
0709 13:16:43.645592 (+121814us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:43.646950  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110314us
I20260709 13:16:43.645838 12015 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.647642  8915 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:43.654126  8913 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:43.655670  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1772) took 1155 ms. Trace:
I20260709 13:16:43.656030  8913 rpcz_store.cc:276] 0709 13:16:42.500154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.647240 (+1147086us) service_pool.cc:224] Handling call
0709 13:16:43.653933 (+  6693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.655335 (+  1402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.655609 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.657482  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1780) took 1129 ms. Trace:
I20260709 13:16:43.657950  8915 rpcz_store.cc:276] 0709 13:16:42.527674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.575247 (+1047573us) service_pool.cc:224] Handling call
0709 13:16:43.657416 (+ 82169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.658608  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33996 (request call id 4) took 1038 ms. Trace:
I20260709 13:16:43.617555 12176 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:43.629199 12166 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.532822 12153 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.626305 12148 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.660303  8917 rpcz_store.cc:276] 0709 13:16:42.634456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.633637 (+999181us) service_pool.cc:224] Handling call
0709 13:16:43.643986 (+ 10349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.664654  8760 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:43.718499  8913 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:16:43.719112  8913 pending_rounds.cc:85] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 4
I20260709 13:16:43.719497  8913 pending_rounds.cc:107] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:16:43.719837  8913 raft_consensus.cc:2889] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:43.626082 12046 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:43.711819  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73753us
I20260709 13:16:43.727527  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.729439  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1773) took 1205 ms. Trace:
I20260709 13:16:43.729916  8913 rpcz_store.cc:276] 0709 13:16:42.519440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.656945 (+1137505us) service_pool.cc:224] Handling call
0709 13:16:43.718115 (+ 61170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.724936 (+  6821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.725149 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.730352  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:43.731403  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 330308us
I20260709 13:16:43.721266 12163 consensus_queue.cc:1243] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:16:43.681731 12089 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.004s
I20260709 13:16:43.706178 12186 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:43.742130  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:43.743835 12003 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:43.744716 12072 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.745379 12009 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.746438 12021 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:43.746626 12086 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.746995 11698 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.747375 12034 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:43.728793 12059 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:16:43.729262 11793 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.731964 12130 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.751562 12148 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.726223 12057 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.641382 11887 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.796934 12158 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.661245 12161 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:43.662405 12176 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:43.753962  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:43.741415 12046 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.781453 12163 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:43.680953 11944 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.661945 12052 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.733649 12166 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.777673  8913 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.839989  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 296) took 1194 ms. Trace:
I20260709 13:16:43.840458  8913 rpcz_store.cc:276] 0709 13:16:42.645449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.730946 (+1085497us) service_pool.cc:224] Handling call
0709 13:16:43.777466 (+ 46520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.839617 (+ 62151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.839915 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.795243 12021 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:43.821451  8841 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:43.816093 12057 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:43.816144 12189 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.852806 12021 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.837381  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1563) took 1062 ms. Trace:
I20260709 13:16:43.853353 12057 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.808312 12086 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.868887  8764 rpcz_store.cc:276] 0709 13:16:42.775278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.377609 (+602331us) service_pool.cc:224] Handling call
0709 13:16:43.399903 (+ 22294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.531772 (+131869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.531802 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.596696 (+ 64894us) log.cc:844] Serialized 26 byte log entry
0709 13:16:43.722903 (+126207us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:43.722960 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.723063 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:43.837151 (+114088us) raft_consensus.cc:1685] finished
0709 13:16:43.837178 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.837322 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":57014,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":205443,"threads_started":2,"wal-append.queue_time_us":175211}
I20260709 13:16:43.837211 12048 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.856508  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1747) took 1728 ms. Trace:
W20260709 13:16:43.859669  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.791738 12186 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.832904 12158 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:43.855533 11887 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:43.818894 12034 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:43.845168  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.869477  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1508) took 1275 ms. Trace:
I20260709 13:16:43.872125  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:43.872236  8914 rpcz_store.cc:276] 0709 13:16:42.127629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.128950 (+  1321us) service_pool.cc:224] Handling call
0709 13:16:43.856291 (+1727341us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54002ac6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:43.856443 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1230939392}
W20260709 13:16:43.874470  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 132488us
W20260709 13:16:43.875996 12182 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:43.789374 12089 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.881444  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:43.877420  8762 rpcz_store.cc:276] 0709 13:16:42.594335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.696627 (+102292us) service_pool.cc:224] Handling call
0709 13:16:42.853121 (+156494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.853917 (+   796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.869248 (+1015331us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400299d50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:43.869409 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358833024}
W20260709 13:16:43.881865  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.891288  8914 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:43.891463  8764 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:43.892200  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1541) took 1237 ms. Trace:
I20260709 13:16:43.892647  8914 rpcz_store.cc:276] 0709 13:16:42.655072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.877840 (+1222768us) service_pool.cc:224] Handling call
0709 13:16:43.890859 (+ 13019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.891856 (+   997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.892119 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.874200 12168 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.900915  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1555) took 1242 ms. Trace:
W20260709 13:16:43.916211  8809 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.920s (SENT)
I20260709 13:16:43.876796 12052 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.919648  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1559) took 1259 ms. Trace:
W20260709 13:16:43.921793  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.887558 12021 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:16:43.921439  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.921965  8914 rpcz_store.cc:276] 0709 13:16:42.660125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.893726 (+1233601us) service_pool.cc:224] Handling call
0709 13:16:43.918861 (+ 25135us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.919263 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.919303 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.919362 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:43.919408 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.919470 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.919588 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.918009  8913 rpcz_store.cc:276] 0709 13:16:42.658639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.878525 (+1219886us) service_pool.cc:224] Handling call
0709 13:16:43.900212 (+ 21687us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.900467 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.900507 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.900566 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:43.900620 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.900691 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:43.900831 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:43.890403 12009 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:43.876061 12153 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.936241 12059 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.936431  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:43.937812 12186 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.937973  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:43.938388 12186 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.938791  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:43.939106  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:43.940125  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:43.940253  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:43.941561 11897 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:43.941984 11897 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:43.942932 11897 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.943835  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1509) took 1349 ms. Trace:
I20260709 13:16:43.944273 11897 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:43.944207  8766 rpcz_store.cc:276] 0709 13:16:42.594644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.699403 (+104759us) service_pool.cc:224] Handling call
0709 13:16:42.724970 (+ 25567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.051164 (+326194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.943576 (+892412us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540025c454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:43.943778 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626730368}
W20260709 13:16:43.947582  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:43.896517 12057 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:43.945098 12161 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:43.938851 12186 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.949695  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:43.950676 12184 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:43.951754  8913 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:43.948308 12059 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.961637 12130 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:43.963214 12014 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:43.964490  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1697) took 2052 ms. Trace:
I20260709 13:16:43.990856 12014 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:43.990983  8835 rpcz_store.cc:276] 0709 13:16:41.912099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.219132 (+307033us) service_pool.cc:224] Handling call
0709 13:16:43.964290 (+1745158us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54002dfad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:43.964409 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512278912}
I20260709 13:16:43.991999 12014 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.992617  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:43.993096 12014 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:43.964641 12086 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:43.870028 12189 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.965330 12009 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:43.995869 12009 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:43.996624 12189 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:43.996943  8836 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:43.967031 12166 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.000424 12111 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:44.000650  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.000957 12111 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:44.001600  8837 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:44.005563 11698 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:43.969920  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1701) took 1093 ms. Trace:
I20260709 13:16:43.975800 12100 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:43.982311  8844 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:43.960531 12002 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.011795  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 293) took 1376 ms. Trace:
I20260709 13:16:43.987057 12102 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:16:43.994658  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:43.967485  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.013386  8918 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:43.983145 12158 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:43.989557  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1564) took 1250 ms. Trace:
I20260709 13:16:44.015297  8835 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.008355  8839 rpcz_store.cc:276] 0709 13:16:42.876372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.876532 (+   160us) service_pool.cc:224] Handling call
0709 13:16:42.893229 (+ 16697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:42.897545 (+  4316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.969650 (+1072105us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5400241b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:43.969864 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8364928}
I20260709 13:16:44.018870  8913 rpcz_store.cc:276] 0709 13:16:42.739237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.927408 (+1188171us) service_pool.cc:224] Handling call
0709 13:16:43.951503 (+ 24095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.989207 (+ 37704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:43.989484 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.012035  8844 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:44.015638  8915 rpcz_store.cc:276] 0709 13:16:42.635442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.658771 (+1023329us) service_pool.cc:224] Handling call
0709 13:16:43.663199 (+  4428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.724474 (+ 61275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.724516 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:43.725038 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.009272 (+284234us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:44.009310 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.009380 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.009423 (+    43us) raft_consensus.cc:1685] finished
0709 13:16:44.009438 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.011741 (+  2303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59698,"raft.queue_time_us":82092,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":211383,"threads_started":1,"wal-append.queue_time_us":209641}
I20260709 13:16:44.022358  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.026963  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1696) took 2119 ms. Trace:
I20260709 13:16:44.027534  8840 rpcz_store.cc:276] 0709 13:16:41.907919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.678411 (+770492us) service_pool.cc:224] Handling call
0709 13:16:42.683193 (+  4782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:42.754121 (+ 70928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.026684 (+1272563us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b54001e5d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:44.026894 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152178560}
W20260709 13:16:44.030026  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.046893  8918 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:44.047830  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1563) took 1386 ms. Trace:
I20260709 13:16:44.048265  8918 rpcz_store.cc:276] 0709 13:16:42.682978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.908982 (+226004us) service_pool.cc:224] Handling call
0709 13:16:43.967322 (+1058340us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b58001d1f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:44.047744 (+ 80422us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5412096}
I20260709 13:16:44.050617  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:44.050411  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.052699  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.054169  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1528) took 2820 ms. Trace:
I20260709 13:16:44.007524 11698 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.056975  8835 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:16:44.053155  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:44.061411  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.061338  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.063160  8840 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:44.026172 12079 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.069533  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.069826  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.070453  8835 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:44.062968 12072 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:44.073770  8837 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:44.074002  8835 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:44.001886 12111 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.054361 12158 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:43.988879 12161 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.053879 12175 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:16:44.078799  8835 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.067713 12195 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:44.109165 12195 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.110224 12195 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.036479 12021 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:16:44.113440 12021 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.113843 12021 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:44.114171  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1524) took 1314 ms. Trace:
I20260709 13:16:44.114571  8767 rpcz_store.cc:276] 0709 13:16:42.799905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.462490 (+662585us) service_pool.cc:224] Handling call
0709 13:16:43.462818 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.733598 (+270780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.741486 (+  7888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:43.741545 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:43.741592 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.113916 (+372324us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000baed4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:44.113960 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.114101 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622197120}
I20260709 13:16:44.114670 12021 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.116638  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1510) took 1521 ms. Trace:
I20260709 13:16:44.117312  8768 rpcz_store.cc:276] 0709 13:16:42.594936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.880323 (+285387us) service_pool.cc:224] Handling call
0709 13:16:43.210132 (+329809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:43.252214 (+ 42082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.116404 (+864190us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54001a7f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:44.116576 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":725807872}
W20260709 13:16:44.092347  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.098562 12158 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.099442 12144 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.135454  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1560) took 1475 ms. Trace:
I20260709 13:16:44.082386 12072 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:44.135831 12166 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:44.136669  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.136822 12166 consensus_queue.cc:1243] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:44.136919 12072 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:44.137929  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.140554  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:44.141527 12076 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.142477  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:44.080688 12083 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.105420 11793 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.105690  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1711) took 1018 ms. Trace:
I20260709 13:16:44.105976 12163 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.072737 12079 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.144189  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:44.144526 12163 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.145008  9466 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:44.145120  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1565) took 1403 ms. Trace:
I20260709 13:16:44.145572 12163 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.106437 11698 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.145536  8916 rpcz_store.cc:276] 0709 13:16:42.741899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.949047 (+207148us) service_pool.cc:224] Handling call
0709 13:16:44.144887 (+1195840us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54001d2c54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:44.145060 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009274112}
I20260709 13:16:44.147451  8917 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:44.148020  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.148835 12079 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.108552 12111 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.109272  8843 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:44.085743 12191 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:16:44.158947  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:44.079779 12052 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:16:44.083498  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:44.131558  8665 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 94) took 24494 ms (client timeout 15000 ms). Trace:
I20260709 13:16:44.133419 12022 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.133852  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet c79353780ac54a25bd9999800873bbeb with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42810
I20260709 13:16:44.134400 11998 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:44.135166 12174 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.695s	user 0.000s	sys 0.004s
I20260709 13:16:44.143198  9462 raft_consensus.cc:2376] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:16:44.146507  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1512) took 1551 ms. Trace:
I20260709 13:16:44.130625 12021 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.148684 12050 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:44.163353  8665 rpcz_store.cc:269] 0709 13:16:19.637954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.638314 (+   360us) service_pool.cc:224] Handling call
0709 13:16:19.823651 (+185337us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400002490. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc760b2 00007fce75befa89 00007fce75b87da6 00007fce75b59088 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc
0709 13:16:44.131459 (+24307808us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:40.105619 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:40.106409 (+   790us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:40.106473 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:16:40.106497 (+    24us) tablet.cc:662] Decoding operations
0709 13:16:40.107708 (+  1211us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:40.107818 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:40.107845 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:16:40.112813 (+  4968us) tablet.cc:701] Row locks acquired
0709 13:16:40.112888 (+    75us) write_op.cc:260] PREPARE: finished
0709 13:16:40.113064 (+   176us) write_op.cc:270] Start()
0709 13:16:40.113225 (+   161us) write_op.cc:276] Timestamp: P: 1783603000112992 usec, L: 0
0709 13:16:40.113245 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:16:40.264084 (+150839us) log.cc:844] Serialized 5022 byte log entry
0709 13:16:40.672402 (+408318us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b18002ec2a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:41.621686 (+949284us) op_driver.cc:464] REPLICATION: finished
0709 13:16:41.886292 (+264606us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b18002ec2a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd17190 00007fce6fd10ae7 00007fce6fd0fdd9
0709 13:16:42.046496 (+160204us) write_op.cc:301] APPLY: starting
0709 13:16:42.046603 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:42.046920 (+   317us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:42.046962 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:42.053098 (+  6136us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:42.053531 (+   433us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:16:42.053600 (+    69us) write_op.cc:312] APPLY: finished
0709 13:16:42.054113 (+   513us) log.cc:844] Serialized 88 byte log entry
0709 13:16:42.054339 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:42.054530 (+   191us) write_op.cc:454] Released schema lock
0709 13:16:42.054619 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:42.055262 (+   643us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:42.055292 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2715997,"reported_tablets":20,"spinlock_wait_cycles":52945664,"child_traces":[["op",{"apply.queue_time_us":406977,"apply.run_cpu_time_us":4779,"apply.run_wall_time_us":8749,"num_ops":12,"prepare.queue_time_us":157981,"prepare.run_cpu_time_us":10601,"prepare.run_wall_time_us":363258,"raft.queue_time_us":63180,"raft.run_cpu_time_us":34454,"raft.run_wall_time_us":609626,"replication_time_us":1469706,"spinlock_wait_cycles":32592512,"thread_start_us":419983,"threads_started":4,"wal-append.queue_time_us":163555,"wal-append.run_cpu_time_us":26774,"wal-append.run_wall_time_us":2389503}]]}
I20260709 13:16:44.143807  8842 rpcz_store.cc:276] 0709 13:16:43.087216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.087356 (+   140us) service_pool.cc:224] Handling call
0709 13:16:43.118118 (+ 30762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.645307 (+527189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.105432 (+460125us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54003a7354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:44.105616 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187548544}
W20260709 13:16:44.214874  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.146853 12163 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.148634  8916 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:44.135882  8914 rpcz_store.cc:276] 0709 13:16:42.660412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.927248 (+1266836us) service_pool.cc:224] Handling call
0709 13:16:43.927607 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.936081 (+  8474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.936123 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.936825 (+   702us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.063097 (+126272us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:44.063135 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.063204 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.135201 (+ 71997us) raft_consensus.cc:1685] finished
0709 13:16:44.135221 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.135385 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8019,"raft.queue_time_us":13306,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":125775,"threads_started":1,"wal-append.queue_time_us":124320}
I20260709 13:16:44.233282  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:44.107781  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.234253  8909 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.150682  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:44.143129 12180 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.426s	user 0.001s	sys 0.001s
W20260709 13:16:44.156199  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.163336  8915 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:44.147322 11698 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.167622  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:44.171387 11996 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.172446 12186 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.173034 12181 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.171090  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:44.252889  9465 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:44.172906 12091 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.254184 12091 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.170869  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:44.165264 12006 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:44.177855 12158 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:44.178933  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 425035us
I20260709 13:16:44.263434 12181 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.266352  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.268270 12181 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.179468 12170 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:44.180068 12172 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.265265  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.181159  8911 raft_consensus.cc:2410] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:44.181684 12048 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.182315  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:44.183362 12187 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.184276 11638 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.184362 12057 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:44.185547  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1528) took 1318 ms. Trace:
W20260709 13:16:44.198750  9462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 449) took 1628 ms (client timeout 1920 ms). Trace:
I20260709 13:16:44.189005  8769 rpcz_store.cc:276] 0709 13:16:42.595538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.153940 (+558402us) service_pool.cc:224] Handling call
0709 13:16:43.177771 (+ 23831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.182365 (+  4594us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:43.313432 (+131067us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.482873 (+169441us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.142515 (+659642us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:44.146016 (+  3501us) spinlock_profiling.cc:243] Waited 9.92 ms on lock 0x7b180033ac60. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:44.146164 (+   148us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.146224 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.146278 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.146340 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.146456 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":637471,"prepare.queue_time_us":116421,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":663436,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":11161,"spinlock_wait_cycles":65560576,"thread_start_us":243248,"threads_started":2,"wal-append.queue_time_us":403149}
I20260709 13:16:44.203109 12176 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.205317 12046 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:44.229406  8838 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1674) took 4045 ms (client timeout 2412 ms). Trace:
I20260709 13:16:44.229522  8837 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.234931  9466 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:44.236675  8913 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:44.251430  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.251875  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1782) took 1353 ms. Trace:
I20260709 13:16:44.242992 12014 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:16:44.258316  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.260070  8915 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:44.177717 12052 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:44.262334  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1571) took 1501 ms. Trace:
I20260709 13:16:44.264379  9461 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:44.268764  8732 leader_election.cc:400] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7.
I20260709 13:16:44.269797  8767 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:44.339465  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.273336  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1767) took 1842 ms. Trace:
I20260709 13:16:44.271369  8768 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.314060  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.054637  8910 rpcz_store.cc:276] 0709 13:16:41.221918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:41.222377 (+   459us) service_pool.cc:224] Handling call
0709 13:16:41.246611 (+ 24234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:41.246854 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:41.372074 (+125220us) log.cc:844] Serialized 14 byte log entry
0709 13:16:41.686719 (+314645us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.706109 (+2019390us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b18003327a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287
0709 13:16:43.764543 (+ 58434us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.002762 (+238219us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.025935 (+ 23173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.026003 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.026058 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.042471 (+ 16413us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.042653 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":241102,"prepare.queue_time_us":306868,"prepare.run_cpu_time_us":159,"prepare.run_wall_time_us":166,"raft.queue_time_us":445878,"raft.run_cpu_time_us":611,"raft.run_wall_time_us":61270,"spinlock_wait_cycles":9906560,"thread_start_us":661067,"threads_started":7,"wal-append.queue_time_us":483455,"wal-append.run_cpu_time_us":2306,"wal-append.run_wall_time_us":1057202}
I20260709 13:16:44.313405  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:44.345957  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.292474  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 282) took 1570 ms. Trace:
I20260709 13:16:44.356508  8762 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:44.357481  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1569) took 1604 ms. Trace:
I20260709 13:16:44.357343  8765 rpcz_store.cc:276] 0709 13:16:42.722464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.261436 (+538972us) service_pool.cc:224] Handling call
0709 13:16:43.261788 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:43.415833 (+154045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.292151 (+876318us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54000bb3d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:44.292397 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281529216}
W20260709 13:16:44.341833  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 159590us
I20260709 13:16:44.358453  8913 rpcz_store.cc:276] 0709 13:16:42.753554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.207313 (+1453759us) service_pool.cc:224] Handling call
0709 13:16:44.236443 (+ 29130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.341678 (+105235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.357419 (+ 15741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.359510  8915 pending_rounds.cc:85] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 4
I20260709 13:16:44.359551  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:44.359938  8915 pending_rounds.cc:107] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 7.5
W20260709 13:16:44.344684  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 93332.6us
I20260709 13:16:44.360508  8915 raft_consensus.cc:2889] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.360610  8913 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:44.360987  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.361361  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1573) took 1218 ms. Trace:
I20260709 13:16:44.361747  8913 rpcz_store.cc:276] 0709 13:16:43.143229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.359731 (+1216502us) service_pool.cc:224] Handling call
0709 13:16:44.360278 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.361106 (+   828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.361307 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.272491  8764 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:16:44.272817  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.365037  8766 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:16:44.365203  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 107004us
I20260709 13:16:44.357265  8914 rpcz_store.cc:276] 0709 13:16:42.898853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.251047 (+1352194us) service_pool.cc:224] Handling call
0709 13:16:44.251359 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.251576 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.251601 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.251642 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.251675 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.251725 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.251821 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:44.339964  8838 rpcz_store.cc:269] 0709 13:16:40.183905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:40.184088 (+   183us) service_pool.cc:224] Handling call
0709 13:16:44.205091 (+4021003us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54002805d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:44.229315 (+ 24224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5288205056}
I20260709 13:16:44.364125  8909 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:16:44.343878  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.342446  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1529) took 1281 ms. Trace:
I20260709 13:16:44.371960  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.338946  8916 rpcz_store.cc:276] 0709 13:16:42.761238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.233906 (+1472668us) service_pool.cc:224] Handling call
0709 13:16:44.261849 (+ 27943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.262026 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.262049 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.262095 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:44.262130 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.262184 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.262283 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.356520 11887 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.257114 12191 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.341473  8912 rpcz_store.cc:276] 0709 13:16:42.431518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.641373 (+1209855us) service_pool.cc:224] Handling call
0709 13:16:43.641845 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.874520 (+232675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.874560 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.885352 (+ 10792us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.085281 (+199929us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:44.085626 (+   345us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.117153 (+ 31527us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.117389 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.117490 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.273087 (+155597us) raft_consensus.cc:1685] finished
0709 13:16:44.273109 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.273273 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87582,"prepare.queue_time_us":3025,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":73,"raft.queue_time_us":115269,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":10541,"thread_start_us":284486,"threads_started":2,"wal-append.queue_time_us":349725}
I20260709 13:16:44.376515  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1783) took 1477 ms. Trace:
I20260709 13:16:44.376659  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.340569  8763 rpcz_store.cc:276] 0709 13:16:42.866726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.477047 (+610321us) service_pool.cc:224] Handling call
0709 13:16:43.477403 (+   356us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:43.477769 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:43.477797 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:43.478458 (+   661us) log.cc:844] Serialized 52 byte log entry
0709 13:16:43.733090 (+254632us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:43.796163 (+ 63073us) log.cc:844] Serialized 14 byte log entry
0709 13:16:43.962017 (+165854us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b18003a3960. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:44.185147 (+223130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.185213 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.185251 (+    38us) raft_consensus.cc:1685] finished
0709 13:16:44.185343 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.185465 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":388708,"prepare.queue_time_us":61743,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":53,"raft.queue_time_us":390288,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":200,"spinlock_wait_cycles":7161984,"thread_start_us":254133,"threads_started":1,"wal-append.queue_time_us":337375}
I20260709 13:16:44.372439  8760 rpcz_store.cc:276] 0709 13:16:43.062019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.718952 (+656933us) service_pool.cc:224] Handling call
0709 13:16:43.719442 (+   490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.176156 (+456714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.176185 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.176738 (+   553us) log.cc:844] Serialized 52 byte log entry
0709 13:16:44.250657 (+ 73919us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:44.250751 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.250824 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.342194 (+ 91370us) raft_consensus.cc:1685] finished
0709 13:16:44.342223 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.342396 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":456308,"raft.queue_time_us":456837,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":73396,"threads_started":1,"wal-append.queue_time_us":84388}
I20260709 13:16:44.372041  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1575) took 1228 ms. Trace:
I20260709 13:16:44.383579  8915 rpcz_store.cc:276] 0709 13:16:42.899129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.252593 (+1353464us) service_pool.cc:224] Handling call
0709 13:16:44.259597 (+  7004us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.376258 (+116661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.376460 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.268668 12062 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:44.285068 12050 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.380228  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.387535  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:44.388183  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.388319  8914 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:44.383914  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.291644 12089 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.385938  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:44.338675 12052 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.346441 11638 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.294129 12059 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.433013  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.356597 11998 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:44.391047  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.432576  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:44.435704  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 167119us
I20260709 13:16:44.442044  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.443773 12209 tablet_replica.cc:333] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:16:44.436987  8910 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:44.261924 11996 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.413100  8913 rpcz_store.cc:276] 0709 13:16:43.143798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.362926 (+1219128us) service_pool.cc:224] Handling call
0709 13:16:44.371508 (+  8582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.371701 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.371730 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:44.371773 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:44.371809 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.371868 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.371984 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:44.446178  8769 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:44.438215  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.343852 12048 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.440505  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.470443  8765 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:44.471349  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.471932  8765 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:44.441102  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.432619  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.474694  8764 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:44.475997  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.477681  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.443557  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.364111 12091 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.485661  8767 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:44.381394 12186 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.444322 12176 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.446832 11638 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.444588 12063 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:16:44.385820 12057 raft_consensus.cc:2764] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:16:44.445746 11998 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:44.461961 12158 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.437460 12034 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.465078 12059 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.272955 12195 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 13:16:44.466490 12052 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.468951  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1567) took 1575 ms. Trace:
I20260709 13:16:44.376201 12170 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.444710 12076 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:44.381699 12111 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:44.480558  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.514153  8765 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:44.512703  8761 rpcz_store.cc:276] 0709 13:16:42.893271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.536978 (+643707us) service_pool.cc:224] Handling call
0709 13:16:43.545364 (+  8386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.165424 (+620060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.165451 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.165856 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.365668 (+199812us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:44.365720 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.365794 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.468684 (+102890us) raft_consensus.cc:1685] finished
0709 13:16:44.468709 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.468855 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":619567,"raft.queue_time_us":625183,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":45,"thread_start_us":194038,"threads_started":1,"wal-append.queue_time_us":203981}
W20260709 13:16:44.486306  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.384598 11793 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:44.486435  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45435.8us
I20260709 13:16:44.496452 12189 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:44.490396  8767 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:44.490773  8837 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:44.491577  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:44.271749 12006 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.499588 11998 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.384560 11887 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.444309 12172 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:44.501343  9468 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:16:44.493883  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 190267us
I20260709 13:16:44.528918  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:44.505437  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61978.6us
I20260709 13:16:44.529803  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:44.338867  9462 rpcz_store.cc:269] 0709 13:16:42.570137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.572062 (+  1925us) service_pool.cc:224] Handling call
0709 13:16:44.142324 (+1570262us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:44.198595 (+ 56271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12920704}
W20260709 13:16:44.493968 12155 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:44.532303 12187 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.483609 12062 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:44.492002 12025 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.487577  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:44.518869 11996 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.411453 12191 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.440258 12106 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.500003 12158 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.522493  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.555979  9466 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:16:44.530192  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.531869  8764 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:44.542009  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.522585 11638 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.515643 12111 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:44.525285 12189 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.532405 12052 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.512074 12034 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:44.561215 12205 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:16:44.562458 12191 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.539229 12187 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.564767  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.513330 12059 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.570981  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.526243 12076 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.601665  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.600397  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.558473 12106 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.607108 12002 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:44.557662 12158 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.608438  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.572409 12100 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.566447 12111 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:44.566237 12091 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.563541 12079 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:44.569514 12189 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.607729 12106 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.615437  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.609748  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.604212 12191 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.603060 11832 raft_consensus.cc:2764] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:44.618651  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1726) took 1091 ms. Trace:
I20260709 13:16:44.607551 12002 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.614463 12166 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.623901  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.620889  8844 rpcz_store.cc:276] 0709 13:16:43.527480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.040999 (+513519us) service_pool.cc:224] Handling call
0709 13:16:44.041490 (+   491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:44.041954 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.041999 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:44.063334 (+ 21335us) log.cc:844] Serialized 26 byte log entry
0709 13:16:44.233551 (+170217us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.233592 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.233658 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:44.617369 (+383711us) raft_consensus.cc:1685] finished
0709 13:16:44.617393 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:44.618588 (+  1195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7889,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":4874,"thread_start_us":148280,"threads_started":1,"wal-append.queue_time_us":267326}
I20260709 13:16:44.610586 12051 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.626225 12163 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.627115 12076 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.614984 12079 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.628103 12059 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.628448 12079 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:44.555562 12025 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.619812  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.634514  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.634959  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.636219  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.637045 12172 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.638303 12025 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.645591 12172 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:44.646421  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.648240  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.650357 12034 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.651000 12001 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:44.652415 12159 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.212s	user 0.005s	sys 0.000s
I20260709 13:16:44.624663 12002 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.653254 12172 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.622972 12195 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.622795 12006 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:44.656780  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 295) took 2020 ms. Trace:
I20260709 13:16:44.660338  8917 rpcz_store.cc:276] 0709 13:16:42.635957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:43.725150 (+1089193us) service_pool.cc:224] Handling call
0709 13:16:44.147282 (+422132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.147869 (+   587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.656530 (+508661us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54001d2c50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:44.656686 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969930112}
I20260709 13:16:44.614710 12100 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.659373 12166 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.663609 11998 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.663975  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.674129  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.665107  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.675079  8761 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:44.665395 12170 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.634145 12051 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.665670  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.659624 12195 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.667968  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.668953  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:44.675477  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.676623  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.677515  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.679783  8765 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.681986  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.682058  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:44.682971  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.683214  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.684105  8769 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:16:44.636215 12091 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.686480  8769 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.659976 12006 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.690177  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.698697  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.693209  8769 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:44.693671  8765 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:44.700585  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.694613  8761 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:44.696872 12025 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:44.697060 12176 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:44.699730  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.700697  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.701617  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.704710  8912 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 11 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:44.704457  8765 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:44.684487 12195 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.707113  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.707782  8912 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 4.
I20260709 13:16:44.708537  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.708498  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.701858  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.702877  8917 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:16:44.709693  8917 pending_rounds.cc:85] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 3
I20260709 13:16:44.709937  8917 pending_rounds.cc:107] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:16:44.710166  8917 raft_consensus.cc:2889] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.703348  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.684660 11897 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.717278  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.711786  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:44.718595  8915 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:44.684471 12102 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.712601  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.714344  8916 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:44.714419 11998 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.714975 12089 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:44.719759  8912 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:44.721438  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.722393  8912 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:16:44.722733  8912 pending_rounds.cc:85] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 4
I20260709 13:16:44.722945  8912 pending_rounds.cc:107] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:16:44.723152  8912 raft_consensus.cc:2889] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.703203 12006 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:44.706125 12022 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.733677  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.737250 12100 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.729157 11998 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.738096 11998 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.738452 11998 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.727686 12102 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.747506  8916 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:16:44.748006  8916 pending_rounds.cc:85] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 3
I20260709 13:16:44.748279  8916 pending_rounds.cc:107] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:16:44.748575  8916 raft_consensus.cc:2889] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:44.729547  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.730286  8761 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:44.689209 11698 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:16:44.702768 12076 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:44.761510  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.762176  8761 raft_consensus.cc:2376] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:16:44.749035 12034 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:44.754901 12063 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:44.777082 12063 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.777563 12063 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:44.779232 12170 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:44.779803 12170 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.780270 12022 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.768828  8761 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
W20260709 13:16:44.780532  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3b34c95a175945b88b17f07fbc650abf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:44.770082 12215 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:44.782383 12170 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.782621  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.783244 12187 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.783344  8761 raft_consensus.cc:2376] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:16:44.783823  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.784546  8764 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:44.785346  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.785270 12040 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:44.787302  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.784377  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.792570  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.793251  8915 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:44.789543  8761 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:16:44.794517  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 91272.9us
I20260709 13:16:44.786324  8764 raft_consensus.cc:2376] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
W20260709 13:16:44.789335  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 84701us
I20260709 13:16:44.785943 12102 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:44.790084 12034 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:44.802857 12034 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.798236 12014 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:44.805127 12014 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.805514 12014 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.807318 12079 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.801016 12021 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:44.811348 12106 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:44.812176  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:44.813745 12030 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:44.814340 12030 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.814663 12106 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.817837 12030 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:44.822758 12211 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:16:44.808549  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 428418us
I20260709 13:16:44.827136  8909 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.829064  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.829149  8913 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:44.829885  8764 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:44.830888  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.831550  8764 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:44.832655  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:44.839350 12161 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:44.840282  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:44.842624  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45366.1us
I20260709 13:16:44.791289 12170 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:16:44.870119  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:44.862303  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67896.8us
I20260709 13:16:44.868230  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.873262  8844 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:44.868162  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.871987  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.889989  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.891065  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:44.871837  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:44.893106  8836 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:44.894095  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.885653  8835 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:44.808557 12189 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.895514  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.862834 12021 consensus_queue.cc:1243] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:44.907136  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:44.844273 11638 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.913084  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.913728  8843 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:44.902536  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.908833  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.816646 12002 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.863296 12172 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:44.899681  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.920295  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:44.899127 12040 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:44.862532 12030 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:16:44.842281 12006 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.921706  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.912109 12170 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:44.898407 12051 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.901000 12072 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.923898  8835 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:44.925765  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.936810  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.908509 12213 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:16:44.908365 12060 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:44.841746 12089 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 13:16:44.929945  8761 raft_consensus.cc:2376] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9. Re-sending same reply.
I20260709 13:16:44.942679 12218 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:44.931725  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.869488 12014 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.933130  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:44.914624 12091 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:44.923703 12001 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.921713 11996 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:44.900774 12158 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.957410  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:44.954243  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.910102 12144 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:16:44.915649 11638 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.925786 12040 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:44.923894 11832 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:44.950541 12218 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:44.951122  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:44.979745  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.912379 12111 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.927958 12172 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.948576 12213 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:44.953588 12091 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:44.954591 12106 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:44.941790 12051 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:44.984994  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.953194 12170 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:16:44.954026 12195 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:44.991974  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:44.986238 12091 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:45.025326  9467 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:44.979372 12079 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:44.985477 12021 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.028093  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:44.986014 12102 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:44.992326 12001 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.009909 12034 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.065802  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 119010us
I20260709 13:16:45.069283  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:45.020275 12002 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:45.028103 12216 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:16:44.988444 12176 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 13:16:45.086570  8764 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:45.088737  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:45.089443  8763 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:45.067668 12001 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.067466 12218 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.090339  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:45.086824  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 112207us
I20260709 13:16:44.992102 12106 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.106117  8764 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:45.107580  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 115677us
I20260709 13:16:45.108529  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.096742 12225 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:45.123050 12220 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:16:45.123169 12083 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.098649 12001 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.125221  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:45.125526 12221 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:16:45.075901 12226 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:16:45.102912 12224 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:16:45.130023 12106 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.097708 12189 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.102530 12230 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:16:45.132294  8763 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:16:45.080968 12034 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.133867 12111 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.134567 12186 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.134963 12186 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:45.135725 12034 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.136343 12195 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.137389 12172 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.138636 12014 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.138687 12063 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.140090 12051 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:45.142856 12158 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.118927 11998 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.106369 11832 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.147025  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:45.131008 11638 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.151253  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.152180  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:45.155916  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47513.7us
W20260709 13:16:45.155802  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44885.7us
I20260709 13:16:45.159938  9461 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:45.159498  8917 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:45.160612  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.124854 12083 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:16:45.135787 12186 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.174312 12186 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.174513 11998 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.175606 12063 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.176795  8838 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:45.183207  8917 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.094164 12213 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.157215 12231 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:45.217558  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 232616us
W20260709 13:16:45.225255  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 67068us
W20260709 13:16:45.225338  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65261.9us
I20260709 13:16:45.232990 12224 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:45.218506 12233 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:45.236941 11998 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:45.238991 12048 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.229422 12001 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.218205 12091 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.253316  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1730) took 1145 ms. Trace:
W20260709 13:16:45.249105  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 88599us
I20260709 13:16:45.252768  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:45.246663 12001 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.266685  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.266927 12001 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:45.267411 12001 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:45.267778 12001 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.249886 12225 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:45.269722 12225 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.270047 12225 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.270259 12091 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.270834 12091 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.271281 12091 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:45.272111 12091 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:45.260064  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.264849  8837 rpcz_store.cc:276] 0709 13:16:44.107604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.127346 (+ 19742us) service_pool.cc:224] Handling call
0709 13:16:44.229344 (+101998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.523483 (+294139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.253025 (+729542us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54002805d0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:45.253234 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233378560}
I20260709 13:16:45.265264  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.275597  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:45.279270  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50268.8us
I20260709 13:16:45.285444  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.286338  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.292326  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.240815 12048 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.307109 11887 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.308851  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.311884  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:45.312709  8765 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:45.313540  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:45.313776  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.316963  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.317796  8910 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:45.322671  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 58493.6us
I20260709 13:16:45.324476 12227 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:45.293977 12144 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.310079 12148 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:45.327919 12148 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:45.328960 12148 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.332474  8915 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:45.244083 12170 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:45.336285  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1580) took 1392 ms. Trace:
I20260709 13:16:45.349654  8918 rpcz_store.cc:276] 0709 13:16:43.943985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.069654 (+125669us) service_pool.cc:224] Handling call
0709 13:16:45.336088 (+1266434us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400292cd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:45.336230 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430560640}
I20260709 13:16:45.350848  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.351145  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.340353 11998 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.344264  9467 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:45.348788  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:45.351699  8916 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.353237  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.304219 12230 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:45.354254  8911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1748) took 3226 ms (client timeout 2501 ms). Trace:
W20260709 13:16:45.356725  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 76382us
W20260709 13:16:45.360440  8911 rpcz_store.cc:269] 0709 13:16:42.127921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:42.173108 (+ 45187us) service_pool.cc:224] Handling call
0709 13:16:45.354064 (+3180956us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54000389d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:45.354185 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3879636736}
I20260709 13:16:45.348016  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:45.362587  8918 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 5: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:45.364383  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.364682  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.365145  8841 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:45.365608  8835 raft_consensus.cc:2410] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:45.294180 12231 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:45.366117  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.281608 12233 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.366909  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:45.367461  8836 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:45.367409  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:45.372852  8841 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.381953  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.386492  8918 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:45.389536  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.392529  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.349411 12170 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:45.376322 11638 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:45.390992 12072 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.408331 12061 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:45.371825 12025 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:16:45.464617  8841 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:45.376353 12021 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:16:45.475314  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:45.397042 12176 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:16:45.373479 11998 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.376701 12230 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.466310  8910 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:45.464986 11996 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:45.450584 12189 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:45.483234 12242 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:16:45.443537 11897 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:16:45.457887 11638 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:45.519548 12230 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:45.520432 12237 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 13:16:45.504503 12181 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.529418 12181 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.531584 12181 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.533135  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.534070  8910 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:45.534101 11638 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.544512  8916 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:45.492282 11996 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:45.548141  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:45.510764 12189 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.555887 12061 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:45.510941 12170 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.601137 12076 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:45.601611 12076 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:45.602943 11998 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.602689 12076 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.582931 11996 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.603899 12076 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:45.604143 11996 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:45.608614 12245 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:45.611845 12061 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.614099  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.616583 12051 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:45.617071 12051 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:45.617892 12051 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.619220 12001 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.621573 12001 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.621897  8765 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.623598 12225 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.600579 12170 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.627856  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.628908  8915 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:45.619460 12051 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.642972 12111 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:45.643029 12158 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:45.649004  8841 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:16:45.649988  8839 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:45.663100  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.664032  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.650740  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.651589  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.667662  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.668741  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.655836  8765 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:45.670267  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.633733 12176 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:45.673015  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.675575  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:45.676918  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 281036us
I20260709 13:16:45.644110 12189 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.678575  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.676780  8837 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:45.659708 12063 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:45.669054 12152 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.681195  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:45.685082  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.687384  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.687569  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.688023  8912 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:45.688927  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.689631  8912 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:45.691159  8915 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:16:45.692051  8666 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 5, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:45.693325 12161 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.694022 12161 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.690204 11638 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:45.695765 11638 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.697376  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.698132 11638 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:45.698843 11638 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:45.692662  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.700245 11638 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.701315  8915 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:45.703105  8915 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:45.671537 11998 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:45.699594  8910 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:45.662415 12130 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:16:45.691331  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.689802  8918 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 3. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:16:45.709951  8841 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:45.711081  8918 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
W20260709 13:16:45.712270  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.712917  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:45.713639  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.664263 12254 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:16:45.705821  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.665746 12111 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.675046 11793 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:45.703327  8912 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:45.715281  8839 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:45.686335 12237 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:45.693804  8666 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.718096  8911 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.667232 12158 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:45.721864  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.753448  8912 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:45.674911 12252 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:16:45.681290 12176 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.758270  8666 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.762267  8912 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:16:45.764334  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83213.3us
W20260709 13:16:45.772084  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:45.775848  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.718818 12025 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:45.725390 12063 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:45.780041  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.717665 12161 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.765790  8666 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:45.782811  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.784576  8912 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:45.705493 12152 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.765483 12237 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:45.752514 11793 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.782665 12225 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.782496 12025 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:45.790127 12021 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:45.800072  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.801190  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:45.801362  8911 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:45.802850  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.804075  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.805104  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:45.809355  8837 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:45.805081  8666 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:45.811973  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.824667  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.826313  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:45.785677 12063 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:45.836128  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:45.799906 12025 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:45.839036 12161 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.839833 12175 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:45.849730  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:45.850338  8666 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:45.837083 12100 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.834261 12251 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:45.834760 11887 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:16:45.843739 12260 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:16:45.842795 12252 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:16:45.851076  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:45.841804 12048 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.883005 12048 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.883433 12152 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.817073 12130 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:16:45.869405  8666 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.855432 12089 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:45.853747 12175 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:45.891860  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:45.866308 12021 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:45.891021  8666 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 6, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.861500 12100 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:45.883442 12048 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.873749 12237 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:45.896273 12263 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:16:45.897325 12258 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 13:16:45.897619 12262 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:16:45.894316 12021 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.899163 12021 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.904006 12100 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.904412  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1719) took 2017 ms. Trace:
I20260709 13:16:45.904556 12048 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:45.905282 12256 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:16:45.906916 12048 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:45.904937  8840 rpcz_store.cc:276] 0709 13:16:43.887072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.064120 (+177048us) service_pool.cc:224] Handling call
0709 13:16:44.076272 (+ 12152us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:44.076620 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.076638 (+    18us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:44.088116 (+ 11478us) log.cc:844] Serialized 52 byte log entry
0709 13:16:45.545568 (+1457452us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b180016e2e0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:16:45.674473 (+128905us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:45.674513 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.674594 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.904055 (+229461us) raft_consensus.cc:1685] finished
0709 13:16:45.904078 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:45.904342 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2956,"spinlock_wait_cycles":11195136,"thread_start_us":128663,"threads_started":1,"wal-append.queue_time_us":1691719}
I20260709 13:16:45.884081 12252 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:45.911408 12006 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.892829 12111 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.917138 12158 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.918988  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:45.921419  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52983.5us
W20260709 13:16:45.923286  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.924659  8666 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.887528 12264 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:16:45.928658 12252 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:16:45.936672  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:45.832983 12186 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:45.949476  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:45.945670 12254 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:16:45.950896 12083 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:16:45.954921 11638 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:45.948050 11998 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:45.955855 11998 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:45.956432 11998 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:45.957787  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1583) took 1979 ms. Trace:
I20260709 13:16:45.958190  8909 rpcz_store.cc:276] 0709 13:16:43.977929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.383837 (+405908us) service_pool.cc:224] Handling call
0709 13:16:44.384113 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:44.827560 (+443447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:45.957533 (+1129973us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54002b0f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:45.957722 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017090944}
I20260709 13:16:45.934782 12176 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.964371  8844 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:45.944981 12252 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:16:45.967154  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.942015 11793 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:45.945914  8666 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 2 to 5, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65), VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66), VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67), VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 6 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:45.972747  8666 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 5, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:45.975258  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:45.980548  8844 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 4: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:45.986125  8844 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:16:45.987346  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:45.948355 12271 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:45.970988 12252 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:45.993263  8666 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 6, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 6 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:45.992478  9434 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:45.977221 12176 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:45.978309 12251 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:45.996300 12025 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.004356 12111 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:46.005102 12111 consensus_queue.cc:1243] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:16:46.006597 12158 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:45.991382 12089 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:46.009104 12176 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.010624 12176 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.011881 12251 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.017727  8836 pending_rounds.cc:85] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 8
I20260709 13:16:46.018153  8836 pending_rounds.cc:107] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:16:46.018460  8836 raft_consensus.cc:2889] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:45.999382 12252 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.022964  8835 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:46.023777  8666 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 3 to 6, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.017231 12050 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.025705  8840 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.012234 12040 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.021984 12100 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:46.042802  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.044263  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:46.044898  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:46.047566  8837 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:46.048457  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:46.049046  8837 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.045254  8844 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:46.020517 12021 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.062086 12040 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.026113 12050 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.053275  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:46.054553  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:46.055466  8843 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:46.056015  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:46.067795  8842 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:46.057471  8841 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:46.068261  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:46.068615 12181 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:46.075233 12065 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:46.076632 12050 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.075233 12051 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:46.046684 12089 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:46.077562 12089 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.077914  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:46.079365  8735 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:46.080001 12089 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:46.080121 12051 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:46.047000 12252 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:46.085009  8837 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:46.081895  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:46.095361 12267 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:16:46.097375  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:46.099539  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:46.098946 12259 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.334s	user 0.001s	sys 0.000s
I20260709 13:16:46.115165  8735 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:46.115646  8735 leader_election.cc:403] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:16:46.114238 12050 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:46.117154 12050 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.117641 12050 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.117794 12152 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:46.081614 12181 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:46.120549  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:46.121866 12025 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:46.113734 12051 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:46.123087 12051 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.083433  8666 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 5 to 6, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 6 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:46.140976  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:46.142251  8837 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:46.118801 12225 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:46.128609 12181 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.149578  8666 catalog_manager.cc:5697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 5, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 5 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:16:46.152755  8666 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 5, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 5 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:46.144140 12170 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:46.157002  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:46.162642 12243 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.657s	user 0.002s	sys 0.000s
I20260709 13:16:46.167388 12170 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:46.173761 12170 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:46.201049  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 350238us
I20260709 13:16:46.202922  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:46.205803 12006 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.179697 12151 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:46.210654  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:46.214730  8760 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:46.206517 11887 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:46.219126 11887 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.219486 11887 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:46.204126 12236 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:46.220706  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.220595 12050 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.223091  8766 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: [7.4-10.5]
I20260709 13:16:46.224243  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.224900  8768 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
W20260709 13:16:46.225907  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 126453us
I20260709 13:16:46.227227  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:46.227774  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.228410  8917 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:46.204392 12231 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.244948  8765 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:46.248234  8760 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:46.270617  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.271518  8910 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:46.214360 12187 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:46.278623  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:46.279944  8760 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:46.214000 12040 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:46.189718 11998 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.246071 12161 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:46.247191 12186 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.269997 12030 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:46.284309 12261 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.417s	user 0.000s	sys 0.004s
I20260709 13:16:46.285971 12209 raft_consensus.cc:2243] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:46.208611 12006 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.320009  8844 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:46.320883 12006 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:46.322046 12276 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:46.322090  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:46.233479 12065 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:46.261042 11638 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:46.313832 12219 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.247s	user 0.003s	sys 0.000s
I20260709 13:16:46.313222 12030 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.259490 12048 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:46.314239 12161 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:46.315311 12050 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.317893  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:46.246971 12236 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.394016  8838 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.324685  8842 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:46.216053 12151 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.304455 12187 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:46.338639  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.398380 12158 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.261998 12231 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.418468  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:46.306151 12040 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.430469 12040 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.349735 11638 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.431200 11638 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.433148 12231 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.434755 12158 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.437640 12158 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.438437  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:46.393349 12048 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.317204 12186 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.449054  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.405380 12025 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.457975  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.460220  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:46.472620  8763 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.439334 12209 raft_consensus.cc:2272] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:46.439337 12251 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.476264 12251 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.478008  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.459230  8838 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:46.444741  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:46.455238 12217 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.471s	user 0.026s	sys 0.010s
I20260709 13:16:46.410450 12065 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.418723 12176 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.479010  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:46.494194  8913 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:46.483207  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:46.495319  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76935.4us
I20260709 13:16:46.498373  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.500181  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:46.501389  9464 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:46.501466  8766 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 5: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:46.501724  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:46.495968  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.503160  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:46.503736  8913 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.506044  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.506660  8917 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:46.508477  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.509977  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.510751  8909 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:46.521961  8763 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:46.523577  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.524518  8763 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:46.528744  9464 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:16:46.529724  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.530902  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:46.541077  8913 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:16:46.501015 12217 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.027s	sys 0.010s
I20260709 13:16:46.542683  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.542603  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:46.556900  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 296016us
I20260709 13:16:46.544526  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.477939 12236 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.545897  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:46.546483  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44850us
I20260709 13:16:46.549088  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.563210  8910 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:46.529660 12022 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:46.478756 12025 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:46.557816  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.557492  8768 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:46.561583  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.551067  9466 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:46.572911  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:46.564689  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 64593.4us
I20260709 13:16:46.494100 12251 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.576493  8761 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:46.582679  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.582778  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.582826  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.563060 12089 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:46.528733 11887 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.529222 12181 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.474191 12161 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.563982 12003 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.586329  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:46.564170 12281 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.572685 12291 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:46.597373  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:46.609215  8768 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:46.577515 12293 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.610147  8915 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:46.584012  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.617327  8761 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:46.614364  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.620286  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:46.588788 11998 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:46.621857  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57109.1us
I20260709 13:16:46.628321  8768 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:46.629441  8763 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:46.598541 12089 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:46.591379 12251 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:16:46.658104  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1553) took 1963 ms. Trace:
I20260709 13:16:46.658654  8769 rpcz_store.cc:276] 0709 13:16:44.694174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.719972 (+ 25798us) service_pool.cc:224] Handling call
0709 13:16:44.720332 (+   360us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:16:44.720738 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:44.720767 (+    29us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:16:44.721470 (+   703us) log.cc:844] Serialized 104 byte log entry
0709 13:16:44.926424 (+204954us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:44.932751 (+  6327us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.958151 (+ 25400us) log.cc:844] Serialized 14 byte log entry
0709 13:16:44.958319 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:44.958385 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:45.525422 (+567037us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b18003b27e0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:46.313213 (+787791us) spinlock_profiling.cc:243] Waited 6.32 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:46.657787 (+344574us) raft_consensus.cc:1685] finished
0709 13:16:46.657815 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:46.658017 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24286,"prepare.queue_time_us":7310,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":3054,"raft.queue_time_us":222558,"raft.run_cpu_time_us":539,"raft.run_wall_time_us":52921,"spinlock_wait_cycles":21525632,"thread_start_us":187545,"threads_started":2,"wal-append.queue_time_us":225075}
I20260709 13:16:46.602967 12254 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:16:46.625584 12030 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.679356 12089 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.606972 12003 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.607188 12281 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.665055 12209 ts_tablet_manager.cc:1916] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:16:46.677798 12280 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 13:16:46.693775  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 130889us
I20260709 13:16:46.670686 12151 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:46.701071  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 78378.3us
W20260709 13:16:46.703253  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:46.690359 12186 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:46.704799  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 103072us
I20260709 13:16:46.697304 12048 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:46.699574 12176 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:46.712335  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 89128.2us
I20260709 13:16:46.711222  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:46.722350 12176 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.722945 12176 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.724996 12176 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.726485  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:46.717314 12284 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:16:46.710073 12217 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:46.745375  9462 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:16:46.745635 12295 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:46.746393 12025 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.747097 11887 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:46.747532 12295 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:46.748219 12295 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:46.752962 12181 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.720747 12048 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.767328 12048 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:46.769505 12296 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:46.771742 12003 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:46.774212 12281 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:46.753710 12217 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:46.727895 12065 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:46.777779 12217 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.778712  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.782811  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.783717  8914 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:46.764021 12314 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:46.764657  8916 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:46.788129  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.764930  8910 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:16:46.766254  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:46.785404  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:46.741878 11998 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:46.796180  8913 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:46.748790 12295 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.802934  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.803669  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:46.834131 12295 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.797583 12217 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:46.837308 12295 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:46.808054  8909 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:16:46.844700  8762 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:46.853142  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 49569.3us
I20260709 13:16:46.755244 11638 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.859051  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:46.868152  9463 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 4: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:46.856784  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:46.797091 11998 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:46.876645 12317 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:46.878499 12317 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:46.878995 12317 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:46.869356 12022 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:46.881644 12317 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.884651 12317 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.855043 12158 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.857452 12025 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:46.893119  8917 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:46.895627  8912 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:16:46.917239  8807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.136s (SENT) [suppressed 23 similar messages]
I20260709 13:16:46.869777 12281 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:46.938241  8766 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:46.892148 12295 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.871016 12252 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:16:46.925750 12025 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:46.927062 12161 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.945503 12304 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.946305 11638 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:46.946946  9462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 466) took 1805 ms. Trace:
I20260709 13:16:46.929430 12291 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.932367 12003 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.949517 12025 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:46.954387 12100 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.957057 11897 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.942497 12299 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.949157 11998 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.949503 12022 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.927254 12158 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.958819  8766 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:46.964993 12291 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.942020 12048 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:46.933965 12305 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:46.971671 11897 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.941684 12281 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:46.948614 12295 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.966440 12161 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:47.010715  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:47.011541  8766 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:46.976961 12299 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.004267 12063 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:47.005117 12316 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:16:47.005674 12295 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:47.005882 12319 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:16:47.006042 11897 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.977985 12022 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.952812  9462 rpcz_store.cc:276] 0709 13:16:45.141239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.143595 (+  2356us) service_pool.cc:224] Handling call
0709 13:16:45.143930 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.745919 (+1601989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:46.946664 (+200745us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54004637d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:46.946878 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3656075136}
I20260709 13:16:47.008474 12291 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:46.985117 11998 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:47.005451 12237 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:47.011404  8842 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
W20260709 13:16:47.008550 12292 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
W20260709 13:16:47.025049  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 107836us
I20260709 13:16:46.969278 12003 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.006155 12100 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:46.967308 12304 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.030215  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:47.074997 12025 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.030084 12237 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:46.978163 12175 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:46.985736 12305 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.158407 12295 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.232040 12237 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.077491 12100 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.227360 11887 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:47.132388 12025 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:47.163594 12063 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.163079 12048 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.080245 12291 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:47.068928 11897 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:16:47.131889 12213 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:47.393718 12291 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:47.402763 12291 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.413801 12048 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.424472 12213 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:47.454643 12305 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:47.393797 12063 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.422861 12237 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:47.480738  8918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.005s	sys 0.003s
W20260709 13:16:47.481451  8918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.005s	sys 0.003s
I20260709 13:16:47.390717 12295 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.394297 11887 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:47.522830  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:47.464797 12213 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:47.498821 12305 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:47.527230 12305 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:47.570115 12322 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 13:16:47.572400  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 516716us
W20260709 13:16:47.582783  8911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1587) took 1896 ms (client timeout 2136 ms). Trace:
W20260709 13:16:47.587893  8911 rpcz_store.cc:269] 0709 13:16:45.686272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.686590 (+   318us) service_pool.cc:224] Handling call
0709 13:16:47.582131 (+1895541us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b54002ab7d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:47.582710 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9643776}
W20260709 13:16:47.575794 12286 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.113s	user 0.001s	sys 0.002s
I20260709 13:16:47.574678 12158 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:47.574158 12063 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:47.574143 12304 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:47.575304 12048 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:47.586371 12025 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:47.643639 12281 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:47.580538 11887 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:47.575568 12003 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:47.680202 12328 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:16:47.681244 12161 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:47.683275 12022 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:47.681537 12025 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:47.689288 12299 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:47.755592 11998 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.725s	user 0.010s	sys 0.000s
I20260709 13:16:47.738271 12100 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:47.757449 12317 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.004s
W20260709 13:16:47.759420 12286 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:16:47.801438 12025 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:47.802556 12291 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:47.805199 12291 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:47.814908 12209 ts_tablet_manager.cc:1929] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:16:47.815646 12209 log.cc:1199] T c79353780ac54a25bd9999800873bbeb P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/c79353780ac54a25bd9999800873bbeb
I20260709 13:16:47.817216 12209 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42810 (request call id 69) took 3684 ms. Trace:
I20260709 13:16:47.818048 12209 rpcz_store.cc:276] 0709 13:16:44.133137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:44.133453 (+   316us) service_pool.cc:224] Handling call
0709 13:16:44.443018 (+309565us) ts_tablet_manager.cc:1151] Deleting tablet c79353780ac54a25bd9999800873bbeb
0709 13:16:44.443192 (+   174us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:47.312197 (+2869005us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:47.814714 (+502517us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:47.817105 (+  2391us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1810439,"tablet-delete.queue_time_us":269041,"thread_start_us":191470,"threads_started":1}
I20260709 13:16:47.965494 12187 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.002126 12102 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:48.003402 12102 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.007503 12102 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.020627 12102 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.021737 12102 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.026880 12102 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:48.061939  9463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 405) took 1103 ms. Trace:
I20260709 13:16:48.062639  9463 rpcz_store.cc:276] 0709 13:16:46.958024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.967179 (+  9155us) service_pool.cc:224] Handling call
0709 13:16:46.968487 (+  1308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.969793 (+  1306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.969811 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.971261 (+  1450us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.027525 (+ 56264us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:47.027646 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.027834 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.048600 (+1020766us) raft_consensus.cc:1685] finished
0709 13:16:48.048648 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.061660 (+ 13012us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":908,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":114,"thread_start_us":36705,"threads_started":1,"wal-append.queue_time_us":492055}
W20260709 13:16:47.575486  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:48.089061  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.092813  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:48.094318  8842 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:48.097898  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:48.098819  8836 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.115154  8836 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:48.125422  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:48.130254  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.132664  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1609) took 1920 ms. Trace:
W20260709 13:16:48.116835  8883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.028s	sys 0.028s
W20260709 13:16:48.137455  8883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.030s	sys 0.028s
W20260709 13:16:48.137845  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 565304us
I20260709 13:16:48.139564  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 337) took 2160 ms. Trace:
I20260709 13:16:48.140267  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:48.140094  8840 rpcz_store.cc:276] 0709 13:16:45.978691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:45.978867 (+   176us) service_pool.cc:224] Handling call
0709 13:16:45.979253 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.028456 (+ 49203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.139069 (+2110613us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b540039bcd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:48.139389 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106418560}
I20260709 13:16:48.137060  8764 rpcz_store.cc:276] 0709 13:16:46.212082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.212670 (+   588us) service_pool.cc:224] Handling call
0709 13:16:46.213403 (+   733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.445333 (+231930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.445379 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:46.445438 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:46.445494 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.132084 (+1686590us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540003d754. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:48.132145 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.132411 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532770560}
I20260709 13:16:48.177518  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:48.189661 12003 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.190591  9463 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:48.190553 12003 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.178740  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet c79353780ac54a25bd9999800873bbeb (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:16:48.180939 12333 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.192843 12333 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.193820 12158 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.173038 12271 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:48.194566 12271 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:48.194657 12158 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.186681 12130 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.197865 12130 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.200454 12158 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.201236 12158 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.202271 12158 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.205693 12158 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.206382 12158 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.202700 12003 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.207201 12003 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.208119 12003 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.211369 12003 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.212239 12158 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.215116 12158 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.215873 12158 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:48.216490 12158 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:48.217597 12254 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.218204 12158 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.218572 12254 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:48.259734  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 116926us
I20260709 13:16:48.262627  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:48.264449  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:48.266149  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:48.216233 12293 consensus_queue.cc:1059] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
I20260709 13:16:48.408825 12293 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.409884 12293 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.432603 12254 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:48.701144 12254 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:48.702136 12254 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.500679 12158 raft_consensus.cc:3055] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:48.668583  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.196786 12271 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.703156 12158 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:48.704469 12271 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:48.704612 12158 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.706276 12158 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:48.711089 12254 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.713011 12254 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.718007 12254 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:48.821084  9432 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.003s	sys 0.009s
I20260709 13:16:48.762456 12003 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.821846 12003 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.823837 12003 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.824352 12003 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:48.765117  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.767778  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:48.826102  8916 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:48.771224  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:48.827160  8917 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.827430  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:48.832054  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:48.778352  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:48.832993  8912 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:48.834522  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:48.835354  8912 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:48.837167 12003 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.837888 12161 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.838696 12161 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.805403  8911 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:16:48.268703 12339 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:48.820236  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:48.841223  8914 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:48.841347 12339 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.842343 12161 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.845233 12161 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.846078 12161 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.847661  8917 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:48.848543 12161 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:48.846581  9432 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.003s	sys 0.009s
I20260709 13:16:48.738137 12293 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:48.849233  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 651870us
I20260709 13:16:48.850350 12237 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.851058 12237 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.848246 12003 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:48.852139 12003 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.853545 12003 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.854388 12293 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.861086 12293 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:48.856899 12237 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.843956 12339 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.867695 12003 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.870435  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:48.876685  8842 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:48.871372  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:48.877331 12295 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.877969  9463 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:48.858165  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.872905  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:48.880008  9462 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 4.
I20260709 13:16:48.874221 12130 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:48.874251 12293 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.857817 12254 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.882102 12130 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:48.886317  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:48.887048  9463 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:48.883816  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47239.3us
I20260709 13:16:48.889532  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:48.891402  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.903592 12305 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:48.911677 12254 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:48.912532 12254 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.915781 12254 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:48.925783 12003 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:48.927919  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.933418 12003 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:48.935482  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.936559 12003 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:48.938014  8884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.995s	user 0.007s	sys 0.040s
W20260709 13:16:48.938421  8884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.996s	user 0.007s	sys 0.040s
I20260709 13:16:48.940976  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.948387 12003 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:48.957253 12003 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:48.958786 12003 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:48.962827  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:48.967051  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.968096 12213 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:48.968412  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:48.968505 12213 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.975492 12213 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:48.976912 12293 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:48.977540 12293 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:48.978094 12293 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:48.998162  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1608) took 2784 ms. Trace:
I20260709 13:16:48.998524 12339 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:16:49.003196 12111 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.006s	sys 0.014s
W20260709 13:16:49.007588  8915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1816) took 2780 ms (client timeout 1706 ms). Trace:
I20260709 13:16:49.010386  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1608) took 2227 ms. Trace:
I20260709 13:16:48.999727  8767 rpcz_store.cc:276] 0709 13:16:46.211798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.211924 (+   126us) service_pool.cc:224] Handling call
0709 13:16:46.212227 (+   303us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:46.212560 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.212587 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:46.216291 (+  3704us) log.cc:844] Serialized 52 byte log entry
0709 13:16:46.400761 (+184470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:46.402722 (+  1961us) log.cc:844] Serialized 14 byte log entry
0709 13:16:46.957075 (+554353us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b18003d66c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:47.575069 (+617994us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:48.956374 (+1381305us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18003d66c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:16:48.956807 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:48.970034 (+ 13227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:48.975050 (+  5016us) raft_consensus.cc:1685] finished
0709 13:16:48.975071 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:48.995874 (+ 20803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10921,"prepare.queue_time_us":1594,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1911,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":17057,"spinlock_wait_cycles":26746752,"thread_start_us":116604,"threads_started":1,"wal-append.queue_time_us":132510,"wal-append.run_cpu_time_us":16487,"wal-append.run_wall_time_us":2385786}
W20260709 13:16:49.017963 12111 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.008s	sys 0.014s
I20260709 13:16:49.015950  8918 rpcz_store.cc:276] 0709 13:16:46.782687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.782794 (+   107us) service_pool.cc:224] Handling call
0709 13:16:46.783080 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.783431 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.783459 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.795720 (+ 12261us) log.cc:844] Serialized 26 byte log entry
0709 13:16:47.482090 (+686370us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:47.482136 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:47.513805 (+ 31669us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.009923 (+1496118us) raft_consensus.cc:1685] finished
0709 13:16:49.009977 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.010198 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34077,"raft.queue_time_us":1964,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":10195,"thread_start_us":615018,"threads_started":1,"wal-append.queue_time_us":826309,"wal-append.run_cpu_time_us":32182,"wal-append.run_wall_time_us":1328543}
W20260709 13:16:49.015383  8915 rpcz_store.cc:269] 0709 13:16:46.226660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.226997 (+   337us) service_pool.cc:224] Handling call
0709 13:16:49.006955 (+2779958us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54000389d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:49.007268 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871416192}
W20260709 13:16:49.026283 12255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.438s	user 0.023s	sys 0.021s
W20260709 13:16:49.026947 12255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.472s	user 0.024s	sys 0.022s
I20260709 13:16:49.038713  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.046844 11638 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.047506 11638 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.048205 12333 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:49.050559 11638 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:49.051548 11638 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.052106 11638 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.067704 12333 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:49.069516 12333 consensus_queue.cc:1243] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:49.071903 12213 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:49.093003  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003023e0 after lost signal to thread 7660
I20260709 13:16:49.095587 11638 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:49.103439  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 354) took 1008 ms. Trace:
I20260709 13:16:49.103946  8844 rpcz_store.cc:276] 0709 13:16:48.094614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.102042 (+1007428us) service_pool.cc:224] Handling call
0709 13:16:49.102427 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.102873 (+   446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.102911 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.102978 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:49.103041 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.103099 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.103217 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:49.103484  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 352) took 1011 ms. Trace:
I20260709 13:16:49.106566  8838 rpcz_store.cc:276] 0709 13:16:48.092281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.102389 (+1010108us) service_pool.cc:224] Handling call
0709 13:16:49.102698 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.103076 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.103101 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.103131 (+    30us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:49.103155 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.103216 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.103311 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:49.107470  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 353) took 1014 ms. Trace:
I20260709 13:16:49.107872  8835 rpcz_store.cc:276] 0709 13:16:48.092675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.106292 (+1013617us) service_pool.cc:224] Handling call
0709 13:16:49.106646 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.107012 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.107039 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.107102 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:49.107136 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.107187 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.107296 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:49.110033  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.111306  8913 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:49.113363  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 145002us
I20260709 13:16:49.114792  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.115105  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.115602  8915 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 3.
I20260709 13:16:49.115754  8918 raft_consensus.cc:2376] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9. Re-sending same reply.
I20260709 13:16:49.118945  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:49.129455 12175 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.117337 12293 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.134006 12213 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.135759 12293 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.138078  9461 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:49.139321  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:49.139448  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.140221  8918 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.139385 12111 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.143100 12021 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.140266 12339 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:49.145128 12339 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:49.145489 12339 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.145864  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.146543  8915 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.152469  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:49.154089  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.155181  8911 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:49.155279  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.155966  8912 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:49.158623  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.163683  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.164615  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:49.165521  8911 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:16:49.165957  8911 pending_rounds.cc:85] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 5
I20260709 13:16:49.166183  8911 pending_rounds.cc:107] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:16:49.166463  8911 raft_consensus.cc:2889] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:49.164664  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:49.164615  8915 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:49.170797  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:49.172066 12293 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:49.172621 12293 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:49.174104 12293 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.168969  8918 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:49.188084  8912 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:49.197861  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.200495  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.202785  8918 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:49.206262  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08000d97c0 after lost signal to thread 8701
W20260709 13:16:49.207077  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800302360 after lost signal to thread 8732
W20260709 13:16:49.207397  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003025e0 after lost signal to thread 8733
I20260709 13:16:49.186441 12021 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:49.215690  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:49.231125  9461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 481) took 1136 ms. Trace:
I20260709 13:16:49.263983  8918 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:49.268077 12305 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:49.268764 12111 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:49.268730  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.270130  8913 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:16:49.269479  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.231606  9461 rpcz_store.cc:276] 0709 13:16:48.084948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.011224 (+926276us) service_pool.cc:224] Handling call
0709 13:16:49.011645 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:49.138582 (+126937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.217132 (+ 78550us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54004c72d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:49.221188 (+  4056us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286547200}
I20260709 13:16:49.259032 12021 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:49.276161  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 54705.8us
I20260709 13:16:49.281981  8912 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:49.270170 12332 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:49.284898  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.283298 12254 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.285897 12255 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.289875 12255 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.291007 12025 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.291704 12025 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:49.292410  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003026c0 after lost signal to thread 8735
W20260709 13:16:49.293150  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800302aa0 after lost signal to thread 8762
I20260709 13:16:49.293416  8912 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:49.295192 12332 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:16:49.293607  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800302600 after lost signal to thread 8763
I20260709 13:16:49.297412  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1616) took 2854 ms. Trace:
I20260709 13:16:49.297231 12332 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.297899  8761 rpcz_store.cc:276] 0709 13:16:46.442130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.646010 (+203880us) service_pool.cc:224] Handling call
0709 13:16:46.646451 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:49.053813 (+2407362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.055783 (+  1970us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:49.056535 (+   752us) log.cc:844] Serialized 52 byte log entry
0709 13:16:49.097892 (+ 41357us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:49.097947 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.114384 (+ 16437us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.296192 (+181808us) raft_consensus.cc:1685] finished
0709 13:16:49.296214 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.296342 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2393917,"thread_start_us":40816,"threads_started":1,"wal-append.queue_time_us":145155}
I20260709 13:16:49.300426  8911 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:16:49.300427  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:49.305243  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.305831  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.300730  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.306459  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.306536  8911 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:49.301219  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.307301  8916 raft_consensus.cc:2376] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:16:49.307689  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.307762  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.308158  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.302429  8917 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:49.308365  8912 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 3.
I20260709 13:16:49.308457  8911 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:49.306670  8913 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.318948 12339 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.301657  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.321964  8910 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:49.323523  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.309285  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.302947 12254 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.310006  8916 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:49.310981 12161 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.317008  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1616) took 2496 ms. Trace:
I20260709 13:16:49.324971  8917 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
W20260709 13:16:49.325605  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.334221  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.335899  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51927.9us
I20260709 13:16:49.336632  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.337677  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.322394 12339 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:49.342491  8838 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:16:49.343688  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800302b20 after lost signal to thread 8768
W20260709 13:16:49.346956  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.337564 12161 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.350983  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:49.334764  8909 rpcz_store.cc:276] 0709 13:16:46.784700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.839629 (+ 54929us) service_pool.cc:224] Handling call
0709 13:16:46.840055 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:46.867109 (+ 27054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:46.867138 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:46.869041 (+  1903us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.135917 (+2266876us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800452bc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:16:49.217796 (+ 81879us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:49.217849 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.220623 (+  2774us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.220669 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:49.220683 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.280676 (+ 59993us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27597,"raft.queue_time_us":33117,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":39179,"spinlock_wait_cycles":4116736,"thread_start_us":81506,"threads_started":1,"wal-append.queue_time_us":2299755}
I20260709 13:16:49.351868  8842 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:49.352237  9489 debug-util.cc:398] Leaking SignalData structure 0x7b080021afa0 after lost signal to thread 8793
I20260709 13:16:49.353212  8918 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:49.359310  8912 raft_consensus.cc:2410] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:49.365633  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:49.351107  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1574) took 2897 ms. Trace:
I20260709 13:16:49.366566  8916 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.367234  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:49.367792  8839 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:49.368501  8917 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:16:49.382269  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.389611  8835 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.394074  8913 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:49.404526  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.402956 12102 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.366739  8769 rpcz_store.cc:276] 0709 13:16:46.456529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.663889 (+207360us) service_pool.cc:224] Handling call
0709 13:16:46.664270 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.664508 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:46.731061 (+ 66553us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.350492 (+2619431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.350598 (+   106us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:49.350657 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.350751 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.350906 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2536830,"prepare.queue_time_us":33017,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"thread_start_us":145084,"threads_started":3,"wal-append.queue_time_us":27758,"wal-append.run_cpu_time_us":1169,"wal-append.run_wall_time_us":1030408}
I20260709 13:16:49.422977 12291 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:16:49.423053 12102 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:49.430401  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.408388 12317 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.433672 12111 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:16:49.433861 12317 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.435649 12102 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.440367  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.465546  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.495448  8915 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:49.463702 12317 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:49.499740  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800334920 after lost signal to thread 8868
W20260709 13:16:49.507061  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800281860 after lost signal to thread 8942
W20260709 13:16:49.508574  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0be0 after lost signal to thread 9492
W20260709 13:16:49.508953  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003274c0 after lost signal to thread 9493
W20260709 13:16:49.521430  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08002c0700 after lost signal to thread 12006
W20260709 13:16:49.521888  9489 debug-util.cc:398] Leaking SignalData structure 0x7b080034daa0 after lost signal to thread 12030
W20260709 13:16:49.522116  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800379b80 after lost signal to thread 12040
W20260709 13:16:49.522372  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800393b80 after lost signal to thread 12050
W20260709 13:16:49.522625  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800235540 after lost signal to thread 12065
W20260709 13:16:49.522941  9489 debug-util.cc:398] Leaking SignalData structure 0x7b080037e3a0 after lost signal to thread 12151
W20260709 13:16:49.523181  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3560 after lost signal to thread 12152
W20260709 13:16:49.523429  9489 debug-util.cc:398] Leaking SignalData structure 0x7b080032cc20 after lost signal to thread 12170
W20260709 13:16:49.523659  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003ce920 after lost signal to thread 12181
W20260709 13:16:49.523885  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08001f91a0 after lost signal to thread 12187
W20260709 13:16:49.530812  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800313ea0 after lost signal to thread 12231
I20260709 13:16:49.533303  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:49.533840  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003bf460 after lost signal to thread 12236
I20260709 13:16:49.539217  8915 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:49.549219  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.551750  8838 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:49.569150  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1572) took 3094 ms. Trace:
I20260709 13:16:49.571290  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.573307  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.575920  8914 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:49.581082  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.583595 12040 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:49.584403 12040 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.587481 12040 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.587636  8839 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:49.600239  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.601379  8842 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:49.596230  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 3.05912e+06us
I20260709 13:16:49.570180  8763 rpcz_store.cc:276] 0709 13:16:46.451940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.648545 (+196605us) service_pool.cc:224] Handling call
0709 13:16:46.655487 (+  6942us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:46.655690 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:16:46.671204 (+ 15514us) log.cc:844] Serialized 14 byte log entry
0709 13:16:49.542962 (+2871758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:49.545819 (+  2857us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:49.545902 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.545996 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.546120 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2739625,"prepare.queue_time_us":15760,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":2416,"thread_start_us":106526,"threads_started":2,"wal-append.queue_time_us":49170,"wal-append.run_cpu_time_us":1481,"wal-append.run_wall_time_us":1059988}
I20260709 13:16:49.603655  8917 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:49.605333  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.606004  8914 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:49.609283 12151 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.609922 12151 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.596099 12065 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.588150 12040 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:49.687134  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.689342  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.692662  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.693984  8917 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
W20260709 13:16:49.673209 12372 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 13:16:49.696024  8842 raft_consensus.cc:2368] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5.
I20260709 13:16:49.698807  8915 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:49.710031 12040 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.711720  8916 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:49.712736 12040 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:49.712888  8839 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.713341  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:49.714851  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:49.717365 12236 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:49.704703 12151 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:49.718144 12236 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:49.721227 12367 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:49.721879 12367 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.724125 12367 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:49.725205 12371 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:49.725906 12371 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.728204 12371 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:49.737106  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48089.3us
I20260709 13:16:49.738961  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:49.777699 12030 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.778383 12030 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.779135  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:49.779572  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:49.780799 12030 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.781277  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.724658 12367 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:49.781538  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:49.785267 12367 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.785985  8842 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.781185 12152 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:49.787532 12367 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:49.787639 12152 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.784754  8763 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:49.792423 12305 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:49.793015 12305 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:49.793200 12152 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:49.781586  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:49.782159  8769 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:49.781863 12377 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.797940 12377 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.800485 12377 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.800679 12367 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:49.803694 12367 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:49.804991 12367 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:49.807688 12255 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.808794 12025 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.822927  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1615) took 3411 ms. Trace:
I20260709 13:16:49.823369  8765 rpcz_store.cc:276] 0709 13:16:46.411086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.411219 (+   133us) service_pool.cc:224] Handling call
0709 13:16:46.411571 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.430616 (+3019045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.437811 (+  7195us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:49.492982 (+ 55171us) log.cc:844] Serialized 26 byte log entry
0709 13:16:49.577086 (+ 84104us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:49.577133 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:49.602451 (+ 25318us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:49.822595 (+220144us) raft_consensus.cc:1685] finished
0709 13:16:49.822615 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:49.822747 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2931162,"raft.queue_time_us":3197138,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":52,"thread_start_us":130403,"threads_started":2,"wal-append.queue_time_us":245370}
I20260709 13:16:49.782328 12187 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:16:49.826514 12372 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:16:49.829793  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:49.832924  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.801736 12254 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.782146 12373 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:49.846261  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.847201  8765 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:49.847407  8844 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:49.847898  8844 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:49.850123  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 146103us
I20260709 13:16:49.854272  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.854738  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.855418  8838 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:49.855551  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.856192  8835 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:49.856257  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.856401  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.854969  8839 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:49.856961  8837 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:49.857100  8840 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:49.857241  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.858147  8841 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.858104  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.858884  8843 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:49.849117  8844 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.860978  8844 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:49.861229  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.861888  8840 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:49.862064  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.862754  8843 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:49.837937 12065 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:49.865316  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.865989  8837 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:49.866328  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.868227 12186 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:49.870368  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.871187  8837 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.872071  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.877593  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.878181  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.879120  8841 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:16:49.885485  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 147261us
I20260709 13:16:49.878362  8765 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 4.
I20260709 13:16:49.890021  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.901575  8842 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:16:49.905135  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:49.913415  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.919677  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:49.920346  8732 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
W20260709 13:16:49.921067  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 81496.9us
I20260709 13:16:49.926842  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.931290 12065 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:49.932791  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.933624  8761 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:49.933923  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.934443  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.934770  8760 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:49.934976  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.935111  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:49.935686  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.936005  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.936100  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.936491  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.936854  8763 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:49.937088  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.937237  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.937685  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.937904  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.938323  8767 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:49.939131  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:49.941107 12021 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:49.942837  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.946686  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.947283  8840 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:49.947798  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.948089  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.948553  8835 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.949164  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.949285  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.949858  8838 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.950026  8837 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.946717  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:49.951539  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.952229  8843 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:49.953418  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.949920  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.937700  8766 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:49.936252  8760 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
W20260709 13:16:49.940493 12374 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260709 13:16:49.957701  8769 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:16:49.966066  9431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.029s	sys 0.045s
W20260709 13:16:49.967839  9431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.029s	sys 0.046s
W20260709 13:16:49.969712  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 581706us
W20260709 13:16:49.982261 12382 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.287s	user 0.000s	sys 0.002s
I20260709 13:16:49.985617  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.986506 12161 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:49.993448  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:49.990549  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.991926  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:49.993036 12065 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:49.993224  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:49.994377  8735 connection.cc:256] RPC call timeout handler was delayed by -1.79081085599978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 13:16:50.027312  8735 connection.cc:256] RPC call timeout handler was delayed by -1.0910926139999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2746s for a response
I20260709 13:16:50.005254  8839 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:49.994696  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.017568  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:50.018716  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.024497  8844 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:50.031316  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60225us
I20260709 13:16:50.032691  8842 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:16:50.034677  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.035128  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.035698  8841 raft_consensus.cc:2368] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5.
I20260709 13:16:50.035329  8843 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:50.037204  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.041244  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.044450  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.045176  8843 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:50.045528  8765 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:50.045248  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.049162  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:50.050026  8842 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:50.053591  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.024154 12293 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.023460 12377 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:50.059146  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.062697  9462 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:50.028635 12236 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:50.065316  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.066074  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.069010  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.069787  8842 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:50.079756  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.084000  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.102519 12021 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:50.107744  8843 raft_consensus.cc:1217] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[5.3-11.6]   Dedup: 7.4->[9.5-11.6]
I20260709 13:16:50.108368  8841 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:50.113343  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.114037  8843 pending_rounds.cc:85] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 4
I20260709 13:16:50.114460  8843 pending_rounds.cc:107] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:16:50.114744  8843 raft_consensus.cc:2889] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:50.123054 11887 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:16:50.129601  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61894.1us
I20260709 13:16:50.108014 12236 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:50.113576  8841 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:50.147897  8835 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:16:50.087245  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.074640 12293 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:50.143069  8912 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:16:50.141453  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 95459.3us
I20260709 13:16:50.086915 12254 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.153578 12254 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:50.154096 12254 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.153795  8662 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 6, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 6 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:50.060842 12065 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.170428  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:50.173655  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 94267.1us
I20260709 13:16:50.174569  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.184505 12386 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:50.187974 12367 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:50.089550 12377 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.188772  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:50.202651  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.216493  8836 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
W20260709 13:16:50.218075  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.218241  8760 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:50.223156  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.190694  8912 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
W20260709 13:16:50.226647  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52146.1us
I20260709 13:16:50.227636  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.192471  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:50.232821  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:50.235265  8844 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:50.245242  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.229296  8841 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.250492  8837 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:50.203464 12317 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:50.251461  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 222805us
I20260709 13:16:50.189677 12380 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:50.257179  8765 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:50.258678 12025 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.262274 12021 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:50.261303  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.273195  8841 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:50.273051  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 80745us
W20260709 13:16:50.273355  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 141852us
I20260709 13:16:50.218057 12305 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.256246 12386 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.260640 12380 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:50.263571 12237 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:50.281184  8765 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:50.288707  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:50.262734 12021 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.297397  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.285499  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.262969 12111 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:16:50.303946  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.304544 12305 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:50.190502  8662 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 7, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.305347  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.308347  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.308380  8836 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:50.309001  8836 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:50.310657 12236 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:50.313668  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.313858 12111 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:50.314569 12293 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:50.280057 12386 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:50.315662 12386 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.317179  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:50.317850  8838 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:50.309563 12021 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.320604 12377 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.321323  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.322052  9466 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:50.315165  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.322981  9464 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:50.297618 12367 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:50.325820  8836 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:50.329420  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:50.330247  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.313906  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1617) took 3791 ms. Trace:
I20260709 13:16:50.330703  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:50.330323 12152 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:16:50.337191  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.312021 12065 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.338402  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.338945  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.339236  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:50.339109 12378 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:50.339874  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.340647  8764 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:50.340994  8769 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:50.340931  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.343710  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:50.332527  8768 rpcz_store.cc:276] 0709 13:16:46.457349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.672476 (+215127us) service_pool.cc:224] Handling call
0709 13:16:46.687478 (+ 15002us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:49.570838 (+2883360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:49.572332 (+  1494us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:49.699172 (+126840us) log.cc:844] Serialized 52 byte log entry
0709 13:16:50.039723 (+340551us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:50.223460 (+183737us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.233071 (+  9611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.233222 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.233274 (+    52us) raft_consensus.cc:1685] finished
0709 13:16:50.233286 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.248647 (+ 15361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2804154,"raft.queue_time_us":3039831,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":6764,"thread_start_us":526946,"threads_started":3,"wal-append.queue_time_us":397812}
W20260709 13:16:50.353003  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.330533 12291 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:50.342244 12391 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.186s	user 0.002s	sys 0.000s
I20260709 13:16:50.356750  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.359913  8763 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:50.361254  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.361954  8767 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:50.363093  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.335041 12187 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.342841 12111 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:50.366618  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.373621  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.374017  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.343513 12367 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:50.370785  8662 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 7, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.373461 12187 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:50.385316 12187 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.373267 12111 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.386389 12111 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.381338 12386 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.392819 12386 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.393931  8766 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:50.395162  8760 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:50.372648 12380 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.399214 12021 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.381546 12040 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.401367 12040 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:50.401870 12040 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.405095  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:50.405762  8910 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:16:50.405959  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 98964us
W20260709 13:16:50.405870  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 74365.7us
W20260709 13:16:50.413977  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 84581.4us
I20260709 13:16:50.341195 12237 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.416138  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:50.400671 12380 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.427173  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.426241  9461 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.346154 12255 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 13:16:50.433043  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.382354 12291 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:50.413727 12152 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:50.420217 12386 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.441601  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:50.418380 12025 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:50.443957  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:50.445565  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:50.450194 12377 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.437477 12373 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.478545  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:50.474380  8808 leader_election.cc:336] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.521s (SENT)
I20260709 13:16:50.441915 12152 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.483686  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:50.451678 12386 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:50.486559  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45063.9us
I20260709 13:16:50.487030  8763 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:50.475373 12065 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.437742 12390 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:16:50.471745 12317 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:50.495067  8768 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:16:50.496085  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.503808  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:50.490854 12386 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.483606 12021 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.486318 12377 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:50.486173 12152 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:50.514684  8765 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
W20260709 13:16:50.504964  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 289191us
I20260709 13:16:50.515988  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.517294  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.513381  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:50.516680  8760 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:50.525200 12025 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:50.525530  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 165251us
I20260709 13:16:50.526573  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.547657 12161 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.547731  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.548338 12161 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:50.548902 12161 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.549052  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.550062 11887 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:50.550125  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.550714 11887 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:50.551329  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1624) took 4064 ms. Trace:
I20260709 13:16:50.551946  8762 rpcz_store.cc:276] 0709 13:16:46.486360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:46.851999 (+365639us) service_pool.cc:224] Handling call
0709 13:16:46.852417 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:49.774319 (+2921902us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:50.153234 (+378915us) log.cc:844] Serialized 14 byte log entry
0709 13:16:50.414990 (+261756us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:50.442648 (+ 27658us) log.cc:844] Serialized 26 byte log entry
0709 13:16:50.442846 (+   198us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:50.442900 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:50.455126 (+ 12226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:50.550939 (+ 95813us) raft_consensus.cc:1685] finished
0709 13:16:50.550965 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:50.551153 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2565423,"prepare.queue_time_us":507929,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":2801421,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":10861,"thread_start_us":843260,"threads_started":3,"wal-append.queue_time_us":324104}
I20260709 13:16:50.551174 11887 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:50.554039 12237 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.554787 12237 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:50.551384 12313 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.527901  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.560706  8761 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:50.551222  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.488041 12187 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.557740  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.566197  9461 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:50.520403 12373 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:50.568706  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.551203 12186 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.545018 12378 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.567467  8768 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:50.572028  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.584271  8761 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:16:50.561926 12313 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.586653  8841 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:50.528748 12407 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.527659 12405 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:50.527359 12291 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:50.606325  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 179693us
I20260709 13:16:50.576958 12186 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.609400  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:50.617159  9432 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.571s (SENT)
I20260709 13:16:50.562893 12254 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.508585 12367 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.622826  8761 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:50.623554  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:50.588231 12305 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:50.586215 12378 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.592851 12313 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:50.624969  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 210125us
I20260709 13:16:50.636600  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.589052 12373 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:50.639559  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.598678 12405 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.597231 12407 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:50.642863  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.625562 12186 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.639251 12255 consensus_queue.cc:1243] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:50.635630 12175 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:50.638283 12305 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:50.637796 12378 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.646337  8768 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 4.
I20260709 13:16:50.644843 12293 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:50.643055 12405 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:50.644178 12407 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:50.686317  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.692566  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.693094  8761 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:50.638020 12111 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:50.690145  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:50.693826  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 125188us
W20260709 13:16:50.696390  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79301.4us
I20260709 13:16:50.687263 12175 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:50.690297 12305 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:50.703794  9464 raft_consensus.cc:2368] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
I20260709 13:16:50.687606 12040 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:50.712575  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:50.715549  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 247705us
I20260709 13:16:50.729598  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:50.730317  8768 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:50.738404 12404 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:16:50.747597  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.748340  8769 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:50.748772 12187 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.706629 12175 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:50.764127 12408 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:16:50.772118  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.777287  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.777990 12040 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.665437 12317 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.710743 12293 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:50.708664 12406 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 13:16:50.799810  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.696067 12373 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.807176  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:50.791399  8808 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.539s (SENT)
I20260709 13:16:50.810847  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:50.813740  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.817554  8769 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:50.819370  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.819864  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.814435  8762 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:50.823370  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.808346 11887 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.827275 11887 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:50.833601  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:50.834332  8760 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:50.848454  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 148202us
I20260709 13:16:50.885804 12161 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.893080 12254 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:50.887957 12313 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:50.899163 12111 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:50.905277  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.806588 12293 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:50.914397  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 56665.8us
W20260709 13:16:50.931732  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 183206us
I20260709 13:16:50.932263  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:50.938825  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:50.932063 11887 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:50.943449  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:50.936188 12161 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:50.949654 11887 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:50.948024 12403 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.016148 11887 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.028641 12424 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:51.034648  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.035118 12424 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.037817 12424 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.038424 12424 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:51.038801 12424 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.039147 12424 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:51.041091 12313 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.042827 12237 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.043288 12237 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.043643 12237 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.045141  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:51.047331  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 104000us
I20260709 13:16:51.049183  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.016933 12403 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:51.053931  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 411187us
I20260709 13:16:51.054798  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:51.054776  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 105570us
I20260709 13:16:51.062031  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.064422  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.064597  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.064793 12175 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.065794 12186 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:51.066601 12427 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:16:51.093794  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.069108  8913 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:16:51.075604  8882 leader_election.cc:336] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.933s (SENT)
W20260709 13:16:51.079082 12380 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.002s
W20260709 13:16:51.081009 12152 consensus_meta.cc:287] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.000s
I20260709 13:16:51.082847 12186 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:51.072357 12386 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:16:51.059690 12313 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.104139  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.107180  8915 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:51.108904  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.090968 12421 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:51.111687  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.091566 12406 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:51.092449  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.099741  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.100306  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.055498 12403 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.086289 11887 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.104139  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.107120  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.119935  8917 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:51.109717  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.114012  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.112730  8916 raft_consensus.cc:2368] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:51.116109  8767 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:51.122224 12414 raft_consensus.cc:2764] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:16:51.123076 12414 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:51.123469 12414 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:51.123852 12414 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.102424 12410 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.125264 12416 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.126365 11887 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.126019 12416 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.123107  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.128401 12416 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.129664  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.125187 12410 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.111011 12407 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.131655 12410 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.105512 12152 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:51.133311 12407 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.134969 12152 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:51.135192  8763 raft_consensus.cc:2368] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8.
I20260709 13:16:51.092931 12175 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:51.125196  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 333847us
I20260709 13:16:51.136320 12293 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.136890 12425 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:51.137708  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.138372  8762 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:51.136883  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.141752  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:51.128784  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.143319 12313 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.143757 12313 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.144421 12313 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:51.142740  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66311.8us
I20260709 13:16:51.147939  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.149771 12434 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:16:51.151865  8808 leader_election.cc:336] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.667s (SENT)
I20260709 13:16:51.152985 12416 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:51.153903  8808 leader_election.cc:336] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.686s (SENT)
I20260709 13:16:51.153990 12416 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:51.154775  8808 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.723s (SENT)
I20260709 13:16:51.164250  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.108163 12386 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.166740  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.143663 12406 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:51.157127  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.152411  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.157655  8768 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:51.180379  8884 leader_election.cc:400] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5.
I20260709 13:16:51.180900  8884 leader_election.cc:403] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.166467 12416 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.183352 12406 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:51.183733  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.184475 12406 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.186403 12161 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:51.186830 12161 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.186754 12255 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:51.187384 12161 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:51.190560  8808 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.759s (SENT)
W20260709 13:16:51.191471  8808 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.761s (SENT)
I20260709 13:16:51.191856  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.193226 12255 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:16:51.193601 12236 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:51.194031 12236 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:51.194798 12236 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.195418 12305 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.195818 12236 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:51.190438 12386 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.198354 12403 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.199093  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.201296  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.221158  8767 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:51.201660  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.203655  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.205271  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.222043  8762 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.222126  8764 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.205376 12065 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:51.183403 12417 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.244647  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.245630  8843 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.207294  8836 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.207834 12405 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:51.209266  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 52202.9us
I20260709 13:16:51.247002  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.209842 12293 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:51.211403  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.212112  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.212657  8917 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:51.213294  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.214404  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.179428  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:51.249436  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70128.1us
W20260709 13:16:51.221405  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44079us
I20260709 13:16:51.222215  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:51.231918  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.224287 12434 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 4. Current term is 5.
I20260709 13:16:51.120643 12421 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.251619  8762 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:51.250058  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.204387 12237 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.275338  8836 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:16:51.275862  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.278013  8913 raft_consensus.cc:2368] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10.
I20260709 13:16:51.277776  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.277779  8765 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:51.279345  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.259120 12293 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:51.241252 12065 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.283316  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.283881  8915 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:51.284941  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.288487  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:51.289152  8762 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:51.285187  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.281191  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.261036 12426 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.261117 12025 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:51.293802  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.298110 12313 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.300398 12313 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:51.301441  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.706s (SENT)
I20260709 13:16:51.283303 12293 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.306294  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.306444  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.188786 12410 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.311848  8917 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:16:51.318570  8762 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:51.287955 12317 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:51.322574  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.320278  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.323101  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.326630  8916 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:51.328081  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.329885  8916 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.324101  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.323434  8915 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.313856  8917 pending_rounds.cc:85] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 4
I20260709 13:16:51.331408  8917 pending_rounds.cc:107] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:16:51.331784  8917 raft_consensus.cc:2889] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:51.322619  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.330984  8918 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:51.332691  8767 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:51.334524  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.335115  8911 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.336476  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.338112  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.339428  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.341198  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.341955  8909 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.343464  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.340765  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.348698  8762 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:51.350553  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.351962  8910 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:16:51.304888 12404 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:51.360985  8764 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:51.304282 12025 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:51.308135 12434 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:51.365684  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.365881  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:51.366609  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46409.9us
I20260709 13:16:51.367353  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:51.367588  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 116771us
I20260709 13:16:51.324623 12417 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:51.367815  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.371640  8767 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:51.371637  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.364688  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.325157 12317 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.372324  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.372509  8762 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:51.373257  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.375581  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.376889  8769 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.385820  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.363400 12415 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:51.365934 12025 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:51.389559  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.390420  8916 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:51.364202 12404 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.402532  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:16:51.392043  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.416313 12421 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.417307  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.417608  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.417950  8767 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.419005  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.421258  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.422286  8763 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:51.423174  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.424336  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.425045 12434 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:51.425561 12442 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:16:51.426553 12439 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:16:51.426198  8662 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.374464 12417 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.432235 12417 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.433195 12436 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:51.434109  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.434587 12436 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:51.435269  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.435355 12436 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:51.435474 12161 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.436370  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.438160  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.438925 12416 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:51.439446 12435 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 13:16:51.454680  8763 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:16:51.379012 12317 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:51.453677  8769 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:51.454694  8911 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:51.451742  8909 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:51.435932 12436 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.457317  8843 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:51.387619 12373 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:51.471148  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.472186  8764 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 5: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:51.472322  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:51.474020  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.478180  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.478853  8836 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.479367  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.480018  8838 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.480566  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.481482  8842 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:51.482446  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:51.415717 12404 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:51.460958 12422 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:51.491686  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.497849  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.498281  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.498692  8841 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:51.499432  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:51.500854  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.503360  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.504124  8839 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.505625  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:51.470530 12378 consensus_meta.cc:287] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.766s	user 0.014s	sys 0.006s
I20260709 13:16:51.428104  8662 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 8 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 10 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.509603  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:51.527628  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.510260  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.510123 12065 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.511094 12438 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.512096 12161 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.517297  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:51.519224 12441 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:16:51.394430 12386 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:16:51.442166 12414 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.523167  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.507858 12407 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:51.508906  8836 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:16:51.530140  8882 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.135s (SENT)
I20260709 13:16:51.534688  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:51.535405  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 102816us
I20260709 13:16:51.564697  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.471081 12436 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:51.536625  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.541002  8842 raft_consensus.cc:2368] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
I20260709 13:16:51.558069  8769 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:16:51.528481  8764 raft_consensus.cc:2376] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:16:51.468364 12434 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:16:51.570812  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:51.559147  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.569001  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.574717  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:51.502573  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:51.577353  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.577095  8843 raft_consensus.cc:606] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:51.579267  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.577731  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.557097 12416 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.521790 12424 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.596650  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.586670  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.585412  8836 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.587994  8839 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:51.589237  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.543228 12378 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:51.600409  8764 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:51.601562  8766 raft_consensus.cc:2368] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11.
I20260709 13:16:51.601848  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.603113  8764 raft_consensus.cc:2393] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:51.604283  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.534466 11887 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:51.605511  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:51.606510  9464 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.592881  8909 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:51.598706  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.606379  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.591094  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.609025  8765 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:51.609253  8763 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:51.609993  8769 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:51.611073  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.612396  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.612718  8839 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.611135  8764 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:51.614542  8839 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:16:51.615929  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:51.616122  8839 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.618873  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.619539  8763 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.620316  8767 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:51.621332  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:51.622220  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 92119.4us
I20260709 13:16:51.622437  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:51.622947  8882 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.187s (SENT)
I20260709 13:16:51.622977  8767 raft_consensus.cc:2376] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9. Re-sending same reply.
I20260709 13:16:51.582372 12175 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.577023 12305 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.629746  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:51.645038  8841 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.629948  8843 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:51.646832  8843 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:51.637346 12386 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:51.638741 12445 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:51.642411 12403 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:51.662577  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83404.7us
I20260709 13:16:51.663353  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.650157  8761 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:51.651464  8763 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:51.654620  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.666146  8916 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:51.608170 12237 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.670818  8761 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:51.671471  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.657042  8839 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:51.672493  8913 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:51.657682  8912 raft_consensus.cc:2368] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8.
I20260709 13:16:51.577798 12407 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.655716  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.666894  8734 leader_election.cc:400] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
I20260709 13:16:51.664755  8844 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:51.667398  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:51.707348  8764 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:51.667865  8909 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:51.707845  8662 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 9 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:51.709061  8909 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:51.654378  8836 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:51.709779  8662 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 6, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 6 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:51.716953  8841 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:51.620100 12378 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:51.679850  8917 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:51.670305  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:51.698418  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75490.7us
I20260709 13:16:51.697453  8916 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:51.695119  8765 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:16:51.668907  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 252607us
I20260709 13:16:51.710949  8734 leader_election.cc:403] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.722298  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.674319 12410 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.703526 12152 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:51.752796  8916 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:16:51.730350  8915 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:16:51.752005  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 95695.7us
I20260709 13:16:51.764467  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.765780  9464 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:16:51.770236  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48062.7us
I20260709 13:16:51.771108  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:51.772521  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 109244us
I20260709 13:16:51.773306  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.774747  8916 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.777192  8732 leader_election.cc:400] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:51.777559  8732 leader_election.cc:403] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:51.764216 12373 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:16:51.762375 12152 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:51.770151 12161 raft_consensus.cc:2764] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:16:51.799243  8909 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:51.802366  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.782940 12403 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.784191 12378 raft_consensus.cc:2764] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:51.785115 12406 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
W20260709 13:16:51.815991  8666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 220) took 30830 ms (client timeout 15000 ms). Trace:
I20260709 13:16:51.816414 12455 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:51.817310 12446 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:16:51.821484 12424 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:51.823792 12414 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.825035  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.851193  8911 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:51.825919  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.834180  8916 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:51.814388 12453 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.836448  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.805909 12152 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.842041  8838 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:51.842933  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.828636 12405 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:51.764117  8662 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 10 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.842430 12161 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:16:51.846616  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.846858  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:51.836642  8666 rpcz_store.cc:269] 0709 13:16:20.776611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.785058 (+  8447us) service_pool.cc:224] Handling call
0709 13:16:51.591273 (+30806215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:46.568162 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:46.615704 (+ 47542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:46.615755 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:16:46.615782 (+    27us) tablet.cc:662] Decoding operations
0709 13:16:46.775720 (+159938us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:46.775780 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:46.775811 (+    31us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:16:46.777282 (+  1471us) tablet.cc:701] Row locks acquired
0709 13:16:46.777302 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:46.777443 (+   141us) write_op.cc:270] Start()
0709 13:16:46.777555 (+   112us) write_op.cc:276] Timestamp: P: 1783603006777401 usec, L: 0
0709 13:16:46.777577 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:46.778439 (+   862us) log.cc:844] Serialized 6370 byte log entry
0709 13:16:48.907832 (+2129393us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b5400169520. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fd116b8 00007fce6fd112fa 00007fce6fd95965 00007fce6fd95e09 00007fce737d0581 00007fce737cfd58 00007fce737d49f1 00007fce737d49a9 00007fce737d4939 00007fce737d4901
0709 13:16:48.928201 (+ 20369us) op_driver.cc:464] REPLICATION: finished
0709 13:16:48.988319 (+ 60118us) write_op.cc:301] APPLY: starting
0709 13:16:48.988470 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:49.000336 (+ 11866us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:49.000378 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:49.002849 (+  2471us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:49.003420 (+   571us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:16:49.003489 (+    69us) write_op.cc:312] APPLY: finished
0709 13:16:49.004250 (+   761us) log.cc:844] Serialized 112 byte log entry
0709 13:16:49.062345 (+ 58095us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:49.062663 (+   318us) write_op.cc:454] Released schema lock
0709 13:16:49.062740 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:49.069400 (+  6660us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:49.069430 (+    30us) write_op.cc:454] Released schema lock
0709 13:16:49.323941 (+254511us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9732a 00007fce6fd1cf14 00007fce6fd1cec3 00007fce6fd1ce38 00007fce6fd1cdf3 00007fce6fd1c0dc 00007fce6fd45e16 00007fce6fd2dcbb 00007fce6fd1839d 00007fce6fd1bd75
Metrics: {"mutex_wait_us":11481,"reported_tablets":53,"spinlock_wait_cycles":1968896,"child_traces":[["op",{"apply.queue_time_us":59733,"apply.run_cpu_time_us":13170,"apply.run_wall_time_us":81070,"num_ops":16,"prepare.queue_time_us":316458,"prepare.run_cpu_time_us":84471,"prepare.run_wall_time_us":2371437,"raft.queue_time_us":93545,"raft.run_cpu_time_us":40019,"raft.run_wall_time_us":2293831,"replication_time_us":2150434,"spinlock_wait_cycles":4362905984,"thread_start_us":446417,"threads_started":5,"wal-append.queue_time_us":250413,"wal-append.run_cpu_time_us":15679,"wal-append.run_wall_time_us":2122969}]]}
I20260709 13:16:51.852137  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.855295 12420 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9.
I20260709 13:16:51.859464 12332 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:51.864775  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.895272  8914 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:51.869287  8917 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:51.874300 12414 raft_consensus.cc:993] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:16:51.881350  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.897753  8909 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:51.864127 12317 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.845847 12065 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.890031 12460 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:16:51.890300  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 113245us
I20260709 13:16:51.903522  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.904793  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.891830  9467 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:16:51.898347  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 72511.7us
I20260709 13:16:51.881796  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.907439  8735 leader_election.cc:400] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
W20260709 13:16:51.900686  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48625.8us
I20260709 13:16:51.909090 12332 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:51.909402 12452 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:51.837499 12293 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:51.911562 12332 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.891548 12021 raft_consensus.cc:2764] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:51.912124 12293 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:51.912237 12449 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:51.903908 12237 raft_consensus.cc:1081] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
W20260709 13:16:51.913980 12236 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.001s
I20260709 13:16:51.909111 12254 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:51.914491 12254 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:51.914795  8768 raft_consensus.cc:2410] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:16:51.914880 12254 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:51.915850  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.916602  8910 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:51.912609 12447 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:51.911399 12452 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:51.919329 12452 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:51.919705 12452 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:51.908639  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:51.925952  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.927603  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.904189 11887 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:51.930522 11887 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:51.930457 12463 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:51.938350 12025 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.944238  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.945334  8840 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:16:51.946774  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 100242us
I20260709 13:16:51.931080 11887 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.954960  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.955551  8918 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:51.924736 12420 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:51.896572 12404 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:51.957207  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:51.913790 12237 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:51.952394  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:51.934240 12065 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:51.984256  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:51.987619  8837 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:51.947587 12378 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:51.986685  8914 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:51.950879 12236 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:16:51.995174  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44755.3us
I20260709 13:16:51.996721  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.957429 12403 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:51.995762  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:51.985231 12463 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:16:52.005028  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.939361 12405 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:16:52.008605  8917 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:51.950309 12407 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.007019  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:51.956514 12460 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:16:51.953433 12452 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:52.041348  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.060091  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.011263 12453 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:52.058872  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:52.063391  8843 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:52.060168  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 77777.1us
I20260709 13:16:52.075870  8918 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:52.081815  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.059597 12161 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:16:52.077567 12417 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.005s
I20260709 13:16:52.098379  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.101542 12161 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:52.101955 12437 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:52.102264 12175 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:16:52.102458  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.102703 12461 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:16:52.103964 12386 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.021107 12065 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:16:52.067227 12236 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.145614 12386 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.146782 12386 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.148139 12386 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.148495 12025 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.014097 12420 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:16:52.115463  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:52.140425 12469 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.134465 12417 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:52.142249 12462 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:16:52.014415 12451 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:16:52.147446 12373 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 4. Current term is 5.
I20260709 13:16:52.095698 12434 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:16:52.189050 12464 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:16:52.191275 12161 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.196955  9464 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.084404 12405 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.090914 12453 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:52.115135 12438 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:52.173276  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49847.4us
W20260709 13:16:52.151175 12436 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.000s
W20260709 13:16:52.184052  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68673.4us
I20260709 13:16:52.137244 12305 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.013160  8662 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.184473 12175 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:52.199374  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:52.204573  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 207925us
I20260709 13:16:52.205828  8842 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:52.206004  8835 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.212150 12453 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.213204  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:52.214025  8837 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:52.215512 12424 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:52.202294 12405 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:52.217779 12405 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.218962 12405 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.216706 12424 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.221149 12424 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:52.221935 12424 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:52.223145 12424 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.134392 12463 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:16:52.225904 12438 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:52.226405 11887 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.227167 12438 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.203001 12317 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.230832 12175 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.231303 12417 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.232955 12404 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.200078 12449 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:52.234110 12449 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:52.200692 12460 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.163877 12437 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:52.200002 12236 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:52.208339 12436 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.236836 12449 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:52.271405 12420 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:52.273223 12452 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.273391 12463 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:52.273993 12463 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.275161 12463 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.270109 12065 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:52.245343  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.279285  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.252151  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1631) took 1054 ms. Trace:
I20260709 13:16:52.284371  8768 rpcz_store.cc:276] 0709 13:16:51.198043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.213993 (+ 15950us) service_pool.cc:224] Handling call
0709 13:16:52.251884 (+1037891us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54001a8954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:52.252065 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530354560}
I20260709 13:16:52.254215  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1639) took 1012 ms. Trace:
I20260709 13:16:52.286422  8769 rpcz_store.cc:276] 0709 13:16:51.241986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.652067 (+410081us) service_pool.cc:224] Handling call
0709 13:16:51.652370 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:51.939208 (+286838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.939250 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:51.939292 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:51.939329 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:52.253875 (+314546us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b5400199954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:52.253935 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:52.254102 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659206016}
W20260709 13:16:52.252912  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46244us
W20260709 13:16:52.267846  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.268424  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:52.268031  8766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58862 (request call id 310) took 1582 ms (client timeout 1706 ms). Trace:
I20260709 13:16:52.288709  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.295037 12463 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.295169  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:52.296028  8914 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:52.296700  8915 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:52.296475 12065 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:52.239416 12460 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.245062 12423 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:52.299413 12423 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.299052 12460 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.301015 12236 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.265213 12467 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:52.302662 12467 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.302322 12236 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.303825 12467 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.264564 12466 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:16:52.263496 12465 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.173s	user 0.003s	sys 0.000s
I20260709 13:16:52.305523 12378 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:16:52.288666  8766 rpcz_store.cc:269] 0709 13:16:50.685701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.687209 (+  1508us) service_pool.cc:224] Handling call
0709 13:16:52.267813 (+1580604us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54000ba9d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:52.267945 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2088612096}
I20260709 13:16:52.300588 12423 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.318035  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:52.336454  8843 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:52.300529 12460 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.326673  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:52.345468  8917 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.256994  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:52.314010  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.330302  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.331230  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:52.330636  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:52.384554  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:52.385293  8769 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:16:52.336030  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:52.326224  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 116176us
I20260709 13:16:52.272137  8662 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 12, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 12 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:52.368453  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 372751us
I20260709 13:16:52.387337  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.368376  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:52.388320  8914 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:52.377503  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:52.309056 12466 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.389189  8915 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.370873 12407 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.381151  8837 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:52.381707  8843 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:52.369120  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:52.385406  8766 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:16:52.396909  8765 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:52.343448  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:52.398061  8918 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:52.394030  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.327232 12378 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:52.402297  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 88412.1us
I20260709 13:16:52.408900  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:52.413883  9432 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.518s (SENT)
I20260709 13:16:52.415356  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:52.327310 12468 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:52.425102  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:52.424211  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.439074  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.440706  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.385051 12467 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.417558  8662 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 9, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:16:52.452889  8662 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:52.455261  8662 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 4 to 5, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 5 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:16:52.458812  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71559.2us
W20260709 13:16:52.460495  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51904.2us
I20260709 13:16:52.444670  8917 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:52.462350  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:52.391881 12437 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:52.467445  8768 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:52.419849 12414 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:16:52.487915  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 62872.6us
I20260709 13:16:52.488590  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.489835  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:52.425783 12455 raft_consensus.cc:2764] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:16:52.499042  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:52.496315 12424 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.497134  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.432017 12468 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:52.501380  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.457695 12423 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.502892  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:52.504928  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.458020 12420 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.491360 12021 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:52.516568  8915 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:52.499543 12405 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.408432 12407 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:52.516027  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.493458 12449 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:52.516646  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:52.486907 12472 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.523227  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.493255 12414 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:52.504962 12468 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.518042 12437 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:52.525070 12254 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.007s
I20260709 13:16:52.502813 12255 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.528512  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:52.528430  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.552922 12437 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:52.556527 11887 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:52.556818  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.556917  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:52.557749  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:52.560587 12448 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:52.561058 12451 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.563138  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:52.531972 12461 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:52.562965  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:52.518646 12420 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.551245 12254 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.520519 12317 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:52.527002 12449 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:52.611896  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83533us
I20260709 13:16:52.519102 12378 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.597353  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:52.530329 12414 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:52.563625  8837 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:52.533245 12434 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:52.554045  8732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.590s (SENT) [suppressed 67 similar messages]
I20260709 13:16:52.580614 12025 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:52.513199 12466 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.580669 12448 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:52.613557  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.594746 12313 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:52.604260 12451 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:52.602196 12065 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:52.621209  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 92768.8us
I20260709 13:16:52.625141  8838 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:16:52.562260 12476 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:16:52.615075 12449 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.633435  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:52.635445  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72493.9us
I20260709 13:16:52.625854 12255 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.626992 12025 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:52.611239 12461 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.620277 12434 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:52.613044 12405 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:52.631654 12451 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:52.685230  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.689783  8915 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:16:52.690742  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.692200  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78727.2us
I20260709 13:16:52.692993  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.638078 12436 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:52.663421 12469 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:52.665628 12065 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.706189  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.665700 12317 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:52.680918 12025 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:52.713524  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 299679us
I20260709 13:16:52.716542  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:52.679858 12434 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:52.718839  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:52.677922 12482 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:52.723399  8837 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.690681 12313 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:52.730799  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:52.698021 12416 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:52.738663  8841 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:52.732818  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:52.733572  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 179536us
I20260709 13:16:52.702183 12424 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:16:52.741873  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 108524us
I20260709 13:16:52.744952  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.715907 12457 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:52.691685 12463 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:16:52.747315  9432 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.697109 12236 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:16:52.722536 12438 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:52.746625 12152 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.852s	user 0.013s	sys 0.000s
I20260709 13:16:52.744982 12436 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.740885 12405 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:52.738631 12416 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:52.722760 12367 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:16:52.747953 12472 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:52.749733 12455 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:52.716249 12065 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:52.811846  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66068.3us
I20260709 13:16:52.772950 12407 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:52.748148 12404 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:52.833670  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.786571 12457 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:52.852885  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.856302  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:52.857170  8768 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:52.857738  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.858289  8769 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:16:52.858968  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.859679  8762 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:52.785811 12436 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:52.871862  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.873834  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:52.876498  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:52.879597  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 92323.6us
W20260709 13:16:52.869910  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 125108us
I20260709 13:16:52.881340  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:52.733225 12448 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.886765  8767 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:52.891618  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:52.893622  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.785583 12152 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.903501  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.910974  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:52.911757  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.828510 12494 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.852092 12236 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.916507  8766 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:52.876538 12436 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:52.922508  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:52.785771 12438 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:52.892608 12470 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:52.836995 12237 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:16:52.908390 12386 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.006s
I20260709 13:16:52.918448 12494 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:52.888794 12367 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:52.973399  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.973914  8763 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:52.915737 12254 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.976725  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:52.989544  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.009742  8765 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:52.980700  8915 raft_consensus.cc:2410] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:16:52.940608 12503 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:52.929395 12485 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:52.933261 12463 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:52.934584 12448 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.017833  8769 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:16:53.022007  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 225640us
W20260709 13:16:52.956581 12489 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
I20260709 13:16:52.950835 12494 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:53.011332 12487 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
W20260709 13:16:52.975587 12477 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260709 13:16:53.036104  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.019047 12503 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:52.929526 12236 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.886904 12317 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:53.023329 12479 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:16:52.909809 12313 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:52.915426 12416 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:52.981256 12499 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:52.957738 12420 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:52.920632 12469 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:53.021471 12485 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:53.023830 12152 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:53.073256 12483 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 13:16:53.090819 12471 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:16:53.025343 12463 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.109647  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:53.119848  8918 raft_consensus.cc:606] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.120371  8918 raft_consensus.cc:614] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:53.121434  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 240692us
I20260709 13:16:53.122335  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.111958  8765 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:53.068565 12367 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:53.020238 12405 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.139243  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.139992  8913 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:16:53.076251 12461 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.095660 12065 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.129953 12504 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:53.154870 12504 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:53.155570 12502 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:16:53.155314 12482 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:53.158164 12236 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.158840 12420 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:53.159232 12420 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:53.162237 12416 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.162403  8763 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:53.111001 12485 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.178506  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.179347  8765 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.120522 12455 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.203413 12498 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:53.204067 12498 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.206743  8918 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:53.208530  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.216416  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.184197 12386 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:53.232208  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.189531 12504 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:53.244062  8918 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.245034  8913 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:53.265251  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.249576  8910 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.266021  8918 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
W20260709 13:16:53.235934  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 163554us
I20260709 13:16:53.267047  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.233349  8909 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:53.230366  8765 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:16:53.236953 12514 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:53.237715 12488 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 13:16:53.274004  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.237900 12480 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:16:53.270733  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.279112  8765 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:53.280400  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.281962  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.244280  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:53.272841  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.256342  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 425655us
I20260709 13:16:53.288515  8915 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:16:53.291456  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.292069  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.292364  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.295591  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.301345  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.301360  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.302696  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.303210  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.305627  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.193707 12025 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.312932  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.289788  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.314711  8909 raft_consensus.cc:2376] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10. Re-sending same reply.
W20260709 13:16:53.317883  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.318950  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:53.319904  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 188191us
I20260709 13:16:53.231360 12386 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:53.308256  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.238922 12498 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.309401  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.331384  8918 raft_consensus.cc:2376] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10. Re-sending same reply.
I20260709 13:16:53.311213  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.322081  9432 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:53.332695  8917 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:53.328770  8910 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:16:53.306866  8765 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:53.273510 12514 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:53.211798 12455 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.345208  8838 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.338058  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.253381 12415 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:16:53.337554 12254 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.359895 12524 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.359660 12254 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.360349 12524 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:53.348489  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.364703  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.365804  8767 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:53.360785 12524 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:53.368263  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.368638 12254 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:53.369071 12484 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260709 13:16:53.369268 12254 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.369515 12475 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.369828 12254 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.370113 12475 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.374555  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.376096  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.377084  8765 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:53.377370  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.377992  8836 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:53.379586  8836 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:16:53.383060  8836 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:53.385968  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.396116  8837 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:53.333873 12476 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.176465 12503 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.401667  8836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:53.335975 12515 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:16:53.361836 12481 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.506s	user 0.001s	sys 0.002s
I20260709 13:16:53.400072  8913 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:53.409443  8765 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.337101 12438 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.338986 12504 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.412390  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.563897  8765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:16:53.413054  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.564848  8835 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:16:53.341274 12514 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.566735 12523 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:53.567806 12504 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:53.568193 12504 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:53.569487 12378 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.569408 12504 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.570609 12504 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.431742  8836 raft_consensus.cc:606] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.573526  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.354283 12498 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.574203  8917 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.574350 12498 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.577023 12498 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.432667  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:53.577903  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 161408us
I20260709 13:16:53.578434 12025 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.579574 12474 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:53.372694 12475 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.372803 12463 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.580303 12474 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.462729 12065 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:53.581671 12065 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.580816 12474 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.584245 12065 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.218449 12469 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.585851  8735 leader_election.cc:400] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:16:53.586073 12466 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.586689 12065 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.467866 12507 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:53.587931 12507 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.468470 12497 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:16:53.467926 12449 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.790s	user 0.006s	sys 0.006s
I20260709 13:16:53.589689  8765 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:53.590142  8765 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.589946 12449 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:53.481464 12451 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.004s
I20260709 13:16:53.590934 12386 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:53.478096 12468 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.002s
I20260709 13:16:53.591451 12451 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.592123 12468 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.372803 12254 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:53.495952 12460 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.133s	user 0.011s	sys 0.000s
I20260709 13:16:53.503893  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 322) took 1113 ms. Trace:
I20260709 13:16:53.507638 12529 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:16:53.508695 12452 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.235s	user 0.005s	sys 0.011s
I20260709 13:16:53.509315 12513 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:16:53.511085  8842 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:53.628685  8915 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.511754  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.512485  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.630479 12452 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.630558  8844 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:16:53.430910 12416 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.513732 12410 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:53.633625 12410 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:53.516652 12455 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:53.519800 12503 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.637267  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.638067  8915 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:53.521140 12521 consensus_queue.cc:1175] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdb96be202c2447586477b2077b7d5bf" responder_term: 10 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:53.524627  8761 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:53.514575 12414 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.887s	user 0.011s	sys 0.001s
W20260709 13:16:53.644950 12447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.007s	sys 0.011s
I20260709 13:16:53.461719 12476 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.645399 12414 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.647746 12414 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.648307 12476 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.530413 12472 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:53.537328 12448 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.004s
I20260709 13:16:53.537954  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:53.649767  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 111818us
W20260709 13:16:53.650300  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.649878 12472 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.651232 12455 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:53.539439 12436 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 13:16:53.539942 12485 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.652431  8912 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:53.653571 12485 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:53.653733  8844 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:16:53.542671 12434 consensus_meta.cc:287] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.000s
W20260709 13:16:53.556491  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.654114  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.654403 12434 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.432471  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:53.655566  8918 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:53.655835  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 223974us
I20260709 13:16:53.656807 12434 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:53.657495  8732 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.556772 12457 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.658989 12498 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:53.659436 12498 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.660029 12498 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.660449 12460 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.661753  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.663097 12236 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.524092 12420 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.664063 12420 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.665489  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:16:53.666162  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.559947  8769 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.430743  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:53.393307 12467 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.000s
I20260709 13:16:53.579670 12152 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.586238  8735 leader_election.cc:403] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:16:53.667932  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82239.8us
I20260709 13:16:53.667699 12152 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.668452  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.634902 12410 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.588421 12509 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.669266 12410 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.557926 12524 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:53.429352  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 128596us
I20260709 13:16:53.670174 12152 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:53.433943  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 189762us
W20260709 13:16:53.605373 12463 consensus_queue.cc:1175] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "773340b2958e4af5b2010b902b9e9c04" responder_term: 12 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.5-11.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:53.669281 12509 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:53.671849 12524 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.672380 12463 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:53.673007 12463 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.672663 12509 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.675535 12509 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.669479 12467 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.676774 12467 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:53.677667 12467 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.680889  8841 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:53.669281 12497 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:16:53.607537  8762 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:53.607852 12514 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:53.540153 12423 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.018s	user 0.010s	sys 0.004s
I20260709 13:16:53.610839  8765 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.683393 12521 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.683950 12521 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.684700 12514 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:53.594262  8760 rpcz_store.cc:276] 0709 13:16:52.390104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.390245 (+   141us) service_pool.cc:224] Handling call
0709 13:16:52.390589 (+   344us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:16:52.408546 (+ 17957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:52.408583 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:16:52.447517 (+ 38934us) log.cc:844] Serialized 78 byte log entry
0709 13:16:52.694977 (+247460us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:52.737888 (+ 42911us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.916447 (+178559us) log.cc:844] Serialized 14 byte log entry
0709 13:16:52.960177 (+ 43730us) log.cc:844] Serialized 14 byte log entry
0709 13:16:53.066492 (+106315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.066638 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.503548 (+436910us) raft_consensus.cc:1685] finished
0709 13:16:53.503592 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.503808 (+   216us) inbound_call.cc:177] Queueing success response
0709 13:16:53.533448 (+ 29640us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b1800389260. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
Metrics: {"mutex_wait_us":153272,"prepare.queue_time_us":1341428,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":99,"raft.queue_time_us":445025,"raft.run_cpu_time_us":908,"raft.run_wall_time_us":89504,"spinlock_wait_cycles":20705152,"thread_start_us":444275,"threads_started":4,"wal-append.queue_time_us":647545}
I20260709 13:16:53.612597  8843 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:16:53.687484  8767 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.687791  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.688542  8843 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:53.604947 12386 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:53.690374  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.690940  8767 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:53.692076 12463 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.686779  8765 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.606959 12468 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.658154 12436 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:53.614014  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 293160us
I20260709 13:16:53.693955  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.694655  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.695179  8916 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:53.695516 12485 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.695902  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.696355 12521 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.611841 12449 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.617123  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.605562 12507 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.619735  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.621155  8911 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.622170  8914 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:53.625140  8837 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:53.626312 12451 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.627295  8768 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
W20260709 13:16:53.630735  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 119091us
I20260709 13:16:53.650712  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.631944 12416 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.699566  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:53.699735  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49210.1us
I20260709 13:16:53.701032 12416 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.659351 12457 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.701851 12434 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.702384  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.703863 12414 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:53.704020 12451 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:53.704701 12414 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.704834 12476 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:53.705572  8910 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:53.564041  8840 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:53.706966 12436 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.703862 12457 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:53.666961 12367 consensus_queue.cc:1175] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "773340b2958e4af5b2010b902b9e9c04" responder_term: 10 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:53.708326  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.708974  8840 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:53.469254 12512 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:53.709621 12460 consensus_queue.cc:1175] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdb96be202c2447586477b2077b7d5bf" responder_term: 10 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:53.710242 12512 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:53.710919 12512 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.669982 12065 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.714596  8840 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:53.491472 12494 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.595626  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.704226  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.718432 12416 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:53.718581 12494 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.701166  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.719331 12416 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:53.719826  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.720486  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.720774 12449 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:53.692751  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.721423 12449 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:53.721966  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.722463 12449 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.723402 12457 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:16:53.724187 12457 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.724536 12373 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:53.722918 12434 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.725139 12373 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.727334 12373 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.730006 12485 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:53.731333 12423 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:53.732403 12507 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:16:53.645381 12447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.007s	sys 0.011s
I20260709 13:16:53.732652 12065 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:53.733215 12507 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:53.720295 12416 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.734149 12065 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.734254 12507 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.735565 12507 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:53.706187 12498 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.738180  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.739394 12498 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.741510  8767 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:53.741953  8767 pending_rounds.cc:85] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 5
I20260709 13:16:53.742230  8767 pending_rounds.cc:107] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:53.742460  8767 raft_consensus.cc:2889] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.747663  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.748363  8842 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:53.748665  8842 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:53.749408  8842 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.750324  8842 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.752110  8765 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:53.753533  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.754815  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.755977  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.756740  8765 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:53.759334  8767 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:16:53.760519 12152 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.761363 12451 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.761934 12451 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.762519  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.762742  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.763193  8762 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.764436 12451 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:53.764711  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.765405  8914 raft_consensus.cc:2376] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9. Re-sending same reply.
I20260709 13:16:53.765434  8910 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:53.766868  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.767616  8914 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:53.769017  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.769871  8914 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:53.771453  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.772161  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.773224  8914 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:53.772898 12476 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:53.773939 12476 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:53.774345 12476 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:53.775211 12476 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.776372 12476 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:53.777451  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:16:53.777545  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.773005  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.778228  8914 raft_consensus.cc:606] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.778581  8841 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:53.780405  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:53.781456  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 110801us
W20260709 13:16:53.781551  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 110544us
I20260709 13:16:53.782877  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.783197 12514 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.783516 12474 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.784085 12519 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.785442 12482 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:16:53.785918 12482 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:53.786365 12482 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:53.789439  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.783562  9431 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.791042  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:53.791402  8768 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:53.785652 12519 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:16:53.792007  9463 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:53.799750  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.801285  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.809291  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.809545  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.810011  8844 raft_consensus.cc:2376] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5. Re-sending same reply.
I20260709 13:16:53.810601  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.811517  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.628882 12237 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.812935  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.813117  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.813294 12237 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.813943  8841 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 5.
I20260709 13:16:53.814307  9465 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:53.815217  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.809312  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.817211 12474 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.818441  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.817127  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:16:53.794482  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:53.822796  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.823422  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.772190 12503 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.816143 12237 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.825485  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.826470  9467 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:53.794221 12529 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:53.829484  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:53.831060 12537 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:53.831624  8766 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:53.833031  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.834292 12515 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:53.834966 12485 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:53.835688  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.855590  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.836119  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:53.837152  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.838632  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.838935  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.839427  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:53.840256  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:53.859426  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.860635  8916 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 10 index: 4. (index mismatch)
I20260709 13:16:53.862545  8918 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:53.845112  8917 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:16:53.864614  8911 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:16:53.864722  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.866536  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.867470  8916 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:53.847306  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.852459  8768 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:53.853062  8915 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:53.869925  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.870702  8915 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:53.870544  8765 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 4. (term mismatch)
I20260709 13:16:53.871338  8765 pending_rounds.cc:85] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 3
I20260709 13:16:53.871682  8765 pending_rounds.cc:107] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 9.4
I20260709 13:16:53.872056  8765 raft_consensus.cc:2889] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.863595  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.876222  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.876531  8732 leader_election.cc:400] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:16:53.877122  8763 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.878945  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.881850  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.883450  8769 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:16:53.884024  8769 pending_rounds.cc:85] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 5
I20260709 13:16:53.884307  8769 pending_rounds.cc:107] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:16:53.884799  8769 raft_consensus.cc:2889] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:53.889269  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.889896  8910 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.890043  8883 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.884210  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.891222  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.892813  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.847203 12494 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:53.915887  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:53.916522  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.898561  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.915153 12065 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:53.921406  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.924312  8914 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:53.922953  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:53.927894  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 153938us
I20260709 13:16:53.930018  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:53.931030  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71951.7us
I20260709 13:16:53.932144  8842 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:53.933842  8762 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:53.935427  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.935812  8917 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: [9.7-10.8]
I20260709 13:16:53.936081  8916 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.935953 12512 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.937071  8768 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 13:16:53.937269  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:53.889153 12513 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.881609 12386 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.938933  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.939504 12467 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:53.939590 12512 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:53.881305 12474 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.940876  8761 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:16:53.939591  8912 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.930656  8835 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:53.945777 12065 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:53.945466 12474 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.946470  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.946789 12515 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:53.946823 12065 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.945575  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:53.949641  8841 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:53.947572 12498 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:53.949980  8909 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:53.953431  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.958673  8916 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:53.945569  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:53.947126  8844 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:53.875356 12378 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.956064  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.958263  8835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:16:53.866289 12466 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.961174  8835 raft_consensus.cc:606] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:53.957571  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.882133 12537 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:53.969698  8884 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:53.969908  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:53.970566 12537 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:53.851013 12436 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:16:53.975230 12436 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:53.981532  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:53.981643  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:53.983007  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:53.983618  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:53.922174 12152 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:53.985427  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 127515us
I20260709 13:16:53.852465 12503 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:53.967686  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.922793 12494 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:53.996341  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:53.996963  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.942757 12403 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:54.005975  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:54.007550  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:54.014673  8912 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:53.949113 12161 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:53.963960 12525 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:53.956770 12367 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.948019 12468 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:53.961879 12386 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.027094  8809 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:54.023454  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:53.949407 12472 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:16:54.035741  8760 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:53.993016 12463 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:53.949666 12414 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:16:53.992224 12152 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.031065  8844 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:53.949542 12451 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:16:54.003158 12513 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:54.016063 12423 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:54.030997  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:53.962136 12523 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:16:54.045758  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.026187 12420 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:54.069710  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.002763 12021 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:16:54.019310  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:54.148595  8763 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:53.989652 12466 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.041826  8910 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:53.988199 12378 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:54.139667  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 171980us
I20260709 13:16:54.037930  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:54.172710  8841 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:16:54.164237  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 179010us
W20260709 13:16:54.177340  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 150309us
W20260709 13:16:54.170122  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 139231us
W20260709 13:16:54.326808  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 302035us
I20260709 13:16:54.021503 12455 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:16:54.039573 12545 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:16:54.134320 12498 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:16:54.268386 12554 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 13:16:54.212981 12237 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.226634 12452 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.159443 12152 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.561681 12414 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.235146 12460 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.177778 12525 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.582952 12451 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:54.560439  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:54.036125 12305 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:54.562647  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 228307us
I20260709 13:16:54.235860 12505 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.563510  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 230083us
W20260709 13:16:54.567015  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 235009us
I20260709 13:16:54.202219 12386 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:16:54.571466  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 552232us
I20260709 13:16:54.659366  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:54.661274  9459 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
W20260709 13:16:54.272194 12509 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.003s
I20260709 13:16:54.239789 12407 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.279s
I20260709 13:16:54.035298 12406 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.463s
I20260709 13:16:54.035629 12367 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.663539 12509 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:54.130414 12468 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.144141 12504 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.430s
I20260709 13:16:54.673808  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1660) took 1468 ms. Trace:
I20260709 13:16:54.673254 12451 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:54.674357  8764 rpcz_store.cc:276] 0709 13:16:53.205617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.578898 (+373281us) service_pool.cc:224] Handling call
0709 13:16:53.579236 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.579589 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.579618 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.580134 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:16:53.925775 (+345641us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:53.925839 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.925939 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:54.673175 (+747236us) raft_consensus.cc:1685] finished
0709 13:16:54.673194 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:54.673593 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":694,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"spinlock_wait_cycles":2432,"thread_start_us":345131,"threads_started":1,"wal-append.queue_time_us":1090431}
I20260709 13:16:54.675408 12475 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.676038 12367 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.675540 12451 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.676203 12475 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.679014 12475 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.160840 12463 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.681751  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:54.318405 12254 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.275s
I20260709 13:16:54.025949 12482 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.179132 12423 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.232882 12448 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.171801 12512 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.211757 12513 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.624028 12565 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.626107 12551 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.400s	user 0.000s	sys 0.001s
I20260709 13:16:54.627724 12569 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:54.616086 12452 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.602361 12472 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.629380 12517 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:54.634891 12476 consensus_meta.cc:287] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.858s	user 0.014s	sys 0.004s
I20260709 13:16:54.618860 12414 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.635516 12503 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.588933 12449 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:54.605827 12498 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.635733 12460 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:54.656138  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 319636us
I20260709 13:16:54.620898  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:54.781258  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 160484us
I20260709 13:16:54.671031 12505 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.606869 12474 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:54.634959 12507 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.004s
I20260709 13:16:54.694276  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:54.031751 12529 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.636655 12434 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:54.800087  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105915us
I20260709 13:16:54.799835 12434 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.801517  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:54.636952 12305 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:54.802842 12305 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.807592 12452 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.686123 12515 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.685094 12437 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.727517  9464 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:54.783567 12498 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:54.689292 12463 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.695828 12509 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.719245  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:54.775765 12517 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.713696 12475 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:54.714886 12404 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:54.783733 12449 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.727022 12512 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:54.730523 12565 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.809237 12515 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.782024  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:54.813151  8840 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
W20260709 13:16:54.833925  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52008us
I20260709 13:16:54.745606 12569 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.770821 12406 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:54.793378 12476 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.769739 12472 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.808733 12452 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:54.823145  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:54.813666  8767 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:16:54.846706  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:54.825886  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 106744us
I20260709 13:16:54.847395  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:54.851236  8835 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:54.851420  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:54.794063 12503 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:54.851922  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:54.847705  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:54.821940  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:54.838300 12436 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.862s	user 0.013s	sys 0.000s
I20260709 13:16:54.824541 12505 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:54.815258 12561 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:16:54.840792 12558 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.824291 12414 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.841874 12406 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:54.838665 12434 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:54.841025 12404 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.857867 12572 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.820778 12513 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.831065 12449 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.821655 12482 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.818003 12423 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.822013 12468 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.879432  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:54.871050 12503 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:54.815864 12305 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.866962  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:54.849905 12452 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:54.820451  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:54.919838 12452 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.829392 12475 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:54.920938 12475 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:54.830449 12512 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.921871 12475 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.923727 12573 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:54.930733 12305 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.888006 12558 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.940088 12558 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:54.952240 12539 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:54.952934 12539 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:54.848241 12474 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.843830 12504 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:54.822124 12466 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.832906 12565 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:54.863155 12421 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:54.828500 12517 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.825327 12509 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.901350  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:54.822893 12437 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.871533 12436 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:54.830922 12562 raft_consensus.cc:2764] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:54.903990  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:54.905490  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.904495  8735 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:54.850307 12476 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.809254 12574 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:16:54.895119 12414 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:16:54.848546 12386 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.903484 12449 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.917438  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:54.967700  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 166267us
I20260709 13:16:54.832450 12494 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.993813  8835 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:54.992743  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:55.018337  8838 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:54.992753  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:55.032939  8836 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
W20260709 13:16:55.006327  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101915us
I20260709 13:16:55.012015  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 330) took 1059 ms. Trace:
I20260709 13:16:55.018674  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:54.897720 12404 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.988463  8842 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:55.037557  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:55.037192  8761 rpcz_store.cc:276] 0709 13:16:53.952414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.331487 (+379073us) service_pool.cc:224] Handling call
0709 13:16:54.563449 (+231962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.746096 (+182647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.746138 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.746193 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:54.746245 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.011633 (+265388us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400199454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:55.011708 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.011918 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419424000}
I20260709 13:16:54.974607 12573 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:54.902607 12572 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:55.102989  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.059175  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1846) took 1251 ms. Trace:
I20260709 13:16:55.117321  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:55.130838 12583 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.987748  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:54.991984 12503 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.131560 12583 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.992934 12582 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.048820 12494 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.006497 12423 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:54.988071 12576 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:54.993690 12515 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:55.131026  9465 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:54.990202 12437 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:54.991824 12569 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.978583 12474 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.141079 12410 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:55.141556 12410 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:55.141711 12474 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:55.142382 12560 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.214s	user 0.008s	sys 0.000s
I20260709 13:16:54.997737 12472 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.133031 12582 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.136440 12423 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:55.161155 12580 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:54.983099 12455 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:55.006115 12460 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:54.984050 12406 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.165686 12474 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:54.994663 12476 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:54.994118 12574 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.135s
I20260709 13:16:54.984261 12504 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.994964 12386 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:54.998076 12449 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.202335 12580 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:55.202142  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 409362us
I20260709 13:16:55.245239  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:55.250324  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:54.986361 12539 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:54.989802 12509 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.266484  8915 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:55.145521  8840 rpcz_store.cc:276] 0709 13:16:53.777185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.777300 (+   115us) service_pool.cc:224] Handling call
0709 13:16:55.028685 (+1251385us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b540028f0d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:55.028849 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289693440}
I20260709 13:16:55.175693 12472 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.199535 12423 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:54.994691 12414 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.170s
I20260709 13:16:55.142416 12410 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:55.262938  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 270395us
I20260709 13:16:55.264040  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.279335  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.266295 12451 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:55.147343 12576 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.270226  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:55.272277  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.273195  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:55.275143  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.276669  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1711) took 1439 ms. Trace:
I20260709 13:16:55.284771  8911 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:55.285517  8915 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:55.285061  8767 rpcz_store.cc:276] 0709 13:16:53.836779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.836919 (+   140us) service_pool.cc:224] Handling call
0709 13:16:55.276492 (+1439573us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540021e154. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:55.276615 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199108480}
I20260709 13:16:55.285933  8911 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:55.278527  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 394) took 1467 ms. Trace:
I20260709 13:16:55.282174  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.282802  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:55.257716 12403 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:16:55.283179  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 232779us
I20260709 13:16:55.288480  8914 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:55.291381  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:55.290050  8912 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:55.257424 12460 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:55.262065 12513 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.211850 12474 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.289356  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:55.258579 12577 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:55.314059  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.258901 12507 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:55.315755  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:55.316571  8839 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:16:55.268150 12519 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:16:55.286616  8843 rpcz_store.cc:276] 0709 13:16:53.798185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.798310 (+   125us) service_pool.cc:224] Handling call
0709 13:16:53.798668 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:53.942435 (+143767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.942469 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:53.957071 (+ 14602us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.214960 (+257889us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:16:54.226631 (+ 11671us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.226854 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.226935 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.015967 (+789032us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:55.244171 (+228204us) raft_consensus.cc:1685] finished
0709 13:16:55.264787 (+ 20616us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.264991 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161916,"prepare.queue_time_us":11379,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"raft.queue_time_us":145661,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":20394,"spinlock_wait_cycles":38551424,"thread_start_us":257556,"threads_started":1,"wal-append.queue_time_us":781732}
W20260709 13:16:55.303704  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 103479us
I20260709 13:16:55.259236 12569 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:55.290791  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.323887  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.324525  8917 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:55.324772  8918 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:16:55.218633 12498 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.312474  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:55.281416 12065 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.221765 12573 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.290084 12475 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:55.341022  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.341724  8769 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:55.342221  8918 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:55.320667  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.321926  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.323824  8836 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:55.343518  8914 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:55.286865 12583 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:55.332547  8839 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:16:55.352181  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.329283  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:55.292608 12406 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:55.353039  8911 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:55.319499  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.347790  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.319149 12577 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.304767 12517 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:55.326270  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:55.353255  8843 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:55.302560 12515 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.313256 12472 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:55.368242  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:55.398913  8914 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:55.369175  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.399928  8767 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:55.401261  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.401996  8767 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:55.403084  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.302366 12476 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:16:55.289927 12403 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.323232 12505 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:55.310588 12574 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 13:16:55.368323 12152 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.007s
I20260709 13:16:55.303685 12451 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.317364 12513 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.326222 12507 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.289270 12580 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.310377 12455 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.350455 12065 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:55.822860  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:55.851827  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.853554  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.848897  8918 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:55.358353 12313 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:55.918334 12571 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.097s	user 0.010s	sys 0.000s
I20260709 13:16:55.936936  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:55.794026 12587 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.330s	user 0.000s	sys 0.000s
W20260709 13:16:55.807845 12584 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.521s	user 0.002s	sys 0.000s
W20260709 13:16:55.789976 12494 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.657s	user 0.008s	sys 0.001s
W20260709 13:16:55.766644 12578 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.560s	user 0.002s	sys 0.000s
I20260709 13:16:55.393775 12460 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:55.938156  8767 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:55.394281 12498 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.394562 12509 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.395964 12404 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.789665  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:56.001597 12607 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:16:56.009416 12497 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:56.009910  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1850) took 1119 ms. Trace:
I20260709 13:16:56.010016 12497 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.010344  8844 rpcz_store.cc:276] 0709 13:16:54.890246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.890435 (+   189us) service_pool.cc:224] Handling call
0709 13:16:54.890904 (+   469us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:54.891396 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.891437 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:54.892229 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 13:16:55.245398 (+353169us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:55.245443 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.245517 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.009663 (+764146us) raft_consensus.cc:1685] finished
0709 13:16:56.009699 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.009852 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45418,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":339261,"threads_started":1,"wal-append.queue_time_us":447093}
I20260709 13:16:55.795197 12386 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.787637 12403 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:55.709185 12438 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:55.708019 12475 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:55.821076 12449 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.368280 12569 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:55.512418 12588 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:16:55.994793 12537 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:55.915016 12505 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.001108  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.054302  8767 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:56.055554  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:55.716910 12582 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:55.959718 12585 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.007064 12509 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.007767 12606 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:56.008347 12498 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:55.396476 12517 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.405643 12515 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:55.717445 12594 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:55.981482  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1717) took 2138 ms. Trace:
I20260709 13:16:56.026773  9459 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:56.033555  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1684) took 2051 ms. Trace:
W20260709 13:16:56.034066 12406 consensus_meta.cc:287] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.001s
I20260709 13:16:56.042436 12507 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.043781 12475 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.025307 12438 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:55.925973 12313 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.056326  8767 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:56.079962  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.081068  8767 raft_consensus.cc:2410] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:56.081971  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.082795  8767 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:16:56.083775  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.084415  8767 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:55.950116 12152 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.016310 12580 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:55.443845 12591 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.653s
I20260709 13:16:56.068730  8760 rpcz_store.cc:276] 0709 13:16:53.981873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.583396 (+601523us) service_pool.cc:224] Handling call
0709 13:16:54.583656 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.879447 (+295791us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.879480 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.879937 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:16:55.039639 (+159702us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:55.039691 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.039778 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.033289 (+993511us) raft_consensus.cc:1685] finished
0709 13:16:56.033315 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.033475 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79236,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":424496,"threads_started":2,"wal-append.queue_time_us":309887}
I20260709 13:16:56.005436 12460 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.065121 12474 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.104532  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.106161 12509 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.067834  8766 rpcz_store.cc:276] 0709 13:16:53.842746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.881679 (+ 38933us) service_pool.cc:224] Handling call
0709 13:16:53.882022 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.949255 (+ 67233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.949296 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:53.987488 (+ 38192us) log.cc:844] Serialized 52 byte log entry
0709 13:16:54.233787 (+246299us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:54.486823 (+253036us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.879195 (+392372us) log.cc:844] Serialized 14 byte log entry
0709 13:16:54.883232 (+  4037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:55.948986 (+1065754us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b5400198054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:55.949056 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:55.981133 (+ 32077us) raft_consensus.cc:1685] finished
0709 13:16:55.981167 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:55.981390 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13145,"prepare.queue_time_us":270349,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":553,"raft.queue_time_us":126228,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":47267,"spinlock_wait_cycles":129798528,"thread_start_us":512845,"threads_started":3,"wal-append.queue_time_us":649278,"wal-append.run_cpu_time_us":4568,"wal-append.run_wall_time_us":1241835}
I20260709 13:16:56.070909 12606 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:56.118443  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.121167  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.125499  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 329) took 2173 ms. Trace:
I20260709 13:16:56.061933 12537 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.132073  8763 rpcz_store.cc:276] 0709 13:16:53.952159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.330723 (+378564us) service_pool.cc:224] Handling call
0709 13:16:54.558566 (+227843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.728608 (+170042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.728639 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.728680 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:54.728713 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.125260 (+1396547us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400339354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:56.125311 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.125439 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390605184}
I20260709 13:16:56.129726  8760 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:56.089610 12594 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:56.090384 12577 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.134194  8767 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:16:56.141064  8767 pending_rounds.cc:85] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 5
I20260709 13:16:56.141407  8767 pending_rounds.cc:107] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:16:56.068807 12498 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.063907 12585 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:56.123462  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.017s	sys 0.018s
W20260709 13:16:56.145948  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.017s	sys 0.019s
I20260709 13:16:56.146210  8763 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:56.146507  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 820257us
I20260709 13:16:56.148372 12594 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:56.150722 12452 consensus_meta.cc:287] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.230s	user 0.013s	sys 0.000s
I20260709 13:16:56.151196 12452 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.141793  8767 raft_consensus.cc:2889] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:56.168573  8734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.017s	sys 0.029s
W20260709 13:16:56.155655  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.170266  8734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.017s	sys 0.029s
I20260709 13:16:56.164069 12313 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:56.147140 12423 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.000s
I20260709 13:16:56.164767 12606 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.168854  8767 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:56.154371 12539 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:56.162086 12438 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.165215 12569 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.173835  8763 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:56.117352 12472 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.020s	sys 0.047s
I20260709 13:16:56.187548  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.201494  8844 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:56.188077 12577 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.189062  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.190227  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.167452 12603 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.203958  8839 raft_consensus.cc:2410] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:16:56.190351  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.204769  8836 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 5.
W20260709 13:16:56.204946  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.207572  8840 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:56.191566  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:56.191872  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.177522  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:16:56.174147  8910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.018s	sys 0.022s
I20260709 13:16:56.209185  8838 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:16:56.209436  8910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.019s	sys 0.022s
I20260709 13:16:56.210382  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.210999  8838 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:56.211794  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.147507 12497 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.214159  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.217366  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.218307  8838 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:56.174000 12602 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.218255  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.227583  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:16:56.207173 12472 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.020s	sys 0.048s
I20260709 13:16:56.229899  8838 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:56.195245 12572 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.237689  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.240165 12152 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:56.241628  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.243969  8836 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:56.214480 12474 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:56.224936  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:56.256361 12406 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:56.261726 12452 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.264024  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1851) took 1373 ms. Trace:
I20260709 13:16:56.229687 12582 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.225109 12497 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.217376 12569 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:56.246392  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:56.198441 12476 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.018s	sys 0.028s
I20260709 13:16:56.199749 12423 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:56.285488  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79031.9us
I20260709 13:16:56.295945 12619 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:56.309315  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.310693  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.289582  8835 rpcz_store.cc:276] 0709 13:16:54.890703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.893962 (+  3259us) service_pool.cc:224] Handling call
0709 13:16:54.894369 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:55.030867 (+136498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.263733 (+1232866us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b540042b3d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:56.263951 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227857792}
I20260709 13:16:56.245858 12507 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.232503 12472 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:16:56.299983  8733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.009s	sys 0.034s
W20260709 13:16:56.303164  8808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.032s
W20260709 13:16:56.327666  8733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.009s	sys 0.034s
I20260709 13:16:56.225462 12577 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.287143 12612 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:56.314117 12476 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.018s	sys 0.029s
I20260709 13:16:56.323652  8762 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:56.309434 12619 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.296294 12406 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.233682 12602 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:56.327764  8808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.018s	sys 0.032s
I20260709 13:16:56.296567 12152 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.220523 12603 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.350369 12423 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:56.303771  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 453533us
I20260709 13:16:56.294598 12065 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:56.286362  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 80402.4us
I20260709 13:16:56.298970 12582 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.344791 12577 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.345163 12612 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.346627 12604 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:56.326212 12617 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.329636 12585 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:56.350078 12404 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:56.350666  8761 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:16:56.329098 12572 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.289968 12474 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:56.313948  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 67658.5us
I20260709 13:16:56.327714 12507 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.329427 12505 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:56.344448  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:56.303483 12497 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.312400 12569 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.354220 12517 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.392447  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.391929  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:56.393535  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61907us
I20260709 13:16:56.401727 12404 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:56.399113  8842 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.355398 12619 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:56.398103 12617 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.361974 12515 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:56.374363 12152 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.473459 12152 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.405305  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:56.390491 12610 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.426280 12404 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.394455 12460 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.422413  8767 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:56.422528  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 351) took 1162 ms. Trace:
W20260709 13:16:56.498569  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 111378us
I20260709 13:16:56.422749  8762 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
W20260709 13:16:56.432390  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.441686  8842 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:16:56.427506 12617 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.429383 12620 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.414690 12472 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.517117  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.407931 12507 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.498956  8910 rpcz_store.cc:276] 0709 13:16:55.260555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.280180 (+ 19625us) service_pool.cc:224] Handling call
0709 13:16:55.302971 (+ 22791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.312707 (+  9736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.312756 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:55.339075 (+ 26319us) log.cc:844] Serialized 26 byte log entry
0709 13:16:56.210142 (+871067us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:56.210201 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.210298 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:56.422281 (+211983us) raft_consensus.cc:1685] finished
0709 13:16:56.422301 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.422437 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18561,"raft.queue_time_us":165,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8513,"thread_start_us":805011,"threads_started":1,"wal-append.queue_time_us":964513}
I20260709 13:16:56.475594 12610 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.413898 12622 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:16:56.621527  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.407270 12572 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.626986  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:56.604959 12515 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.605223 12455 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:56.781165  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:56.788041  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 165079us
W20260709 13:16:56.789227  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.513335 12620 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:56.794184  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 407510us
I20260709 13:16:56.514261 12621 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:56.608182 12498 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:56.798589  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 281574us
I20260709 13:16:56.799355  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:56.801779  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 174880us
I20260709 13:16:56.400394 12604 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.802911  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.779788 12618 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:16:56.747947  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 342719us
I20260709 13:16:56.794019 12485 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:56.808223  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.797605 12161 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.804849 12452 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:56.775347 12404 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:56.627912 12622 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.811576  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.809571 12594 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.796319 12455 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.814821 12021 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.618870 12619 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.797053 12515 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.814683 12621 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:56.811072 12623 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.823369  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.818413 12452 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.839890  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:56.848747  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:56.869262  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.826972 12423 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.875957  8839 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:56.871888  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.873425  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:56.877826  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.825093 12618 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:56.878978  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:56.814987 12485 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.885257  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.874596 12577 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:56.838547 12621 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.877920  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.888422 12632 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:56.889986 12572 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:56.891110 12628 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:16:56.830559 12021 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:56.892825 12455 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:56.818321 12161 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.949563  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:56.994588  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.944790  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.837595 12612 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:56.995091  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:56.837824 12476 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.997342  8763 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:56.978235  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.981850 12610 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:56.984054 12580 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.876s	user 0.006s	sys 0.004s
I20260709 13:16:56.985308 12604 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.005326 12378 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.005563  8835 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:56.989295 12021 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.996690 12622 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.018302 12507 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.830900 12594 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.021715 12507 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.986438  8839 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:16:57.022404  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 440) took 3237 ms. Trace:
I20260709 13:16:57.022959 12594 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.841400 12460 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:57.023370  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.023586 12460 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:57.023998 12460 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:56.837842 12452 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:56.834784 12523 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:56.875056 12423 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.025544 12423 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:56.995582  8838 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:57.029253 12618 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.030472  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:57.031956  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.871140 12503 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 13:16:57.032759 12617 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:56.943498 12577 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:56.981941 12447 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:56.878585 12582 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:56.999370  8763 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:57.025225 12523 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.841157 12498 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 13:16:56.997041 12476 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:56.998834  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:56.965629 12621 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:56.987054 12632 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:57.035465 12539 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.000s
I20260709 13:16:57.060847  8838 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:57.022970  9464 rpcz_store.cc:276] 0709 13:16:53.785003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.789161 (+  4158us) service_pool.cc:224] Handling call
0709 13:16:53.789564 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.824767 (+1035203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.022036 (+2197269us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b540039ec54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:57.022289 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156516864}
I20260709 13:16:57.062973  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:57.063287  8765 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:57.064443  8844 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:57.073922  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.076316  8843 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:16:57.044996 12577 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.038100 12620 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.082978  8839 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.084884  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.087208  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.089639  9464 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 6.
I20260709 13:16:57.071043 12632 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.084681 12606 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.050212 12447 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:57.122210  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 156296us
I20260709 13:16:57.101430  8839 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.082450 12635 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.116369  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:56.871408 12623 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:57.150233  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 96366.4us
I20260709 13:16:57.123649 12455 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:57.163578  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.136046 12634 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.120379 12606 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:57.182387  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 379497us
I20260709 13:16:57.183475  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:57.151537 12640 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:16:57.188344  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57788.9us
I20260709 13:16:57.189075  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.167834 12455 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.178547 12585 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:57.182559 12515 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:57.204087 12645 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.228399  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.229843  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:57.230577  8763 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:57.231431  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.232026  8763 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:57.190459 12472 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.234395  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.235602  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.188495 12161 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.138773 12635 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:57.247388  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.187676 12640 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.197345 12415 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.238452  8763 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:57.267803  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:57.268560  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.225590 12650 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:57.192835 12616 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:16:57.203408 12620 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:16:57.203761 12539 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:16:57.269083  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.408393  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 447) took 2582 ms. Trace:
I20260709 13:16:57.416899  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.269280  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.269197  8763 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:57.418375  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:56.980659  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:57.237596 12472 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.236166 12515 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.438467  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.427313  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.267591 12254 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:57.310680  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.435736  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.435909  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:57.444967 12254 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.450083  8914 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.440301 12472 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.452096 12452 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.273342 12161 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.413808 12406 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.437740  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.464781  8838 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.169243 12634 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.229635 12585 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.416817  9466 rpcz_store.cc:276] 0709 13:16:54.825551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.825961 (+   410us) service_pool.cc:224] Handling call
0709 13:16:54.826264 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.835617 (+  9353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.835659 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.835715 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:16:54.835746 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.408133 (+2572387us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b54004c6654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:57.408186 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.408336 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21067008}
W20260709 13:16:57.366360  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.439164  8916 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:16:57.263607 12555 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 2.953s	user 0.015s	sys 0.000s
I20260709 13:16:57.439191  8763 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:16:57.441385  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.472743  8917 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.473717  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.474110 12452 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.474295  8917 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.403527 12021 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.476784 12021 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.469911 12161 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:57.413636 12643 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 13:16:57.407691 12449 raft_consensus.cc:993] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:16:57.266412 12415 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.241109 12645 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.441612 12621 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.463061  8915 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:57.435775  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.490006  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:57.279053 12637 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:57.264703 12640 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:57.440050 12152 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.966s	user 0.011s	sys 0.001s
I20260709 13:16:57.354673 12455 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.480688  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.494027  8910 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.355269 12523 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.481218  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.278724 12476 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.441740 12515 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.496569  8916 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:57.497593  9431 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:57.476434 12423 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.486099 12021 raft_consensus.cc:1081] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:16:57.486582 12415 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.506397  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.439416 12650 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.511009  8917 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:57.516292  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1693) took 3949 ms. Trace:
I20260709 13:16:57.516428  8912 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:57.504057 12606 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.516738  8913 rpcz_store.cc:276] 0709 13:16:53.613174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.626767 (+ 13593us) service_pool.cc:224] Handling call
0709 13:16:53.627122 (+   355us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:53.627529 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.627561 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:53.628172 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 13:16:53.956173 (+328001us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:53.956216 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.958430 (+  2214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.152157 (+3193727us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:16:57.508889 (+356732us) raft_consensus.cc:1685] finished
0709 13:16:57.508914 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.516218 (+  7304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1496,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":155782,"spinlock_wait_cycles":274846592,"thread_start_us":327426,"threads_started":1,"wal-append.queue_time_us":589433}
I20260709 13:16:57.509529 12603 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:57.513841 12404 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.001s
I20260709 13:16:57.496606 12637 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.509356 12616 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.524921 12416 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:57.503227 12623 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.496142 12152 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.536063  8838 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:16:57.539072  9468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 531) took 3694 ms (client timeout 1543 ms). Trace:
W20260709 13:16:57.539538  9468 rpcz_store.cc:269] 0709 13:16:53.838557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.838692 (+   135us) service_pool.cc:224] Handling call
0709 13:16:57.532987 (+3694295us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400620054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:57.533145 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2342690560}
W20260709 13:16:57.543926 12649 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:16:57.525090 12635 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.545950  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.549240 12634 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:57.551298  8914 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:57.553244  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.554405 12637 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.556308 12621 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.557440  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:57.562041  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:57.562893  8838 raft_consensus.cc:2368] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9.
I20260709 13:16:57.537303 12416 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:57.528054 12254 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.569336 12152 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.570214 12416 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.573235 12645 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:57.574968 12640 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:57.653257  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 152730us
I20260709 13:16:57.585829 12423 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:57.565649 12460 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 13:16:57.590613 12410 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.596946 12474 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.598074 12650 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.601445 12632 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.595460 12485 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:57.608610 12414 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:57.661013 12414 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:57.615056  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.661953 12640 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:57.662364  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47373.6us
I20260709 13:16:57.617884  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1852) took 2717 ms. Trace:
I20260709 13:16:57.663064  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.625563 12447 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.628350  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.629357 12585 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:57.629704  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.669981  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.640748  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:57.663393  8837 rpcz_store.cc:276] 0709 13:16:54.900062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.900202 (+   140us) service_pool.cc:224] Handling call
0709 13:16:54.903510 (+  3308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:55.269427 (+365917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:55.269455 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:55.289695 (+ 20240us) log.cc:844] Serialized 52 byte log entry
0709 13:16:55.367708 (+ 78013us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:55.684672 (+316964us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.694330 (+  9658us) log.cc:844] Serialized 14 byte log entry
0709 13:16:55.957283 (+262953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.019028 (+1061745us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800456a60. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:16:57.617441 (+598413us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540006bb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:57.617518 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:57.617580 (+    62us) raft_consensus.cc:1685] finished
0709 13:16:57.617598 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.617798 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1255620,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":54,"raft.queue_time_us":817958,"raft.run_cpu_time_us":392,"raft.run_wall_time_us":16603,"spinlock_wait_cycles":525833856,"thread_start_us":783504,"threads_started":5,"wal-append.queue_time_us":842567,"wal-append.run_cpu_time_us":3413,"wal-append.run_wall_time_us":1117048}
I20260709 13:16:57.578603 12515 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:16:57.656122  8882 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.553s (SENT) [suppressed 15 similar messages]
I20260709 13:16:57.664299  8735 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:57.666900  8841 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:16:57.670511  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.653483 12367 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:57.667860 12474 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.661974 12414 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.675000  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.675452 12414 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.663516 12416 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.674851 12474 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:57.652704 12467 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:16:57.681591  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.683506  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.684167  8916 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:57.689857  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.690945  8914 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:16:57.690256  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:57.691458  8914 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:57.687187  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.668246 12152 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:57.692230  8841 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.694846  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:57.695544  8916 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:57.693082  8914 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.680361 12423 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.683224 12474 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.663234 12460 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.702491  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:57.688021 12529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.857s	user 0.007s	sys 0.015s
I20260709 13:16:57.701969  8914 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:16:57.716130  8734 leader_election.cc:336] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Timed out: RequestConsensusVote RPC to 127.7.122.68:45973 timed out after 1.543s (SENT)
I20260709 13:16:57.716826  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:57.657226 12577 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.708424  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.698068 12152 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:57.729238  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.682252 12621 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:16:57.731796  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:57.692746 12367 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:16:57.749512  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:57.750176  8837 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:16:57.716167 12529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.885s	user 0.007s	sys 0.015s
I20260709 13:16:57.688340 12467 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:16:57.725692 12559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 3.490s	user 0.042s	sys 0.028s
I20260709 13:16:57.673879 12472 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.727362 12513 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.757283  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.759981  8765 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:57.761221 12577 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.763660  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1740) took 1372 ms. Trace:
I20260709 13:16:57.747603 12152 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.798537  8763 rpcz_store.cc:276] 0709 13:16:56.391393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.480409 (+1089016us) service_pool.cc:224] Handling call
0709 13:16:57.492408 (+ 11999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.492627 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:16:57.552234 (+ 59607us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.761197 (+208963us) log.cc:844] Serialized 14 byte log entry
0709 13:16:57.763267 (+  2070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.763325 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:57.763377 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.763448 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.763593 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1153,"prepare.queue_time_us":167777,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":80,"raft.queue_time_us":40316,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5563,"spinlock_wait_cycles":30080,"thread_start_us":234365,"threads_started":3,"wal-append.queue_time_us":153726}
I20260709 13:16:57.764104 12468 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.766222  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.773176  8836 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.777051 12423 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:57.793655  8762 raft_consensus.cc:2410] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:16:57.756608 12559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.524s	user 0.043s	sys 0.028s
W20260709 13:16:57.801219  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 114112us
I20260709 13:16:57.754485 12517 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:57.811646  8838 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:57.810923  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.820709  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.822147  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:57.822779  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.804114 12515 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.823526  8762 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:57.804385 12475 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.818262 12423 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:57.835088  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.836962 12423 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.827124 12513 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:57.830529 12577 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.840308 12497 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.844013  8762 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:57.830492  9459 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 538) took 1033 ms. Trace:
I20260709 13:16:57.853561  9459 rpcz_store.cc:276] 0709 13:16:56.797369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.801174 (+  3805us) service_pool.cc:224] Handling call
0709 13:16:57.766071 (+964897us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:57.827078 (+ 61007us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609408}
W20260709 13:16:57.854440 12590 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 2.464s	user 0.022s	sys 0.049s
I20260709 13:16:57.855634 12632 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.856253 12631 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:57.856419 12513 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:57.859869  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.859948 12513 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.860888  8837 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:57.856648 12631 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:57.864442 12631 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.865499 12631 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.830988 12515 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.831218 12475 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.858556  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:57.858808  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:57.870460 12467 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.870563  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.871107 12467 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.871476 12497 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.871891 12497 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:57.872220 12497 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:57.872407  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.874078  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:57.874449 12472 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:57.874943  9467 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:57.875907  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 540) took 1077 ms. Trace:
I20260709 13:16:57.856319 12577 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.877501 12460 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:57.881304  8842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1837) took 1690 ms (client timeout 2102 ms). Trace:
W20260709 13:16:57.882118  8842 rpcz_store.cc:269] 0709 13:16:56.191116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.191260 (+   144us) service_pool.cc:224] Handling call
0709 13:16:57.881100 (+1689840us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400415854. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:57.881241 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425579392}
I20260709 13:16:57.885548 12497 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.887431 12616 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:57.887692 12497 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:57.888006 12616 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:57.890591 12616 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:57.894670  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.898659  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:57.899780 12420 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:16:57.899821  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.900357 12420 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:57.900525  8763 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:57.901197  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.901475  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.901258 12420 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:57.902062  8764 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:57.902123  8763 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:57.902999  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.903244  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.903717  8764 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:57.904254  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:57.909168  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:57.909361  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:57.910200  8913 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:57.875056 12472 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:57.920243  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.913631  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.915232  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:57.927907  8914 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:57.928097  8767 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:57.934947  8913 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:16:57.918094  8841 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:57.876329  9467 rpcz_store.cc:276] 0709 13:16:56.798357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.798508 (+   151us) service_pool.cc:224] Handling call
0709 13:16:57.873861 (+1075353us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:57.875623 (+  1762us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4651264}
I20260709 13:16:57.924708  8838 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:16:57.945416  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:57.973687  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:57.992996  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 276896us
I20260709 13:16:57.935308 12515 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.001609 12367 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.001511 12497 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:57.935570 12472 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.001670 12460 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:16:58.097627  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.052273 12152 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:58.104148  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.225888  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.030262 12367 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.030355  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.049880 12497 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:16:58.052222 12474 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:58.002671 12641 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.008s	sys 0.026s
I20260709 13:16:58.023758 12585 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:16:58.217006  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1860) took 1223 ms. Trace:
I20260709 13:16:58.037843  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:58.217573  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1699) took 2909 ms. Trace:
I20260709 13:16:58.217720  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1683) took 4265 ms. Trace:
I20260709 13:16:58.222275  8837 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:16:58.234825  8769 rpcz_store.cc:276] 0709 13:16:53.952759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.583178 (+630419us) service_pool.cc:224] Handling call
0709 13:16:54.583543 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:55.348675 (+765132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.154577 (+2805902us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400377b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:58.217661 (+ 63084us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743016704}
W20260709 13:16:58.235462  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 197734us
I20260709 13:16:58.227721  9434 leader_election.cc:400] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9.
I20260709 13:16:58.237659  9434 leader_election.cc:403] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:58.003587 12577 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:58.234741  8760 rpcz_store.cc:276] 0709 13:16:55.308496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.137521 (+829025us) service_pool.cc:224] Handling call
0709 13:16:56.137899 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.195964 (+ 58065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.196009 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.196066 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:56.196111 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.190497 (+1994386us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b5400190d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:58.217388 (+ 26891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.217507 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132998016}
W20260709 13:16:58.231002 12670 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.150s	user 0.008s	sys 0.003s
W20260709 13:16:58.228212 12618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.188s	user 0.008s	sys 0.011s
I20260709 13:16:58.240921 12455 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.237489  8836 rpcz_store.cc:276] 0709 13:16:56.993516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.039874 (+ 46358us) service_pool.cc:224] Handling call
0709 13:16:58.188491 (+1148617us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54002b0554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:58.216947 (+ 28456us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615001472}
W20260709 13:16:58.233148 12641 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.009s	sys 0.026s
I20260709 13:16:58.245332  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:58.248386  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:58.249580  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 326) took 4292 ms. Trace:
I20260709 13:16:58.250818  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:58.253441  8843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1834) took 2064 ms (client timeout 1857 ms). Trace:
W20260709 13:16:58.253935  8843 rpcz_store.cc:269] 0709 13:16:56.188708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.188823 (+   115us) service_pool.cc:224] Handling call
0709 13:16:58.253249 (+2064426us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b540006b154. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:58.253368 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2007018752}
W20260709 13:16:58.260398  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 44132.4us
W20260709 13:16:58.246614 12618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.012s	sys 0.012s
I20260709 13:16:58.250701  8768 rpcz_store.cc:276] 0709 13:16:53.951200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.954312 (+  3112us) service_pool.cc:224] Handling call
0709 13:16:53.954666 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:54.522003 (+567337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.563039 (+ 41036us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:54.577976 (+ 14937us) log.cc:844] Serialized 26 byte log entry
0709 13:16:54.857378 (+279402us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:54.857430 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.148596 (+3291166us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b54001a7554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:58.239442 (+ 90846us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:58.239513 (+    71us) raft_consensus.cc:1685] finished
0709 13:16:58.239531 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:58.243369 (+  3838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304083200,"thread_start_us":198784,"threads_started":1,"wal-append.queue_time_us":521139,"wal-append.run_cpu_time_us":16222,"wal-append.run_wall_time_us":1989860}
I20260709 13:16:58.261101 12403 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.323558 12403 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.324059 12403 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.246158 12455 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.313406 12367 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.313479 12434 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.325341 12434 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.325799 12434 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.316349 12497 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.245401 12616 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.317062 12576 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.247520 12631 consensus_queue.cc:1059] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:58.334704 12631 raft_consensus.cc:3055] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.335074 12631 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:16:58.243435 12577 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.335901 12631 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.318500 12474 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.261466 12504 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.310865 12662 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.337767 12662 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.338251 12577 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:58.339802 12569 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.340166 12662 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.326267 12152 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.345417  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:58.347772  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:58.261603 12565 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.325085 12455 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.349655 12631 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.355192 12515 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.352730 12645 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.351197 12565 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:58.354238 12585 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.359193 12515 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.357637 12472 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:58.362107 12565 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.374960 12616 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9.
I20260709 13:16:58.367007 12515 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.366079 12576 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:16:58.362948 12645 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.376598 12434 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:16:58.439272  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 85426.7us
W20260709 13:16:58.443053  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 95248.3us
W20260709 13:16:58.383827 12415 consensus_meta.cc:287] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.870s	user 0.023s	sys 0.006s
I20260709 13:16:58.455245 12415 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.396778 12565 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.457499  8844 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:58.458797 12474 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:58.459515 12565 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.459898 12474 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.484834  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:58.485935  8765 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:58.490507  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.491992  9461 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:16:58.492539  9461 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 541) took 1690 ms (client timeout 2025 ms). Trace:
I20260709 13:16:58.389371 12576 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:16:58.499369 12576 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:58.501674 12576 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.504241 12576 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.391068 12645 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.474541  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:58.482339  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:58.507035  8768 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:58.493834  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:58.508637  9465 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 539) took 1710 ms (client timeout 1543 ms). Trace:
W20260709 13:16:58.509145  9465 rpcz_store.cc:269] 0709 13:16:56.798046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.798192 (+   146us) service_pool.cc:224] Handling call
0709 13:16:58.493403 (+1695211us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:58.508539 (+ 15136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4501760}
I20260709 13:16:58.495534  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.510872  9467 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:58.497037  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.477886  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.502251 12475 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.460455 12415 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.519506 12602 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.521821 12161 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:58.529124  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54926.3us
I20260709 13:16:58.532056 12451 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.530175 12645 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.530385  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1686) took 3257 ms. Trace:
I20260709 13:16:58.535795 12434 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.535493  8761 rpcz_store.cc:276] 0709 13:16:55.273146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.273306 (+   160us) service_pool.cc:224] Handling call
0709 13:16:55.290320 (+ 17014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.401877 (+1111557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.529519 (+2127642us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400378554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:58.530165 (+   646us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414532864}
W20260709 13:16:58.541644  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 317034us
I20260709 13:16:58.543305  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 398) took 3245 ms. Trace:
I20260709 13:16:58.558218  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.558298  8840 rpcz_store.cc:276] 0709 13:16:55.297223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.297663 (+   440us) service_pool.cc:224] Handling call
0709 13:16:55.298170 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:56.208242 (+910072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:58.542425 (+2334183us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b5400415354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:16:58.543004 (+   579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090806656}
I20260709 13:16:58.523738 12474 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:16:58.544811  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.560884 12406 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:58.561393  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:58.545783  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1863) took 1523 ms. Trace:
I20260709 13:16:58.561740 12406 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.562299  8839 rpcz_store.cc:276] 0709 13:16:57.022640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.023116 (+   476us) service_pool.cc:224] Handling call
0709 13:16:58.545305 (+1522189us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b54003a7854. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:58.545533 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135554944}
I20260709 13:16:58.549897  8760 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:58.551864  8769 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.554247  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:58.565409  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.566135  8766 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:58.560348  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.567605  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.568369  9468 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:58.569509 12410 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:58.569911  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.570789  9463 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:58.571346 12565 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:58.572209  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.573262  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.573462  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.574381  9462 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:16:58.574796  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.575364 12414 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.557088  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:58.576094 12414 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.578848 12414 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:58.514184  9461 rpcz_store.cc:269] 0709 13:16:56.802307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.802467 (+   160us) service_pool.cc:224] Handling call
0709 13:16:58.490012 (+1687545us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800003998. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:16:58.492426 (+  2414us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4243200}
I20260709 13:16:58.581063 12565 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:58.582953 12663 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:58.585642  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:16:58.566620  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1846) took 1697 ms (client timeout 2025 ms). Trace:
I20260709 13:16:58.586107 12663 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:16:58.583130  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 71277.9us
W20260709 13:16:58.587167  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.582108  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:58.584196 12565 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.588130 12406 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.590750  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 1866) took 1416 ms. Trace:
I20260709 13:16:58.590631 12403 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.585865 12474 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.593432 12537 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.593657  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:16:58.596803 12679 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.572341 12410 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:58.596995 12619 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:58.597714  8884 connection.cc:256] RPC call timeout handler was delayed by -1.917780515000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:16:58.637590  8884 connection.cc:256] RPC call timeout handler was delayed by -1.9024805149999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:16:58.637987  8884 connection.cc:256] RPC call timeout handler was delayed by -1.9015805149999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:16:58.638401  8884 connection.cc:256] RPC call timeout handler was delayed by -1.8772805149999385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 13:16:58.638876  8884 connection.cc:256] RPC call timeout handler was delayed by -1.8763805149999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:16:58.639407  8884 connection.cc:256] RPC call timeout handler was delayed by -1.6648805150000499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 13:16:58.639990  8884 connection.cc:256] RPC call timeout handler was delayed by -1.661280515000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18200000000000002s for a response
W20260709 13:16:58.640470  8884 connection.cc:256] RPC call timeout handler was delayed by -1.6594805150000411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18220000000000003s for a response
I20260709 13:16:58.602202 12617 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.602478  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.603932  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:58.564924  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:16:58.555889  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.550184  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.608795  8809 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:58.617703  8835 rpcz_store.cc:269] 0709 13:16:56.868704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.868887 (+   183us) service_pool.cc:224] Handling call
0709 13:16:58.566232 (+1697345us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b540006b654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:58.566447 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311257856}
W20260709 13:16:58.640837  8884 connection.cc:256] RPC call timeout handler was delayed by -1.6495805150000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 13:16:58.613411 12664 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.576s	user 0.000s	sys 0.004s
I20260709 13:16:58.629772  8844 rpcz_store.cc:276] 0709 13:16:57.174149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.545696 (+371547us) service_pool.cc:224] Handling call
0709 13:16:58.590432 (+1044736us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54003a6954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:16:58.590669 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093424000}
I20260709 13:16:58.646035  9466 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
W20260709 13:16:58.646422  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64615.2us
W20260709 13:16:58.645859  8884 connection.cc:256] RPC call timeout handler was delayed by -1.6063805149999553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 13:16:58.650137  8884 connection.cc:256] RPC call timeout handler was delayed by -1.5793805149999116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 13:16:58.651757  8884 connection.cc:256] RPC call timeout handler was delayed by -1.5595805149998796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19330000000000003s for a response
W20260709 13:16:58.653393  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 59942.9us
I20260709 13:16:58.654665  9460 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:58.657691  8884 connection.cc:256] RPC call timeout handler was delayed by -1.539780515000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 13:16:58.659219  8884 connection.cc:256] RPC call timeout handler was delayed by -1.3570805150000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
W20260709 13:16:58.660701  8884 connection.cc:256] RPC call timeout handler was delayed by -1.2787805149998803s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 13:16:58.662302  8884 connection.cc:256] RPC call timeout handler was delayed by -1.2094805149999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23220000000000002s for a response
W20260709 13:16:58.667474  8884 connection.cc:256] RPC call timeout handler was delayed by -1.0069805149998956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25470000000000004s for a response
I20260709 13:16:58.668500  9461 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:16:58.677265  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 68707.9us
I20260709 13:16:58.670774  8764 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.655156 12406 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.689299  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.668574 12451 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:58.702015 12386 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.702621 12386 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:58.702224 12451 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.703099 12386 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.703190 12485 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:16:58.704121 12485 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.704952 12466 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.702033  9459 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:58.705672 12466 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.705116 12451 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.706758 12485 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.707177 12474 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.709000 12665 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:16:58.709429 12665 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.709795 12665 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:58.713267 12663 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.716629  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.718405 12565 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:58.720525  8841 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:16:58.725663 12403 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.727026 12455 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.729326  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.731612  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.733162  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.691327 12406 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.736119 12406 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:58.739197  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:58.740852  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.741954  8839 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:16:58.743111  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.746024  8913 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:58.747522  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.748342  8914 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:58.749145 12414 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.749611 12414 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.749982  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.750654  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:16:58.720749  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 48954.9us
W20260709 13:16:58.753113  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 67981.7us
I20260709 13:16:58.754082  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:58.755290  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:58.758428 12438 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.758848 12485 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.688028 12679 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.762504 12679 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.768437  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:58.771643  8909 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:58.708616 12466 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.720304 12515 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.769263  9459 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:58.776384  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.749984 12414 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.778766  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.781569  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.782356  8911 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:16:58.758906 12438 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:58.789492  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.799721 12416 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:58.793802  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.800416 12416 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:58.801162  8918 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:16:58.801280  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.801605  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.802798 12416 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.802829  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.803787  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:58.805460  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.806876  8916 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:58.807406  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:58.809453  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.810040  8916 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.810374  8911 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:58.811192  8883 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:16:58.813144 12680 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.815438  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:58.818109  8764 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:58.819662  9460 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:58.818166  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:58.802938  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:58.828039  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.792645  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:58.839392  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.789466 12438 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:16:58.848474  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73215.8us
I20260709 13:16:58.849428  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:58.853443 12474 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:58.791714 12406 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:58.855072 12406 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:58.829187 12455 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:58.849516  8912 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.867066  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.867983  8844 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:16:58.860424  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:58.875202  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:58.875428  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.883373  8909 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.881827  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.889101  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.886101  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.886509  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.896278  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.895569  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.856469 12406 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:58.883226 12645 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:16:58.902503  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.936323  8838 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
W20260709 13:16:58.944308  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.947540  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:58.945230  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.981083  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:58.982198  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:58.890187 12161 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:16:58.927175 12645 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:58.977141 12680 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:58.935496 12559 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:16:59.032579  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:58.915583 12416 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:58.890520 12455 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:59.057755  8662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 95) took 22865 ms (client timeout 15000 ms). Trace:
I20260709 13:16:59.062686  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.044504  8844 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.060351  8914 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 5.
I20260709 13:16:59.068670  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.070109  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.070988  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:59.072264  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.073575  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.074378  8839 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:16:59.075503  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:59.076297  8839 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.077167  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.077700  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.078415  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.079182  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.079519  8840 raft_consensus.cc:2410] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:16:59.079658  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.079955  8911 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:59.080632  8918 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:59.081099 12416 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:16:59.081542 12565 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.082125 12565 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:59.082698 12416 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.085602  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.087949  8909 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:16:59.089524  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.090456 12434 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.090926 12434 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:59.094326  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.086000  8916 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:16:59.041815  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:59.092145 12434 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.104349  8844 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:16:59.041221 12645 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:16:59.111464  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.110196  8841 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:59.112545  8840 raft_consensus.cc:2410] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:16:59.060012 12455 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.118292  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:59.084097 12565 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.111424 12161 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:59.142023 12161 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:59.142624 12665 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.143078 12161 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.145826  8911 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:59.130556  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.183441  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
W20260709 13:16:59.184458  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.181952  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 256560us
I20260709 13:16:59.128088 12455 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.196410  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:59.198158  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.171950 12537 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.338289  8732 connection.cc:256] RPC call timeout handler was delayed by -1.84703218799973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:16:59.527520  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.529548  8844 raft_consensus.cc:2410] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:59.444088  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.231950  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.531256  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:59.532164 12680 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:59.532769 12680 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:16:59.527856  8732 connection.cc:256] RPC call timeout handler was delayed by -1.7894321879998643s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
I20260709 13:16:59.533924 12680 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.236284  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:16:59.441955  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.537418  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.255566  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.286238  8914 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:59.543219  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.549327  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.550118  8764 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:59.550163  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:59.515509 12497 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.015s	sys 0.107s
I20260709 13:16:59.551470  8912 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:16:59.551725 12497 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.016s	sys 0.108s
I20260709 13:16:59.553843  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:59.409490  8837 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:16:59.558507  8838 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:16:59.559269  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.557123  8768 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:59.231640  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:59.199820 12665 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:59.567621  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.525276 12466 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:59.231583 12403 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:59.553859 12565 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.585948  8839 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:16:59.567605  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.561918 12663 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:16:59.573549  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:59.574332  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.575182  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:59.575712  8761 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.576287  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.578471  8844 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:59.588505  8916 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.367820 12474 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.559733 12386 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.856s	user 0.006s	sys 0.013s
I20260709 13:16:59.529876 12434 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.255888 12515 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:59.190615 12414 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.557843 12161 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.590831  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.606985  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.588461 12403 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.583202 12451 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:16:59.607339 12663 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.642035 12451 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.565864 12645 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.608112  8918 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:16:59.608618  8766 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.613070  8769 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:16:59.604944  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:16:59.626951 12684 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:16:59.628405  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.235983 12438 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.342943 12537 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.629900  8838 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:16:59.635936  8844 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:16:59.636924  8735 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.014s	sys 0.018s
I20260709 13:16:59.648357  8761 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:16:59.653874  8735 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.014s	sys 0.018s
W20260709 13:16:59.654220  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 559167us
I20260709 13:16:59.650076  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:59.663064  8836 raft_consensus.cc:2368] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11.
I20260709 13:16:59.665791 12645 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:16:59.666167 12663 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:59.666698  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.667413  8842 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:16:59.668964  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.670197  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.670841  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.671252  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:16:59.671648  8838 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:16:59.672317  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.641502 12403 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.672782  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:59.669098  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.676662  8838 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.676996  8918 raft_consensus.cc:2410] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:16:59.678161  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.678437 12537 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:16:59.678763  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 176847us
I20260709 13:16:59.679072 12537 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:59.661692  8807 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.594s (SENT)
I20260709 13:16:59.680284  8807 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:16:59.682615  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.683435  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:16:59.673579  8915 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:59.690542  8835 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:59.605542 12474 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.623000 12386 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.665827 12438 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:59.706954 12474 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:59.709209  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.694062 12416 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:16:59.702888 12689 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:16:59.719126  8732 connection.cc:256] RPC call timeout handler was delayed by -1.7318321879997711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 13:16:59.721587  8732 connection.cc:256] RPC call timeout handler was delayed by -1.651732187999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:16:59.721985  8912 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:16:59.724552  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:16:59.725216  8844 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.728222  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:16:59.730983  8838 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:16:59.685102 12466 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.739974  8768 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:59.740341  9459 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:16:59.723093  8732 connection.cc:256] RPC call timeout handler was delayed by -1.6265321879998282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1857s for a response
I20260709 13:16:59.743625  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:16:59.742919  8732 connection.cc:256] RPC call timeout handler was delayed by -1.6139321879998079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
W20260709 13:16:59.748415  8732 connection.cc:256] RPC call timeout handler was delayed by -1.5923321879997729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 13:16:59.748996  8732 connection.cc:256] RPC call timeout handler was delayed by -1.277514771999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2102s for a response
I20260709 13:16:59.751900  8761 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:59.758708 12466 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:59.759670  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:16:59.761073 12504 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:59.761778 12504 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:16:59.762934 12504 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.771799  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:16:59.786535  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.812927  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:59.813661  8769 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:16:59.815933  8761 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:16:59.817672  8912 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.820904  8766 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:16:59.829294  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:16:59.830440  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.832451  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.833598  8768 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:16:59.834808  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.835572  8765 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 5. (term mismatch)
I20260709 13:16:59.836076  8765 pending_rounds.cc:85] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 4
I20260709 13:16:59.836297  8765 pending_rounds.cc:107] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 13:16:59.836615  8765 raft_consensus.cc:2889] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:59.837121  8764 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.837242  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.837463 12474 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.838100 12474 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.838689 12449 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:59.839636  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:16:59.844686  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 278740us
W20260709 13:16:59.802628 12692 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:59.867926  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:16:59.868717  9459 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:16:59.876281  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:16:59.876891  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.817399 12466 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:59.878767  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 333479us
I20260709 13:16:59.882961  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:16:59.888876  8764 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:59.886456  8844 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:16:59.885300 12451 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:16:59.885480 12700 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.905602 12449 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.928660  8766 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:16:59.931342  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:16:59.885691 12474 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:59.940258  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:16:59.942019  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:59.943151 12386 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:16:59.943387  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.947487  8844 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:16:59.948966  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:16:59.949776  8764 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:16:59.950788  8911 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:16:59.952101 12447 raft_consensus.cc:2764] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:16:59.954284  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:16:59.939795 12704 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:59.924690 12449 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:16:59.949888 12665 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:16:59.950141 12700 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:16:59.945030 12559 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:16:59.983819  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.952948 12438 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:59.978181 12161 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:16:59.063225  8662 rpcz_store.cc:269] 0709 13:16:36.191842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:36.192116 (+   274us) service_pool.cc:224] Handling call
0709 13:16:59.057370 (+22865254us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:53.890597 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:54.009470 (+118873us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:54.009521 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:16:54.009538 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:54.010769 (+  1231us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:54.010873 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:54.010901 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:16:54.012119 (+  1218us) tablet.cc:701] Row locks acquired
0709 13:16:54.012226 (+   107us) write_op.cc:260] PREPARE: finished
0709 13:16:54.012390 (+   164us) write_op.cc:270] Start()
0709 13:16:54.012569 (+   179us) write_op.cc:276] Timestamp: P: 1783603014012324 usec, L: 0
0709 13:16:54.012589 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:16:54.013334 (+   745us) log.cc:844] Serialized 5155 byte log entry
0709 13:16:55.220221 (+1206887us) op_driver.cc:464] REPLICATION: finished
0709 13:16:55.805659 (+585438us) write_op.cc:301] APPLY: starting
0709 13:16:55.816113 (+ 10454us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:55.949360 (+133247us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:56.012096 (+ 62736us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:56.153771 (+141675us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:56.154037 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:16:56.154085 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:56.154384 (+   299us) log.cc:844] Serialized 94 byte log entry
0709 13:16:56.154563 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:56.154711 (+   148us) write_op.cc:454] Released schema lock
0709 13:16:56.154760 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:56.155162 (+   402us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:56.155191 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2478553,"reported_tablets":20,"spinlock_wait_cycles":1935616,"child_traces":[["op",{"apply.queue_time_us":499367,"apply.run_cpu_time_us":5288,"apply.run_wall_time_us":374040,"num_ops":13,"prepare.queue_time_us":360394,"prepare.run_cpu_time_us":15357,"prepare.run_wall_time_us":300855,"raft.queue_time_us":218404,"raft.run_cpu_time_us":13749,"raft.run_wall_time_us":63566,"replication_time_us":1207407,"thread_start_us":741285,"threads_started":4,"wal-append.queue_time_us":577529,"wal-append.run_cpu_time_us":54016,"wal-append.run_wall_time_us":2554251}]]}
I20260709 13:16:59.991577  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1721) took 1177 ms. Trace:
W20260709 13:16:59.993101  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 146810us
I20260709 13:16:59.993286 12416 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:59.911067 12466 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:00.012586  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.014101  8764 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.946641 12415 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:17:00.000898 12161 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.999564 12559 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:16:59.977633 12704 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:00.067281  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 241803us
I20260709 13:17:00.000046  8844 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:00.068845  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:16:59.959394  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.035035  8916 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:16:59.934926 12451 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:17:00.062389  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.002519  8913 rpcz_store.cc:276] 0709 13:16:58.800417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.803606 (+  3189us) service_pool.cc:224] Handling call
0709 13:16:58.804030 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:58.804658 (+   628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:58.804694 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:58.805409 (+   715us) log.cc:844] Serialized 52 byte log entry
0709 13:16:59.232118 (+426709us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:59.232181 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.232277 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:59.977801 (+745524us) raft_consensus.cc:1685] finished
0709 13:16:59.977822 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:59.977984 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":896,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":132,"thread_start_us":421109,"threads_started":1,"wal-append.queue_time_us":893194}
W20260709 13:17:00.026769 12690 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 13:17:00.079588  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.024767 12466 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:00.081015 12698 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:00.081353  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.082360  8913 raft_consensus.cc:2368] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:17:00.083403  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.008742 12449 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:00.026621 12700 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:00.066254  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.084801  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.087182  8910 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:00.085443  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:00.072448  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55373us
I20260709 13:17:00.106248  8765 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.086658  8766 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:16:59.998838 12447 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:17:00.087392  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.107736  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:00.001168 12438 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:00.109935 12438 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.110312  8762 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 6: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.110543  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.110921 12466 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:00.071051  8769 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:00.111725  8914 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:00.114355  8764 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:00.070824  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.118027  8912 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:17:00.118340  8916 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:00.112596  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 153327us
I20260709 13:17:00.052565 12161 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.107788  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.139103  8762 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:00.068212 12559 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.152676  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1882) took 1294 ms. Trace:
I20260709 13:17:00.075990 12645 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.073177 12403 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.119846 12466 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:00.157950  8840 rpcz_store.cc:276] 0709 13:16:58.858122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.119967 (+261845us) service_pool.cc:224] Handling call
0709 13:16:59.565467 (+445500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.606516 (+ 41049us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:59.971815 (+365299us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.146758 (+174943us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.146928 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.146980 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.147042 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.147124 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.152568 (+  5444us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":353724,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":90,"thread_start_us":443163,"threads_started":2}
W20260709 13:17:00.170564  8841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.013s
I20260709 13:17:00.142047 12434 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:00.171710  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.155735 12703 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:17:00.147511 12415 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.186594  8844 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:00.187216  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.191814  8764 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:00.192832  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46863.6us
W20260709 13:17:00.146097  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 195824us
I20260709 13:17:00.184434  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:00.182541  8841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.003s	sys 0.013s
I20260709 13:17:00.196189  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.197086  8765 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.146452 12576 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:17:00.215864  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.193783  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.197892  8909 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:00.198655  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 308723us
I20260709 13:17:00.201350  8762 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.208420  8764 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:00.223487  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.224287  8914 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:00.231112  8769 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.191221 12415 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:00.239600  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 294979us
W20260709 13:17:00.238912  8835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.014s	sys 0.014s
W20260709 13:17:00.240656  8835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.015s	sys 0.014s
W20260709 13:17:00.241770  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 393899us
I20260709 13:17:00.246706  8844 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:00.253474  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.254563  8769 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.256628  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:00.262465  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.097630 12704 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:00.196411 12645 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.219090 12665 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:00.285073  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.278545  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.288394  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.288757  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:00.288486  8769 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:00.289831  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:00.288008  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 94340.3us
W20260709 13:17:00.287040  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 87372.9us
I20260709 13:17:00.290457  8916 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:00.277917 12451 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:00.282374 12455 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.003s
I20260709 13:17:00.299443  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.300458  8769 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:00.305527  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.306128  8914 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:00.307837  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.328683 12703 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.334353  8769 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:00.336071  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52391.2us
W20260709 13:17:00.343938  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.300086 12451 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:00.274529 12720 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:17:00.345175  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.303103 12504 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:00.389004  8769 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.303205 12455 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:00.397961 12717 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:17:00.450363  8914 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:00.304340 12466 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.451534 12455 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:00.451891  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.452564  8914 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:00.453518  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.381362 12451 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.454072  8914 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:17:00.398665 12714 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.399454  8762 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: [5.6-5.6]
W20260709 13:17:00.400050 12709 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:00.402114 12406 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:00.402657 12161 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.410216  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.414940 12706 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:00.418394 12645 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:00.420758 12438 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.427974  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1746) took 1121 ms. Trace:
I20260709 13:17:00.412603 12723 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:00.429133  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:00.430022  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1745) took 1202 ms. Trace:
I20260709 13:17:00.431604  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.432345  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:00.433310  8764 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.433439 12414 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:00.302822 12415 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:00.436003  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.437824  8761 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:17:00.439038  8760 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:00.439589  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.441040  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:00.445292  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:17:00.441116  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1742) took 1360 ms. Trace:
W20260709 13:17:00.477586  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 169118us
W20260709 13:17:00.470852  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 166893us
W20260709 13:17:00.488770  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.494987 12406 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:00.545339 12406 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.335759 12703 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:00.505156  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 156531us
I20260709 13:17:00.495627  8769 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:00.549190  8915 rpcz_store.cc:276] 0709 13:16:59.080289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.089057 (+  8768us) service_pool.cc:224] Handling call
0709 13:17:00.440935 (+1351878us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54001d2c54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:00.441055 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341490944}
I20260709 13:17:00.548906  8767 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.551975  8767 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.552358  8765 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:17:00.551331  8911 rpcz_store.cc:276] 0709 13:16:59.228100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.228257 (+   157us) service_pool.cc:224] Handling call
0709 13:17:00.429834 (+1201577us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400319f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:00.429937 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954051328}
I20260709 13:17:00.550644  8909 rpcz_store.cc:276] 0709 13:16:59.333123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.338226 (+  5103us) service_pool.cc:224] Handling call
0709 13:16:59.338680 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.221841 (+883161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.427681 (+205840us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54000fbc54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:00.427904 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1975570304}
I20260709 13:17:00.549688  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1891) took 1460 ms. Trace:
I20260709 13:17:00.547497  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.652696  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.580457  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.797755  8837 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.586687  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.696316  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:00.644698  8769 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:00.587739  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.819190  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:00.570197  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:00.583827  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.769328  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 337125us
I20260709 13:17:00.698417  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:00.696666  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.848780  9459 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:00.785137  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1751) took 1210 ms. Trace:
I20260709 13:17:00.548332  8761 pending_rounds.cc:85] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 7
I20260709 13:17:00.633515  8915 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.586938  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.583269  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.731376  8836 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:00.804996  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 409178us
I20260709 13:17:00.695168  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:00.847971  8765 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.860342  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:00.861370  8761 pending_rounds.cc:107] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:00.861495  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 418) took 1682 ms. Trace:
W20260709 13:17:00.555339  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 301665us
I20260709 13:17:00.555346  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.863008  8840 raft_consensus.cc:2368] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11.
I20260709 13:17:00.863524  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 417) took 1769 ms. Trace:
I20260709 13:17:00.864058  8763 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:00.861760  8761 raft_consensus.cc:2889] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.864470  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1751) took 1032 ms. Trace:
I20260709 13:17:00.849107  8914 raft_consensus.cc:2376] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:17:00.866392  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1756) took 1290 ms. Trace:
W20260709 13:17:00.867197  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 280361us
W20260709 13:17:00.867954  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.876348  8912 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:17:00.589731 12619 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:00.863843  8836 rpcz_store.cc:276] 0709 13:16:59.100221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.581028 (+1480807us) service_pool.cc:224] Handling call
0709 13:17:00.654720 (+ 73692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.863335 (+208615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.863481 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.864933  8763 rpcz_store.cc:276] 0709 13:16:59.832237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.586193 (+753956us) service_pool.cc:224] Handling call
0709 13:17:00.864408 (+278215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:00.815508 12696 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.061s	user 0.003s	sys 0.010s
I20260709 13:17:00.861891  8837 rpcz_store.cc:276] 0709 13:16:59.178664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.797134 (+1618470us) service_pool.cc:224] Handling call
0709 13:17:00.797519 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.861203 (+ 63684us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.861419 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.866894  8914 rpcz_store.cc:276] 0709 13:16:59.576195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.473441 (+897246us) service_pool.cc:224] Handling call
0709 13:17:00.866285 (+392844us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:00.589845 12710 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:17:00.850553  8835 rpcz_store.cc:276] 0709 13:16:59.089878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.729862 (+639984us) service_pool.cc:224] Handling call
0709 13:16:59.730180 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.730434 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:00.241187 (+510753us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.549395 (+308208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.549440 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.549481 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.549540 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.549632 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13445,"prepare.queue_time_us":258413,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":67561,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19460,"thread_start_us":757073,"threads_started":3,"wal-append.queue_time_us":320572}
I20260709 13:17:00.725960  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.877596  8762 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
W20260709 13:17:00.796700 12565 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.205s	user 0.000s	sys 0.011s
I20260709 13:17:00.495868 12504 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:00.494524 12434 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:00.860101  8910 rpcz_store.cc:276] 0709 13:16:59.574400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.577387 (+  2987us) service_pool.cc:224] Handling call
0709 13:17:00.784928 (+1207541us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b540026c354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:00.785062 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051236736}
I20260709 13:17:00.874235  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:00.888985  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.889351  8769 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:00.889484  8918 raft_consensus.cc:2410] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:00.873382  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1752) took 1040 ms. Trace:
I20260709 13:17:00.875070  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1753) took 1042 ms. Trace:
W20260709 13:17:00.861569 12559 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.002s
I20260709 13:17:00.839180 12415 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.591676 12720 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.875249  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.877041  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:00.903565  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:00.877041  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1765) took 1115 ms. Trace:
I20260709 13:17:00.814515 12438 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:00.868949  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1760) took 1195 ms. Trace:
I20260709 13:17:00.877405  8760 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:17:00.736156 12161 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:00.788419  8664 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:00.873004 12680 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:00.919123 12680 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:00.919695  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1892) took 1829 ms. Trace:
I20260709 13:17:00.920192 12680 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.928707  8909 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.872215  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:00.878541  8766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.001s	sys 0.025s
W20260709 13:17:00.935494  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.945348  8766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.001s	sys 0.026s
I20260709 13:17:00.593034 12414 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.285s
I20260709 13:17:00.630563 12645 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.246s
I20260709 13:17:00.914450  8769 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:00.941780  8911 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:00.942040  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:00.890671  8768 rpcz_store.cc:276] 0709 13:16:59.832558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.696398 (+863840us) service_pool.cc:224] Handling call
0709 13:17:00.873320 (+176922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.946959  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:00.938267  9460 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:00.935624  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.948580  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.890019  8761 rpcz_store.cc:276] 0709 13:16:59.832831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.437055 (+604224us) service_pool.cc:224] Handling call
0709 13:17:00.437369 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.874820 (+437451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.875014 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.894117  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1883) took 2035 ms. Trace:
I20260709 13:17:00.949533  8915 rpcz_store.cc:276] 0709 13:16:59.673313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.571236 (+897923us) service_pool.cc:224] Handling call
0709 13:17:00.608124 (+ 36888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.868604 (+260480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.868850 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:00.895602  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:00.523109 12714 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:00.904376  8912 rpcz_store.cc:276] 0709 13:16:59.761259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.586312 (+825053us) service_pool.cc:224] Handling call
0709 13:17:00.876982 (+290670us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:00.901266  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 270818us
I20260709 13:17:00.907877  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1741) took 1827 ms. Trace:
I20260709 13:17:00.949350  8763 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.951733  8917 rpcz_store.cc:276] 0709 13:16:59.079887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.080077 (+   190us) service_pool.cc:224] Handling call
0709 13:16:59.080502 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.127560 (+ 47058us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.127601 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.145073 (+ 17472us) log.cc:844] Serialized 26 byte log entry
0709 13:16:59.529551 (+384478us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:59.529590 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:59.529662 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.815025 (+1285363us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b24001f5038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccec09d 00007fce6f91e10e 00007fce6f93588c 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221
0709 13:17:00.900160 (+ 85135us) raft_consensus.cc:1685] finished
0709 13:17:00.900181 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.907703 (+  7522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47522,"raft.queue_time_us":33192,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":26651,"spinlock_wait_cycles":44527360,"thread_start_us":326165,"threads_started":1,"wal-append.queue_time_us":593345}
I20260709 13:17:00.924608  8664 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 7, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:00.953851  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.954273  8917 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:17:00.954638  8917 pending_rounds.cc:85] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 5
I20260709 13:17:00.954953  8917 pending_rounds.cc:107] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:17:00.955201  8917 raft_consensus.cc:2889] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:00.954698  8664 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 7, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 7 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:00.957824 12714 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:00.892163  8910 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:00.914403 12451 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.897063 12559 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:00.917057 12699 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.946686  8839 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:00.955871  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1931) took 1068 ms. Trace:
I20260709 13:17:00.956251  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1771) took 1183 ms. Trace:
W20260709 13:17:00.922793  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 329082us
I20260709 13:17:00.957260  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:00.957412  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:00.959126  8912 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:00.908090  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:00.959422  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1767) took 1197 ms. Trace:
I20260709 13:17:00.931020 12704 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.949815  8841 rpcz_store.cc:276] 0709 13:16:58.858455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.220724 (+362269us) service_pool.cc:224] Handling call
0709 13:16:59.293493 (+ 72769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:59.335319 (+ 41826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:59.335366 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:59.589486 (+254120us) log.cc:844] Serialized 26 byte log entry
0709 13:17:00.195609 (+606123us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:00.195646 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.195717 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:00.444119 (+248402us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:00.893544 (+449425us) raft_consensus.cc:1685] finished
0709 13:17:00.893565 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.894042 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10737,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":27076,"spinlock_wait_cycles":12103424,"thread_start_us":544628,"threads_started":1,"wal-append.queue_time_us":625079}
I20260709 13:17:00.960196  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1927) took 1064 ms. Trace:
I20260709 13:17:00.883155 12703 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:00.939443 12721 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.960741 12406 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.923384 12726 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:00.923069  8767 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:00.960095  8664 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 3 to 6, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:00.963025  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1754) took 1387 ms. Trace:
I20260709 13:17:00.920113  8838 rpcz_store.cc:276] 0709 13:16:59.090543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.777027 (+686484us) service_pool.cc:224] Handling call
0709 13:16:59.777915 (+   888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:59.802077 (+ 24162us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:00.227601 (+425524us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.629355 (+401754us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.919185 (+289830us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18002f2a80. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:17:00.919345 (+   160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:00.919393 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:00.919438 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.919501 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:00.919632 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22517,"prepare.queue_time_us":187828,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":349770,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"spinlock_wait_cycles":31951744,"thread_start_us":664046,"threads_started":3,"wal-append.queue_time_us":569681}
I20260709 13:17:00.963973  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:00.965152  9459 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:00.970109  8915 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:01.030807  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:01.040779 12721 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.042280  9464 raft_consensus.cc:2410] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:17:01.043320 12735 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:01.043952 12721 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:01.044029 12735 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:01.044740 12414 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.045235 12414 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:01.046085  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 150597us
I20260709 13:17:01.046264 12434 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.047130 12619 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:01.047335 12414 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:01.033061 12726 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.048728 12726 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:01.049129  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 90501.8us
I20260709 13:17:01.049402 12645 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:01.049821 12645 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.049964  8767 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:01.049919  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 104532us
I20260709 13:17:01.050760 12645 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.052356  8767 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:01.031484  8918 rpcz_store.cc:276] 0709 13:16:59.575527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.677860 (+102333us) service_pool.cc:224] Handling call
0709 13:17:00.962740 (+1284880us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54003adc54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:00.962948 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2783844224}
I20260709 13:17:01.052958 12576 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:01.053460 12576 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.054668 12403 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:01.054986  8664 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:01.059746  9466 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:00.899025 12720 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:01.055784 12515 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:01.057228 12504 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.033226  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:01.055711 12576 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:01.061173  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1923) took 1180 ms. Trace:
I20260709 13:17:01.070864  8915 rpcz_store.cc:276] 0709 13:16:59.881019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.950919 (+1069900us) service_pool.cc:224] Handling call
0709 13:17:00.969803 (+ 18884us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.060837 (+ 91034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.061119 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.061918  8765 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:01.061870  8911 rpcz_store.cc:276] 0709 13:16:59.763466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.941251 (+1177785us) service_pool.cc:224] Handling call
0709 13:17:00.941604 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.946842 (+  5238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.947062 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:01.038959  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 178694us
I20260709 13:17:01.062623  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1929) took 1179 ms. Trace:
I20260709 13:17:01.072791  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:00.988205  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.072863  8912 rpcz_store.cc:276] 0709 13:16:59.883329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.951555 (+1068226us) service_pool.cc:224] Handling call
0709 13:17:00.958793 (+  7238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:01.061971 (+103178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.062542 (+   571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.061174  8760 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.969555  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1766) took 1207 ms. Trace:
W20260709 13:17:01.009728  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 60990.6us
I20260709 13:17:01.074847  8910 rpcz_store.cc:276] 0709 13:16:59.761695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.891082 (+1129387us) service_pool.cc:224] Handling call
0709 13:17:00.891334 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.969187 (+ 77853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.969496 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.062662  8917 rpcz_store.cc:276] 0709 13:16:59.887266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.953556 (+1066290us) service_pool.cc:224] Handling call
0709 13:17:00.953901 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.955613 (+  1712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.955786 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.061262  8909 rpcz_store.cc:276] 0709 13:16:59.762060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.928179 (+1166119us) service_pool.cc:224] Handling call
0709 13:17:00.928515 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.959155 (+ 30640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:00.959345 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:01.062850  9460 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:01.032680  8768 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:01.063819  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:01.031930  8913 rpcz_store.cc:276] 0709 13:16:59.882887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.100746 (+217859us) service_pool.cc:224] Handling call
0709 13:17:00.941941 (+841195us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b58001d1f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d600a0 00007fce74d5f984 00007fce6e2da6d4 00007fce6e2da662
0709 13:17:00.947190 (+  5249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33653760}
I20260709 13:17:01.081779  8809 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:01.088394  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.935331 12455 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:01.141371  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:01.150745  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 193549us
I20260709 13:17:01.065944 12720 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.140051  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:01.150921  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:01.144383  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60782.7us
W20260709 13:17:01.147804  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 95810.5us
W20260709 13:17:01.152889  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 80129.5us
I20260709 13:17:01.153714  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:01.054848 12703 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:01.152218  8664 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 4 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 7 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:01.174855  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:01.084581 12721 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:01.130944 12447 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.009649 12723 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:01.175566  8808 connection.cc:256] RPC call timeout handler was delayed by -1.4409245900001224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:17:01.192253  8808 connection.cc:256] RPC call timeout handler was delayed by -1.4005001689999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
I20260709 13:17:01.172001  8911 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:01.194074 12497 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:01.196144  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:01.194383  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:01.070175 12515 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.083679 12699 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.066090 12665 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.129s
I20260709 13:17:01.195093 12727 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:01.195722 12723 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.150019 12455 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.199586  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:01.173671 12414 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:01.186056 12619 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:01.178627 12697 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:01.214473  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.211428 12403 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:01.255790  8844 raft_consensus.cc:2410] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:01.212824  8664 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:01.258991 12723 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.261735 12451 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:01.179502 12466 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:17:01.262739  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66690.8us
I20260709 13:17:01.263497  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:01.272519 12559 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:01.257293 12697 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.274008 12697 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.252184 12721 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.279657 12726 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.283174 12721 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:01.288268  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.292203  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:01.293074  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 123751us
I20260709 13:17:01.293660  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:01.293869  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:01.299110  8760 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:17:01.204661 12699 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.202783 12447 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:01.335536  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.255105 12504 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:01.350242  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 163463us
I20260709 13:17:01.356155  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1764) took 1610 ms. Trace:
W20260709 13:17:01.370959  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 64299.4us
I20260709 13:17:01.310578 12619 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:01.329736 12714 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:01.357086  8843 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:01.374607  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 111196us
I20260709 13:17:01.329478 12737 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.350436 12403 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.371439  8914 rpcz_store.cc:276] 0709 13:16:59.745511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.880442 (+1134931us) service_pool.cc:224] Handling call
0709 13:17:00.880827 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.897584 (+ 16757us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:01.016615 (+119031us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.355825 (+339210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.355876 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:01.355926 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.355988 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.356097 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40466,"prepare.queue_time_us":111220,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":55595,"thread_start_us":263829,"threads_started":2}
I20260709 13:17:01.354085 12559 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.354247 12504 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:01.389075  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 318169us
I20260709 13:17:01.370671 12406 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:01.388221  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 179870us
I20260709 13:17:01.388964  8664 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:01.349922  8807 connection.cc:256] RPC call timeout handler was delayed by -1.0061260120000952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 13:17:01.406759 12449 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.407377 12449 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.409363 12753 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:17:01.409479  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.405247  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:01.415076  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:01.415854  8838 raft_consensus.cc:2376] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11. Re-sending same reply.
W20260709 13:17:01.425778  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.330118 12455 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.388722 12559 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.391904 12504 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.498557  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:01.439517  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.456179 12406 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.462121  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.502990  8841 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:01.463169  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.469177 12752 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.470739 12447 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.389976 12750 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.473173 12449 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:01.473914 12619 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:01.475366  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 63090.4us
I20260709 13:17:01.476034  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.469516 12403 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.483253  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 351) took 1051 ms. Trace:
W20260709 13:17:01.478237  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 107198us
I20260709 13:17:01.438220  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:01.489354  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:01.492414  8807 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.785s (SENT)
I20260709 13:17:01.497586  8664 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 4 to 5, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 5 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:01.500591  8840 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:17:01.440611  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.505932  8835 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:01.503804  8839 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:01.497733 12559 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.513478  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:01.516415  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78265.9us
I20260709 13:17:01.477804  8838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:01.528962  8838 raft_consensus.cc:606] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:01.516885  8842 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:17:01.529703  8838 raft_consensus.cc:614] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:01.522410  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.517400  8762 rpcz_store.cc:276] 0709 13:17:00.431601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.882650 (+451049us) service_pool.cc:224] Handling call
0709 13:17:00.897691 (+ 15041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.904056 (+  6365us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:01.058496 (+154440us) log.cc:844] Serialized 14 byte log entry
0709 13:17:01.482869 (+424373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:01.482931 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:01.482980 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.483057 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.483182 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2012,"prepare.queue_time_us":115719,"prepare.run_cpu_time_us":779,"prepare.run_wall_time_us":54102,"raft.queue_time_us":57266,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":3436,"thread_start_us":421805,"threads_started":2,"wal-append.queue_time_us":350926}
I20260709 13:17:01.536578  8836 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:01.523171 12752 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:01.537055  8836 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:01.537569 12749 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:17:01.538022  8836 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.539086  8836 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.509835 12750 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:01.541684  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 348592us
I20260709 13:17:01.535065  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:01.555305  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1761) took 1849 ms. Trace:
I20260709 13:17:01.555904  8916 rpcz_store.cc:276] 0709 13:16:59.700640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.795030 (+1094390us) service_pool.cc:224] Handling call
0709 13:17:00.795498 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:00.796052 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:00.796095 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:00.796685 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.199594 (+402909us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:01.199634 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.199702 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:01.549955 (+350253us) raft_consensus.cc:1685] finished
0709 13:17:01.549982 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:01.550157 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1429,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":376768,"threads_started":1,"wal-append.queue_time_us":572127}
I20260709 13:17:01.555322 12753 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:01.557835  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:01.559122 12753 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.566056  8838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:01.566831  8838 raft_consensus.cc:606] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:01.567245  8838 raft_consensus.cc:614] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:17:01.567420  8808 connection.cc:256] RPC call timeout handler was delayed by -1.3042001690000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
I20260709 13:17:01.569099 12455 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:01.573678 12755 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:17:01.567822  8808 connection.cc:256] RPC call timeout handler was delayed by -1.2034001689999059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:17:01.516366 12449 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:01.581532 12449 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.595850 12406 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:01.547449 12752 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.602479 12752 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.603899  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:01.605748  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:01.612149 12704 consensus_meta.cc:287] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.537s	user 0.007s	sys 0.000s
I20260709 13:17:01.581880  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.542834  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:01.619387  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58724.6us
I20260709 13:17:01.622066  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:01.624317  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 328879us
W20260709 13:17:01.624989  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71282.2us
W20260709 13:17:01.628552  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.524098 12726 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:01.634135  8766 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
I20260709 13:17:01.584532 12449 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:01.628449  8664 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 7, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 7 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:01.639739  8838 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:01.617131 12714 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:01.647579 12714 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.612816 12704 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.675083  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:01.675992  8916 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.677389  8884 leader_election.cc:400] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11.
I20260709 13:17:01.629565 12751 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:17:01.654012  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 161649us
I20260709 13:17:01.551774 12750 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.665907  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "405e426995614183bb2a212fc38e04b0"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:01.706156  8914 raft_consensus.cc:606] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:01.706562  8914 raft_consensus.cc:614] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:01.652565  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:01.552083 12722 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:01.671176  8664 catalog_manager.cc:5697] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 6, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:01.643546  9461 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:01.623612 12680 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.678103  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51462.2us
W20260709 13:17:01.709478  8807 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.912s (SENT)
I20260709 13:17:01.714169  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.714988  8838 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:01.644172 12406 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:01.716391  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.717060  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 186648us
I20260709 13:17:01.717347  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:01.718345  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.656380 12504 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.720660  8664 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 3, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:01.725534  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.726575  8838 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:01.727500  8836 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:01.728541  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:01.658493 12697 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.730394  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.732378  8836 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.735005  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.709174 12753 raft_consensus.cc:2764] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:01.735947  8842 raft_consensus.cc:2376] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12. Re-sending same reply.
I20260709 13:17:01.738176  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.749914  8838 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:01.740677  8664 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 1 to 6, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 6 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:01.756827  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 200776us
I20260709 13:17:01.757614  9459 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:01.758080  8808 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.751s (SENT)
I20260709 13:17:01.763463  8836 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:01.732045 12451 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:01.758038  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:01.767570  8916 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
W20260709 13:17:01.765847  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 113475us
I20260709 13:17:01.770313  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:01.709885 12704 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.716846 12680 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:01.760327 12720 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.002s
I20260709 13:17:01.769011  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:01.782588  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101795us
W20260709 13:17:01.783845  8807 leader_election.cc:336] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.089s (SENT)
I20260709 13:17:01.785028  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.792085  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:01.793445 12665 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:01.793918 12665 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:01.794793 12665 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.796070 12665 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.798942 12680 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:01.808007 12645 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.809592 12559 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.793511  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.829803  8839 raft_consensus.cc:2410] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:17:01.833439  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 201692us
I20260709 13:17:01.834338  9466 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:17:01.842841  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72660.4us
I20260709 13:17:01.770815 12722 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:01.784581 12753 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:01.868564  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110508us
W20260709 13:17:01.871546  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 87726.6us
I20260709 13:17:01.850638 12760 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.847442 12735 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.878460  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.881191  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.785403 12720 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.869581 12753 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:01.885497  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.885309  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:01.874445 12713 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:17:01.888127 12451 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:17:01.888168 12762 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:17:01.887836  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129874us
I20260709 13:17:01.892370  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:01.893180 12751 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:01.897524  8843 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:01.896584  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:01.898025  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.899869  8839 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:01.900183  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:01.890367 12753 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:01.890218 12760 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:01.909071  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:01.898715 12699 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.005s
I20260709 13:17:01.919133 12764 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:01.920995 12772 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.921098 12767 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:01.922042 12774 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:01.922499 12774 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:01.919129 12777 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:01.923940  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50664.8us
I20260709 13:17:01.923470 12760 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.921659 12772 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.886063 12735 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.925185  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:01.932469  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.933043  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.901520 12619 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:01.934239  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:01.938898  8808 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.778s (SENT)
I20260709 13:17:01.936076 12447 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:01.923471 12777 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.939405  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:01.939459  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.901916 12466 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:01.946075  8842 raft_consensus.cc:2393] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:01.946683  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.918411 12504 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:01.954422  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:01.926110 12697 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:01.963449  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:01.965840  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:01.967527  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.971015  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.971699  8839 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:01.974259  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.976089  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.976974  8842 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:01.954022 12466 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.915853 12722 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:01.977725  8914 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:01.976914  8909 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:01.953670 12559 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:01.930732 12699 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.988389 12665 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.950429 12777 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.989344  9464 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:01.984534  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.990070  8913 raft_consensus.cc:2376] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:17:01.990075  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:01.979569  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.980579  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.990533  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.982231  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.982146  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.983037  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.984517 12735 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:01.970150 12414 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.982065  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:01.995105 12765 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:01.997237 12765 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:01.997325  8911 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:01.998368 12765 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:01.999810 12765 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.998914  8911 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:02.000769 12704 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:01.990185 12703 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.001906 12703 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.003316  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.004415  8842 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:01.976948 12438 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.021111 12735 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:17:01.981251 12680 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:02.028534 12438 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:02.007640 12770 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:17:02.029358 12680 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.030993 12438 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.031349  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.031931  8837 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:17:01.990783  8915 raft_consensus.cc:2376] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:17:01.950645 12751 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:17:02.008148  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:01.973192 12727 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.034198  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.011040 12447 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:02.034703 12727 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:02.012042  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.037863  8912 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:02.036571  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.034118  8844 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:02.039856  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.040746  8837 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:17:02.008677  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.017433  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.042838  8913 raft_consensus.cc:2368] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:02.010950  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1756) took 1575 ms. Trace:
I20260709 13:17:02.017119  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.025820  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.034058 12665 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.046254  8914 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:02.047593  8842 raft_consensus.cc:2410] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:02.058212  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:02.085408  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.086436  8844 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.086908  8915 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:02.095252  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.092008  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.098135  8842 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.099941  8914 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
W20260709 13:17:02.104190  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 179151us
I20260709 13:17:02.104911 12767 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 11 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:02.106990  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:02.105463  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 204004us
I20260709 13:17:02.108099  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.043308  8764 rpcz_store.cc:276] 0709 13:17:00.435704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.887469 (+451765us) service_pool.cc:224] Handling call
0709 13:17:00.887851 (+   382us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:00.888279 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:00.888583 (+   304us) log.cc:844] Serialized 14 byte log entry
0709 13:17:00.925998 (+ 37415us) spinlock_profiling.cc:243] Waited 5.75 ms on lock 0x7b180038ef00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9
0709 13:17:00.959630 (+ 33632us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b180038ef00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a 00007fce6fda4a2a
0709 13:17:01.065048 (+105418us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:01.104538 (+ 39490us) log.cc:844] Serialized 52 byte log entry
0709 13:17:01.104777 (+   239us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:01.104827 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.104948 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.007150 (+902202us) spinlock_profiling.cc:243] Waited 9.5 ms on lock 0x7b180038ef00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:02.010638 (+  3488us) raft_consensus.cc:1685] finished
0709 13:17:02.010669 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.010861 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45158,"prepare.queue_time_us":3648,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":39,"raft.queue_time_us":24953,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":18480,"spinlock_wait_cycles":38097280,"thread_start_us":74725,"threads_started":1,"wal-append.queue_time_us":180503}
I20260709 13:17:02.095297  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.123423  8918 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:02.032765 12680 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.129962  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.037897 12699 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:02.020910 12565 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:02.118577  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 90564.2us
I20260709 13:17:02.119413  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:02.143941  8917 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.125598  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.125986  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:02.012291 12772 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.145061  8913 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:17:02.128118  8837 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:02.124013  8843 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.113950 12773 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.132287  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:02.133961  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.105870 12735 consensus_queue.cc:1243] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:01.991657 12466 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.056028 12665 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:02.139166  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:02.140777  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:02.004837 12703 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:02.109097 12697 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.112042  8914 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:02.105167 12447 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:02.190057  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.196180  8844 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
W20260709 13:17:02.200440  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 61624.9us
I20260709 13:17:02.202050  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.157799 12760 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.204660  8844 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:02.218611  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.220772  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.220849  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:02.191190 12697 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.222427  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.225073  8844 raft_consensus.cc:2368] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12.
I20260709 13:17:02.152092 12565 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.226075  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:02.229808  8844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:02.205132 12735 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:02.230389  8844 raft_consensus.cc:606] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:02.217695 12786 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.231912  8844 raft_consensus.cc:614] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:02.233346 12787 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.243602 12787 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.244030 12787 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.237499 12784 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:02.241055 12768 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:02.155962 12750 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.228713 12697 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.258309  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.264179  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:02.160490 12773 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.231702 12735 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:02.298236 12792 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:02.254577 12727 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.299506  8843 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:02.307798 12773 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:02.311786  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 186712us
I20260709 13:17:02.316001  8917 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:02.242973 12786 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:02.298748 12779 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.318383  8839 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.223989 12760 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:02.327770  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 104683us
I20260709 13:17:02.328279  8843 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 13:17:02.329283  8839 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:17:02.329686  8839 pending_rounds.cc:85] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 2
I20260709 13:17:02.329929  8839 pending_rounds.cc:107] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:17:02.330168  8839 raft_consensus.cc:2889] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.330472  8839 pending_rounds.cc:107] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:17:02.330714  8839 raft_consensus.cc:2889] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.331524  8842 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:02.334321  8837 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:02.231088 12665 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.337038 12665 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.351500 12777 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:02.354007 12776 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.444s	user 0.000s	sys 0.005s
I20260709 13:17:02.227180 12767 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.357997  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 474) took 1068 ms. Trace:
I20260709 13:17:02.391045  9466 rpcz_store.cc:276] 0709 13:17:01.289591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.293418 (+  3827us) service_pool.cc:224] Handling call
0709 13:17:02.357803 (+1064385us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b540057ce54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:02.357931 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1241581440}
I20260709 13:17:02.359127  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.393179 12750 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:02.360366  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.345472 12735 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.394569 12735 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.398219  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:02.398541 12515 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.399698 12704 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:02.399595 12515 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.400280 12704 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:02.401434 12704 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.404697 12786 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.405256 12565 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.387338  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.408587  8842 raft_consensus.cc:2410] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:02.318571 12792 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:02.411317 12792 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.412144 12786 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:02.413208 12771 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.486s	user 0.002s	sys 0.001s
I20260709 13:17:02.413767  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.415112  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.416200  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.416895  8912 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 5.
I20260709 13:17:02.417600 12768 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:02.417997 12768 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:02.418352 12768 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.419253  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:02.420023  8913 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:02.421682 12760 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:02.422086 12759 raft_consensus.cc:2764] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:17:02.422904  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.327248 12779 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:02.425222 12779 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.419586 12697 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.428197 12720 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:02.328063 12753 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.429167  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.429409 12697 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.429982 12774 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.430959 12753 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:02.431104 12774 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:02.432265  8768 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
W20260709 13:17:02.348724 12645 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.002s
I20260709 13:17:02.433635  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:02.433916  8766 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:02.434228  8838 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.391499  8839 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:02.435249  8839 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:02.436033  8839 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.438524 12777 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:02.440841  8910 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:02.457181  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.459733  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:02.452399  8839 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.460448  8768 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:02.457746  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:02.449824  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:02.462268  8916 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:02.465884  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:02.467048  8768 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:02.447146  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:02.471764  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.457530  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:02.476824  8838 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:17:02.461396  8909 raft_consensus.cc:606] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:02.479537  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:02.517930  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:02.522905  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 43495.8us
I20260709 13:17:02.525286  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.525965  8838 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:17:02.524130  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.030s	sys 0.062s
W20260709 13:17:02.532398  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.030s	sys 0.062s
W20260709 13:17:02.533118  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 511615us
W20260709 13:17:02.535897  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78456.1us
I20260709 13:17:02.536043  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:02.537508  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.540988  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.541935  8768 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
W20260709 13:17:02.543685  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.555418  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.523845 12720 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.453014 12777 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 13:17:02.533277 12737 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:02.532369 12784 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:02.407721 12466 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.574074  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.575229  8766 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:02.576437  8839 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:02.552062 12759 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:02.569824  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.570863  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:02.580232  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:02.551513 12763 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.582100  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:02.577011  8839 pending_rounds.cc:85] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 5
I20260709 13:17:02.566025  8768 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:17:02.582787  8836 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:02.447319 12750 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:17:02.548472 12773 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.578145  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.565133 12726 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:02.576644  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 129576us
W20260709 13:17:02.581432  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.583541  8839 pending_rounds.cc:107] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:02.577723 12737 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:02.593057 12737 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.593767  8917 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:02.568444  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.585207  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.590580  8839 raft_consensus.cc:2889] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:02.587740  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:02.595568  8763 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:02.596773  8768 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.566882 12720 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.602911  9466 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:02.603919  8766 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.578539 12721 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:02.599452  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:02.606035  9460 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:17:02.607158  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.583009 12565 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:02.585952 12763 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:02.609926  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.612980  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.614085  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:02.615760  8768 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:17:02.614391  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.595067 12762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.012s	sys 0.039s
I20260709 13:17:02.611737  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.593081 12722 raft_consensus.cc:2764] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:17:02.616307  8764 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
W20260709 13:17:02.621251  9432 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.793s (SENT)
I20260709 13:17:02.617607  9461 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:02.627607  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:02.627887  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.598623 12759 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:02.613933 12406 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:17:02.639880 12798 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:17:02.640221 12778 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:02.645874  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:02.609627 12721 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:02.646312 12466 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:02.625942 12762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.013s	sys 0.040s
I20260709 13:17:02.652627  8768 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.657955  9460 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:02.660849  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70801.7us
I20260709 13:17:02.669935  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:02.617502 12763 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.647790 12414 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.624317 12735 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:02.673647  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101941us
I20260709 13:17:02.601768 12704 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:02.675479  8807 leader_election.cc:400] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:02.681133  8807 leader_election.cc:403] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.681155  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:02.683629  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.684372 12732 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:02.684799 12732 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:02.685137  8840 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:02.685267 12732 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:02.686477  8808 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.619s (SENT) [suppressed 82 similar messages]
I20260709 13:17:02.665273 12714 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.622602 12565 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.661504 12721 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:02.690379  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 69191.8us
W20260709 13:17:02.685611 12804 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:02.686918  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.627259 12799 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:17:02.677254 12414 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:02.680474 12735 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:02.737280  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.692111 12750 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.666745 12778 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:02.758529  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83165.9us
I20260709 13:17:02.761453  8807 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:02.763445  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.703493 12722 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:02.764683  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.766466  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 96653us
I20260709 13:17:02.687460 12449 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:02.746062 12414 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.694159 12781 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:02.685889 12787 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.659003 12784 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.725641 12727 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:02.765717 12447 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:02.774279  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 87821.8us
I20260709 13:17:02.754592 12735 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.801998 12565 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:02.802683 12797 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:17:02.779114  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 92423.3us
I20260709 13:17:02.803951  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.805334  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:02.806746  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.770329  8807 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.808108  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.737000 12576 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:17:02.769060 12434 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.770471 12802 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:02.811291  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.778136 12403 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.817329  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.821851 12403 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:02.824043 12803 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:17:02.824378 12403 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:02.827287  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:02.811098 12559 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:02.829314 12786 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.829007 12796 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:17:02.829752 12786 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.830157 12786 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.827316 12449 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.830909 12449 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:02.831393 12449 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.829035 12447 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:02.811998 12565 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:02.834605 12800 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:17:02.835317 12727 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:02.835760 12727 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:02.810897 12773 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.837170 12773 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:02.837580 12773 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.838424 12787 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:02.839886 12720 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:02.813155 12781 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.841213 12781 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.841622 12781 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:02.830931  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 62335.2us
I20260709 13:17:02.774736 12759 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:02.812497 12802 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.813586 12807 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:02.863325  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 56646.6us
I20260709 13:17:02.865625  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.864460 12802 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:02.820562 12434 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.864568 12704 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:02.836601 12727 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:02.860347 12751 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:17:02.940358 12704 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:02.941133 12810 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:02.943463 12704 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:02.958199  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.933619  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68103.2us
I20260709 13:17:02.864930 12807 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:02.932010 12504 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:02.985677  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.988078  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 126847us
I20260709 13:17:02.993830  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:02.984017 12807 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.984192 12774 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.032507 12774 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.035029 12774 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.008422 12735 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.009402 12713 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:03.009857  8764 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:03.010128 12665 raft_consensus.cc:2764] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:03.014833 12434 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:03.016242 12781 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:03.021005  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.003667 12727 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:03.025012  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.026571 12449 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:03.005731 12768 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.002s
W20260709 13:17:03.044200  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.040680 12779 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.000s
I20260709 13:17:03.057142  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:03.045164  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45599us
I20260709 13:17:03.059330  8884 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.038899  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:03.044138  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 215937us
W20260709 13:17:03.050536  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.058072  8768 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:03.045747 12713 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:03.067690 12713 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.061574 12768 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.064026 12773 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.070955 12768 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.071362 12792 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.071803 12773 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:03.069671 12713 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.068368 12815 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:03.074693  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:03.075176  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.061010  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:03.076953  8764 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.078510 12721 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:03.079672  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.080433 12784 raft_consensus.cc:2764] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:03.036823 12786 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.064697 12779 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.086805 12786 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.087445 12779 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:03.088195 12786 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:03.088711 12786 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:03.089476  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.090096  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83481.2us
I20260709 13:17:03.091022  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:03.091301  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.091748  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.092301  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.090701 12786 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.093811 12720 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:03.094147  8732 leader_election.cc:400] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:17:03.094215 12720 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:03.095121  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.096009 12750 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.096378  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.092978  8884 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.096853 12750 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.097380 12815 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.097759 12750 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.097867  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.098790 12645 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.099221  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.073113 12565 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.099677 12645 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.100435 12565 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.084563 12807 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.107478 12807 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.109880 12449 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.110247 12438 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:03.112454  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.114277  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:03.116158  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:03.117633 12773 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:03.100508  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.120141  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.121065 12645 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.125670 12406 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:03.127609 12778 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.112354  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:03.129019 12438 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:17:03.130620  8808 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.014s (SENT)
I20260709 13:17:03.131091  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.038671 12732 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:03.173658  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53625.1us
W20260709 13:17:03.173513  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 80648.8us
I20260709 13:17:03.062357 12434 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.180742  8838 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:03.181113  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:03.182199  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:03.188248  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 112205us
W20260709 13:17:03.189854  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 93553.4us
I20260709 13:17:03.191509  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.189234  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:03.099678 12815 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.141419 12773 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.053565 12802 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.178239 12447 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.178826 12665 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.187726  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:03.202234  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 72690.4us
W20260709 13:17:03.203508  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.209649  8836 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:03.210036  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:03.212047  8838 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.216213  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:03.217540  8840 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:03.218109  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:03.218634  9464 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:03.213608 12759 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.226573  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:03.185032 12438 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:03.231542  8837 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:17:03.231148 12414 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.233685 12721 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:03.234325  8841 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:03.235623  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:03.236580  8842 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:03.186816 12559 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:03.240523  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:03.205989 12723 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.189473 12434 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.242416  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.210289 12815 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:03.095152 12720 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.264904  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:03.216413 12403 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:03.248772  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:03.216224 12722 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:03.269686  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.251201  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:03.268158  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.251780  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:03.271493  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.214197 12726 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:17:03.275866  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:03.276144  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:03.279080  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.250301 12815 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:03.273800  8840 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:03.272675 12414 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.270340 12759 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.269168 12403 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.286397  8837 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:03.276322 12645 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.287442  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.250861 12721 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:03.272783 12781 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.276185 12723 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.286657 12815 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.284729  8884 leader_election.cc:400] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12.
I20260709 13:17:03.250569 12713 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:03.236145 12565 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:03.269870 12722 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.319608 12722 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.319864  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.295231 12721 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.322551 12721 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.323644 12504 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.291366 12720 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.325160 12751 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:03.325742 12763 consensus_meta.cc:287] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.637s	user 0.011s	sys 0.000s
I20260709 13:17:03.325925 12787 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:03.326694 12751 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.326234 12763 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.314091 12732 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:03.301749  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90877.9us
I20260709 13:17:03.330863  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:03.332063  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:03.314626  8836 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:03.333377  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:03.334614  8841 raft_consensus.cc:2368] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:17:03.335883  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:03.336145 12723 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:03.314713 12768 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.337280 12768 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.337646 12768 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.337703 12723 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:03.338155 12723 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.338510 12723 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.338827 12759 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:03.340279 12784 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:03.293558 12403 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.345765  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.348237  8914 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:03.349471  8909 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:03.296553 12735 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.290632 12438 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:03.371055  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.361649  9461 raft_consensus.cc:2368] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7.
I20260709 13:17:03.362660  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:03.362660  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.372279  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.363377  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.373311  8916 raft_consensus.cc:2410] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:03.372746  8769 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:03.364133  8766 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:03.374934  8841 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:03.368222  8913 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:03.373363  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.365401  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:03.368610  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.375180  8766 pending_rounds.cc:85] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 6
I20260709 13:17:03.376416  8766 pending_rounds.cc:107] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:03.376680  8766 raft_consensus.cc:2889] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:03.379134  8837 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:03.316296  8884 leader_election.cc:403] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.387085  8764 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 6.
W20260709 13:17:03.388602  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52836.5us
I20260709 13:17:03.390605  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.370501 12434 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:03.409591  8808 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.539s (SENT)
I20260709 13:17:03.442255  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:03.360299 12787 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:17:03.414134  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 66646.3us
W20260709 13:17:03.420439  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 135927us
I20260709 13:17:03.398893 12732 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.388955 12726 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:17:03.390865 12778 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:17:03.432957  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.438289  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 96120.1us
I20260709 13:17:03.449509  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:03.469626  8843 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:03.470185  8843 pending_rounds.cc:85] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 6
I20260709 13:17:03.470438  8843 pending_rounds.cc:107] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:03.470837  8843 raft_consensus.cc:2889] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:03.472182  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62665.3us
I20260709 13:17:03.435640 12836 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:03.486971  8761 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:03.487846  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.488895  8765 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
W20260709 13:17:03.477808  8808 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.567s (SENT)
I20260709 13:17:03.519230  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:03.522024  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.524282  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.525280  8761 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:03.543459  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.545583  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:03.546406  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 63288.9us
I20260709 13:17:03.552254  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.467224 12830 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:03.555665  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.562377  8767 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
W20260709 13:17:03.562589  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.518347 12576 raft_consensus.cc:993] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:03.564265  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.481163 12836 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:03.567782  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:03.573679  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 183095us
I20260709 13:17:03.578090  8767 raft_consensus.cc:2376] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9. Re-sending same reply.
I20260709 13:17:03.502223 12763 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:03.549657 12735 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:03.588783  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.597536  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.556252 12759 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.594282  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.594354  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.556762 12434 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.601711  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.516597 12784 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:17:03.608832  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.574258 12727 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.622349  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:03.623214  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.613858 12438 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:03.615814 12837 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:03.617081 12839 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.618446 12840 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:03.619347 12815 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.629387  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:03.629679  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.714771  8762 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.614512  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:03.559623 12829 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:17:03.717933  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105829us
I20260709 13:17:03.670059  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.720017  8765 raft_consensus.cc:2368] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7.
I20260709 13:17:03.660415 12839 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.686161  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.704165  8761 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:03.705462  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:03.708913  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 96195.2us
I20260709 13:17:03.729240  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.733031  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.734102  8761 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.745558  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:03.776567  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.746776  8838 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.750437  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.714067 12559 raft_consensus.cc:1081] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:03.753180  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.765758 12835 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:03.726334 12727 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:03.776365  8767 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:03.611835 12722 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.780827  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.784981  8842 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:03.716874 12735 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:17:03.791191  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.793422  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.794291  8762 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.795193  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.796711  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.804183  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:03.816179  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.817865  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.817489  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.820209  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.786567 12835 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:03.802215 12697 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.823149  8761 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.825253  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.825997  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.855664  8765 raft_consensus.cc:2376] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11. Re-sending same reply.
I20260709 13:17:03.832480  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.840876  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.858836  8916 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 7: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:03.844282  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.843629  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.869760  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.869942  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.872426  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.877159  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:03.877771 12721 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.001s
I20260709 13:17:03.878439 12721 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:03.878973 12720 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.004s
I20260709 13:17:03.879999 12778 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:03.877938 12841 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.149s	user 0.000s	sys 0.002s
I20260709 13:17:03.877877  8763 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:03.883194  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.873198  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.886106  8910 raft_consensus.cc:2368] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11.
I20260709 13:17:03.887646  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.736639 12836 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.868904 12697 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.877701 12732 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12.
I20260709 13:17:03.897184  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.897450  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:03.899174 12768 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.008s
I20260709 13:17:03.899622 12768 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.891333 12735 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:03.900766 12735 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.901243  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.901028 12835 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.902066 12774 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:03.902335 12835 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.902701 12774 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:03.903604 12792 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.903858 12774 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.818409 12820 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:17:03.904395 12792 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.845340 12857 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:03.918751  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.880040 12722 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:03.920321  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.922868  8765 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.893812  8767 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:03.925065  8909 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:17:03.917047  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 338463us
I20260709 13:17:03.883584 12721 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:03.921562  8763 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.896624 12697 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.829759 12576 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:17:03.933921  8913 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:03.927955  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.928092  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.928925  8918 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:03.932179  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.920440 12857 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.949503  8911 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:03.949784  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.923892  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:03.934333  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.950664  8765 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.949517  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:03.937187  8767 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:03.952318  8735 leader_election.cc:400] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:17:03.952705  8735 leader_election.cc:403] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.953835  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:03.933276  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.938076  8916 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:03.956143  8909 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.952678  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.959712  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.936484 12713 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:03.961252 12713 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:03.962450 12851 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.962309 12713 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:03.964049  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.964947  8915 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:03.951521 12727 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:03.967140  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.967794  8769 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 6.
I20260709 13:17:03.968747  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.969496  8769 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.970332  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.973206  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:03.973876  8913 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.957994 12857 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.975899  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.976652  8763 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.965988 12850 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:17:03.982232 12768 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.968984 12779 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.985634  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.986387 12830 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:03.986900  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:03.987308 12845 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:03.987819 12845 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:03.988059  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:03.988499  8767 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:03.988619  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:03.988884  8765 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:03.989224  8911 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:03.986482 12759 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:03.988636  8761 raft_consensus.cc:2376] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12. Re-sending same reply.
W20260709 13:17:03.957752 12723 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.000s
I20260709 13:17:04.013037  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:04.013499  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.013753  8842 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:04.002193  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1942) took 1644 ms. Trace:
I20260709 13:17:04.007565  8839 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:04.009004  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.015942  8914 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:04.014890  8843 rpcz_store.cc:276] 0709 13:17:02.357460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.366944 (+  9484us) service_pool.cc:224] Handling call
0709 13:17:02.392188 (+ 25244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.471440 (+1079252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.001952 (+530512us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003a6454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:04.002134 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2476998400}
I20260709 13:17:04.017982  8909 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:03.958199 12839 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:03.934125 12720 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:17:04.000842 12759 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:03.997399 12815 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:04.023919  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.022384 12820 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.093617  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:04.094393  8910 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:04.097390 12856 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:17:04.098002  8768 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:04.099138  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:04.099820  8915 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.100481  8760 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:04.053634 12781 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:04.051440 12843 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:17:04.102438 12843 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:04.102573 12434 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:04.102845 12843 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:04.103224 12434 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:04.103720 12843 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:04.105355  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.106187 12792 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:04.108042  8910 raft_consensus.cc:2410] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:04.108762 12843 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.109330  8765 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:17:04.112124  8912 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:04.113726 12735 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:04.117328  8913 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:04.126045 12802 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:04.070372 12845 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.021476 12723 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:04.129441  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105582us
I20260709 13:17:04.130846  8760 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:04.092672  8763 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:17:04.136312  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:04.144455  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.146950  8915 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
W20260709 13:17:04.148067 12403 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.777s	user 0.013s	sys 0.000s
I20260709 13:17:04.150277 12403 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.156543 12403 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:04.134213 12820 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.167333 12774 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:04.168524 12723 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:04.141229 12845 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.171418  8808 leader_election.cc:400] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7.
I20260709 13:17:04.175257  8808 leader_election.cc:403] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:17:04.182567  8884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.000s	sys 0.025s
W20260709 13:17:04.184607  8884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.000s	sys 0.026s
W20260709 13:17:04.186287  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 596810us
W20260709 13:17:04.174849  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 380520us
W20260709 13:17:04.215575  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.238677  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:04.240363  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:04.245464  8883 leader_election.cc:400] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7.
I20260709 13:17:04.245916  8883 leader_election.cc:403] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.246372  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:04.247195 12722 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.172408 12857 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.244871 12723 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.269474 12836 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.291379 12403 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:04.286188  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 44003.8us
W20260709 13:17:04.297230  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 125982us
I20260709 13:17:04.290920 12857 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:04.298739  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:04.299568 12857 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.299747 12802 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:04.301013  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53024.1us
I20260709 13:17:04.300758  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.314685  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:04.357515  8766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:17:04.358158  8766 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.353010  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.358551  8766 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.242395 12820 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 6. Current term is 7.
I20260709 13:17:04.285869 12851 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:17:04.385923  8843 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:04.385838 12849 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:04.362988  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:04.388937  8765 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.389634  8839 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:04.390036  8839 pending_rounds.cc:85] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 5
I20260709 13:17:04.390260  8839 pending_rounds.cc:107] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:04.390411  8762 raft_consensus.cc:2410] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:04.390472  8839 raft_consensus.cc:2889] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:04.368077  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.371248  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:04.378461  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:04.392318  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:04.388850  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.393030  8840 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:04.390817  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.394228  8842 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.391546  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.362666  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:04.397353  8760 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.397476  8837 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 6: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:04.285172 12576 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.398833 12576 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:04.398905  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:04.405038  8843 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:04.412065  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.412679  8844 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.356269 12723 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:17:04.441290  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.442317  8765 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:04.442499  8841 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.441731  8769 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:04.360147 12830 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.444506  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:04.456846  8765 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.360466 12720 raft_consensus.cc:2764] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:04.451974  8760 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:04.329897 12802 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:04.446197  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 93384.4us
I20260709 13:17:04.470531  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.470717  8842 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:04.405625 12735 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.472635  8768 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:04.473729  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:04.418200  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50111.1us
I20260709 13:17:04.474824  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:04.475747  8769 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:04.480600  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:04.481423  8763 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.482225  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.492237  8844 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:04.493952  8765 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:04.494191  8844 pending_rounds.cc:85] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 5
I20260709 13:17:04.494830  8844 pending_rounds.cc:107] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:17:04.495393  8844 raft_consensus.cc:2889] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:04.500298  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.501096  8835 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.452908  8666 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:04.317073 12759 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:04.529441  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.452941 12773 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.506122  8766 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:04.538184  8735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.010s	sys 0.009s
W20260709 13:17:04.538686  8735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.010s	sys 0.009s
W20260709 13:17:04.540477  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.540966  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:04.541461  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.543995  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:04.390395 12403 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7.
W20260709 13:17:04.551249  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 76606.8us
I20260709 13:17:04.370719 12722 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:17:04.528066  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:04.552913  9431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.015s	sys 0.039s
W20260709 13:17:04.565196  9431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.015s	sys 0.040s
I20260709 13:17:04.530841  8666 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 5, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 5 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:04.482415 12792 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.469265 12830 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.499512 12820 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:04.566646  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:04.552181 12773 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.567916  8766 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:04.499740 12815 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:04.573158  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45229.6us
I20260709 13:17:04.574260  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1781) took 1073 ms. Trace:
I20260709 13:17:04.622153  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.405002 12434 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:04.580101  8763 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
W20260709 13:17:04.617733  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 827328us
I20260709 13:17:04.595816  8842 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:04.620303  8910 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:17:04.634893  9431 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:04.570184 12835 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
I20260709 13:17:04.640571  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:04.641592  8842 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.648103  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.650218  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.581065 12836 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.622028  8761 rpcz_store.cc:276] 0709 13:17:03.500701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.000168 (+499467us) service_pool.cc:224] Handling call
0709 13:17:04.000483 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.000679 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:04.021835 (+ 21156us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.573814 (+551979us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:04.573887 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:04.573956 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.574041 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.574188 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7384,"prepare.queue_time_us":23686,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":10784,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":6623,"thread_start_us":456883,"threads_started":1}
I20260709 13:17:04.583046 12857 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:04.653076  8839 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:04.623090  8911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.030s	sys 0.038s
W20260709 13:17:04.692642  8911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.031s	sys 0.039s
W20260709 13:17:04.655061  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.658087  9431 leader_election.cc:400] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11.
I20260709 13:17:04.694618  9431 leader_election.cc:403] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:04.695233  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55304.3us
W20260709 13:17:04.673153  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.680779 12727 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.022s	sys 0.020s
W20260709 13:17:04.651948 12750 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.010s	sys 0.035s
I20260709 13:17:04.587980 12787 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:17:04.714578  9464 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:04.720881  8836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.013s
W20260709 13:17:04.723984  8836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.016s	sys 0.013s
I20260709 13:17:04.653649 12784 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.653235 12850 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.652000 12863 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.654341 12576 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:04.684949 12815 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:04.711006 12727 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.023s	sys 0.020s
I20260709 13:17:04.725469 12781 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.632248 12792 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:04.690115 12735 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:04.706964 12851 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:04.745602  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.732071 12865 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:04.727578 12726 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.727147 12732 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:04.751211 12750 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.011s	sys 0.035s
W20260709 13:17:04.702324  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52226.5us
W20260709 13:17:04.791877 12854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.009s	sys 0.051s
I20260709 13:17:04.791469  8842 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:17:04.701709  8917 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.021s	sys 0.021s
W20260709 13:17:04.824026  8917 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.021s	sys 0.021s
W20260709 13:17:04.699241  8913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.009s	sys 0.016s
I20260709 13:17:04.813207  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:04.824843  8913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.010s	sys 0.017s
I20260709 13:17:04.744238 12787 consensus_queue.cc:1243] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:04.833326  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:04.741997 12836 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 13:17:04.800938 12844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.002s	sys 0.021s
I20260709 13:17:04.699034 12852 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.127s
W20260709 13:17:04.822180 12854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.010s	sys 0.051s
I20260709 13:17:04.822492 12732 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.703864 12857 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:04.826234 12850 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.760123 12815 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:04.851140  8835 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:04.828359 12759 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:04.808066 12865 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:04.798026 12735 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:04.836284 12787 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:04.883294  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:04.839677 12844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.002s	sys 0.021s
I20260709 13:17:04.916519  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:04.913764  8915 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.012s	sys 0.012s
W20260709 13:17:04.917925  8915 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.012s
W20260709 13:17:04.919834  8837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.026s	sys 0.010s
W20260709 13:17:04.925515  8837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.026s	sys 0.011s
I20260709 13:17:04.929060  8841 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:04.935879  8841 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:04.832826 12867 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 13:17:04.952401  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:04.957245  9432 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.012s	sys 0.029s
W20260709 13:17:04.958997  9432 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.012s	sys 0.029s
W20260709 13:17:04.959420  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 732920us
I20260709 13:17:04.967000  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:04.997910  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:04.998602  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:04.920619 12697 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:04.925061 12723 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.952502 12751 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:04.952237 12802 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.951085 12727 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.924448 12759 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:17:04.960165 12836 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.004530 12835 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:17:05.017690 12870 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:17:05.001494 12787 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:05.021507  8764 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.020s	sys 0.045s
I20260709 13:17:04.968462 12850 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.966228 12844 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:05.011428 12871 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:17:05.004916 12830 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:05.044004  8764 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.020s	sys 0.045s
W20260709 13:17:05.001750  8767 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.007s	sys 0.032s
I20260709 13:17:05.005223 12852 raft_consensus.cc:476] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:17:05.019726 12735 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:05.038465 12845 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.814s	user 0.011s	sys 0.000s
W20260709 13:17:05.058530  8767 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.008s	sys 0.032s
I20260709 13:17:05.060415  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.072243  8910 raft_consensus.cc:2376] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7. Re-sending same reply.
I20260709 13:17:05.066233  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.067238  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:05.031077 12857 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:05.023837 12723 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.014370 12697 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:05.078042  8808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.033s	sys 0.078s
W20260709 13:17:05.078747  8808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.034s	sys 0.078s
I20260709 13:17:05.073555  8918 raft_consensus.cc:2410] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:05.045675 12751 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:05.050935 12787 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:05.077661  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.101243  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.029783 12727 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.068697 12850 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:05.116212  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 556322us
I20260709 13:17:05.118160  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1929) took 1112 ms. Trace:
I20260709 13:17:05.118732  8838 rpcz_store.cc:276] 0709 13:17:04.006120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.007139 (+  1019us) service_pool.cc:224] Handling call
0709 13:17:04.007386 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:04.007598 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:04.482911 (+475313us) log.cc:844] Serialized 14 byte log entry
0709 13:17:04.766027 (+283116us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.117762 (+351735us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:05.117811 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.117869 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.117939 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.118074 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":866717,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":6988,"raft.queue_time_us":337843,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5169,"spinlock_wait_cycles":31448320,"thread_start_us":1090911,"threads_started":3,"wal-append.queue_time_us":552097}
I20260709 13:17:05.133551  8841 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:05.135375  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:05.136624  8841 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.076754 12735 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.075332 12843 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:05.051753 12844 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.075513 12434 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:05.150619  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:05.104599 12857 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.155093  8841 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:05.152889  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 670671us
I20260709 13:17:05.152325 12732 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:05.197950  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:05.199162  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.141460 12850 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.151808 12735 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.183431 12835 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.166886 12857 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.252489  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:05.254448  8807 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.020s
I20260709 13:17:05.254884  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:05.209190 12815 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:05.261724  8838 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:05.262270  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:05.254894  8807 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.013s	sys 0.020s
W20260709 13:17:05.273665  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 525861us
I20260709 13:17:05.200698 12830 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:17:05.248036 12845 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:05.249233 12759 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:05.250452 12836 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:05.263129 12878 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.238s	user 0.001s	sys 0.001s
W20260709 13:17:05.294955  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 152697us
I20260709 13:17:05.261787 12835 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.301376 12902 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.306262 12890 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:17:05.306025 12902 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:05.307981 12877 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:17:05.309283 12902 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:05.309697  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1933) took 1301 ms. Trace:
I20260709 13:17:05.310216  8836 rpcz_store.cc:276] 0709 13:17:04.007980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.008110 (+   130us) service_pool.cc:224] Handling call
0709 13:17:04.048116 (+ 40006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.059105 (+ 10989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.059157 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.072082 (+ 12925us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.160233 (+ 88151us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b18003fdfc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:17:04.724523 (+564290us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:04.724563 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.724629 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.309320 (+584691us) raft_consensus.cc:1685] finished
0709 13:17:05.309350 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.309621 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12339,"raft.queue_time_us":18306,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":16263,"spinlock_wait_cycles":54873856,"thread_start_us":564111,"threads_started":1,"wal-append.queue_time_us":923873}
I20260709 13:17:05.257454 12852 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:05.313287  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:05.264110 12732 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.264307 12865 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:05.256605 12434 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:17:05.293069 12863 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.206255 12751 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 10.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.203665 12787 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.295094 12896 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:05.260625 12898 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:17:05.364675  8666 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:05.352375 12880 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:17:05.352636 12434 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:05.353164 12885 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:17:05.353490 12888 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
W20260709 13:17:05.353842 12882 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:17:05.313478 12759 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:05.355675 12820 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.001s
I20260709 13:17:05.312572 12845 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.361049 12727 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:05.363972  8664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 218) took 33660 ms (client timeout 15000 ms). Trace:
I20260709 13:17:05.365108 12844 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:05.367137  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 180415us
I20260709 13:17:05.324555 12852 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.383219  8666 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:05.489032 12774 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 1.321s	user 0.011s	sys 0.002s
I20260709 13:17:05.333652 12901 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:05.315711 12836 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.333583 12723 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:05.406319 12784 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.429291  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:05.431432  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.511165  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.433823  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:05.438006  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 408) took 1070 ms. Trace:
I20260709 13:17:05.498430 12820 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:05.440665 12815 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:05.441044 12867 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:05.439558  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:05.526595  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1958) took 1210 ms. Trace:
I20260709 13:17:05.527851  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.527148  8912 rpcz_store.cc:276] 0709 13:17:04.315941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.316090 (+   149us) service_pool.cc:224] Handling call
0709 13:17:04.316495 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.318485 (+  1990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.318528 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.356018 (+ 37490us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.850790 (+494772us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.265078 (+414288us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.294500 (+ 29422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.294586 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.526367 (+231781us) raft_consensus.cc:1685] finished
0709 13:17:05.526386 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.526535 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52423,"prepare.queue_time_us":557017,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":74976,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":21551,"thread_start_us":766557,"threads_started":2,"wal-append.queue_time_us":662274}
I20260709 13:17:05.529610  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:05.531049  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.506403 12844 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.490413  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1956) took 1345 ms. Trace:
I20260709 13:17:05.379653 12857 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:05.499100  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1951) took 1475 ms. Trace:
I20260709 13:17:05.331370  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:05.353968 12713 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:05.497890  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 235677us
W20260709 13:17:05.501314  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.550576  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.553174  8916 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.552245  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:05.519426 12901 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:05.505192  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 202151us
I20260709 13:17:05.397665 12792 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:05.509526  8666 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.432583  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.397930 12434 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:05.349979 12863 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.514424  8914 rpcz_store.cc:276] 0709 13:17:04.367843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.369582 (+  1739us) service_pool.cc:224] Handling call
0709 13:17:04.370029 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.400707 (+ 30678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.400736 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.401535 (+   799us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.837683 (+436148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:04.837747 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.437502 (+599755us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b54001d3b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:05.437571 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.437631 (+    60us) raft_consensus.cc:1685] finished
0709 13:17:05.437653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.437930 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"spinlock_wait_cycles":69723520,"thread_start_us":435715,"threads_started":1,"wal-append.queue_time_us":654840}
I20260709 13:17:05.439527 12778 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:05.509717 12880 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 13:17:05.523350  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 89638.5us
I20260709 13:17:05.501892 12697 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:05.496809  8664 rpcz_store.cc:269] 0709 13:16:31.744219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.774978 (+ 30759us) service_pool.cc:224] Handling call
0709 13:16:32.863697 (+1088719us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:05.363864 (+32500167us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:02.217563 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:02.245205 (+ 27642us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:02.245258 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:17:02.245277 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:02.246606 (+  1329us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:02.246720 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:02.246747 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:02.309467 (+ 62720us) tablet.cc:701] Row locks acquired
0709 13:17:02.309536 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:17:02.309724 (+   188us) write_op.cc:270] Start()
0709 13:17:02.309887 (+   163us) write_op.cc:276] Timestamp: P: 1783603022309652 usec, L: 0
0709 13:17:02.309909 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:02.310728 (+   819us) log.cc:844] Serialized 5154 byte log entry
0709 13:17:02.800112 (+489384us) op_driver.cc:464] REPLICATION: finished
0709 13:17:03.072341 (+272229us) write_op.cc:301] APPLY: starting
0709 13:17:03.072459 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:03.072747 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:03.075817 (+  3070us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:03.184797 (+108980us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:03.197385 (+ 12588us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:17:03.197442 (+    57us) write_op.cc:312] APPLY: finished
0709 13:17:03.239025 (+ 41583us) log.cc:844] Serialized 94 byte log entry
0709 13:17:03.266813 (+ 27788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:03.275743 (+  8930us) write_op.cc:454] Released schema lock
0709 13:17:03.285882 (+ 10139us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:03.330791 (+ 44909us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:03.330828 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1561068,"reported_tablets":52,"spinlock_wait_cycles":32216448,"child_traces":[["op",{"apply.queue_time_us":244823,"apply.run_cpu_time_us":5571,"apply.run_wall_time_us":264010,"num_ops":13,"prepare.queue_time_us":217357,"prepare.run_cpu_time_us":36302,"prepare.run_wall_time_us":438919,"raft.queue_time_us":156329,"raft.run_cpu_time_us":14191,"raft.run_wall_time_us":205086,"replication_time_us":490030,"spinlock_wait_cycles":18304,"thread_start_us":620076,"threads_started":4,"wal-append.queue_time_us":283585,"wal-append.run_cpu_time_us":42085,"wal-append.run_wall_time_us":1702043}]]}
I20260709 13:17:05.533989  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1959) took 1134 ms. Trace:
I20260709 13:17:05.478111  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:05.587697  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:05.588228  8841 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:05.537068  8913 rpcz_store.cc:276] 0709 13:17:04.145460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.145615 (+   155us) service_pool.cc:224] Handling call
0709 13:17:04.146021 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.146410 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.146437 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.146928 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.825238 (+678310us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.178550 (+353312us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.178724 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.178822 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.490120 (+311298us) raft_consensus.cc:1685] finished
0709 13:17:05.490150 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.490335 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6511,"prepare.queue_time_us":582366,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":58360,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":19020,"thread_start_us":993301,"threads_started":2,"wal-append.queue_time_us":794019}
I20260709 13:17:05.540693  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.542296  8843 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:05.587985  8837 rpcz_store.cc:276] 0709 13:17:04.399887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.402268 (+  2381us) service_pool.cc:224] Handling call
0709 13:17:04.402608 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.403002 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.403038 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.403621 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.927985 (+524364us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:04.928040 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.928139 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.533761 (+605622us) raft_consensus.cc:1685] finished
0709 13:17:05.533785 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.533924 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":523901,"threads_started":1,"wal-append.queue_time_us":740554}
W20260709 13:17:05.543080  8915 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.002s	sys 0.010s
I20260709 13:17:05.559142  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:05.559378  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:05.560042  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:05.561201  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:05.558197 12726 consensus_meta.cc:287] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.004s
I20260709 13:17:05.562676  8762 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.5-12.5]
I20260709 13:17:05.553056  8909 rpcz_store.cc:276] 0709 13:17:04.024251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.054153 (+ 29902us) service_pool.cc:224] Handling call
0709 13:17:04.054691 (+   538us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:04.055220 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.055277 (+    57us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:04.066700 (+ 11423us) log.cc:844] Serialized 52 byte log entry
0709 13:17:04.531103 (+464403us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:04.957862 (+426759us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.357070 (+399208us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b24001f50c8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccebfb0 00007fce6f962488 00007fce6f962be8 00007fce6f93a398 00007fce6f93576a 00007fce6f934bb6
0709 13:17:05.403699 (+ 46629us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b1800118c60. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce737923c7 00007fce6fda49a7 00007fce6fdb40bf 00007fce6fdb4038
0709 13:17:05.403976 (+   277us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.498638 (+ 94662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.498718 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.498853 (+   135us) raft_consensus.cc:1685] finished
0709 13:17:05.498874 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.499038 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":524243,"prepare.queue_time_us":955352,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":85,"raft.queue_time_us":117108,"raft.run_cpu_time_us":449,"raft.run_wall_time_us":61464,"spinlock_wait_cycles":10240512,"thread_start_us":851882,"threads_started":2,"wal-append.queue_time_us":664722}
I20260709 13:17:05.522634 12815 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:05.554330 12850 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:05.570335  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.570674  8765 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:05.565781  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:05.574716  8666 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:05.577003  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:05.577266 12932 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.579346  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:05.586763  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:05.589207  8767 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:05.569985  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:05.590322  8915 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.003s	sys 0.010s
I20260709 13:17:05.592749  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:05.593552  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.590962  8769 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.652277  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:05.578485 12916 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:05.652981  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:05.590713  8766 raft_consensus.cc:2368] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:05.590947  8761 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:05.517928 12784 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.692191 12835 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:05.536445 12867 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.654745 12726 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11.
I20260709 13:17:05.856722  8666 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:05.697197  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:05.857679  8768 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:05.930516  8760 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:05.701251  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:05.845005  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 312075us
W20260709 13:17:05.701877 12914 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.186s	user 0.002s	sys 0.010s
I20260709 13:17:05.554961 12844 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:05.709045 12888 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:17:05.563961 12911 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.709795 12434 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.589573 12920 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:05.690407 12901 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.575232 12722 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:05.574348 12774 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.209s
I20260709 13:17:05.563836 12781 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.903832  8808 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.122.126:41961, user_credentials={real_user=slave}} blocked reactor thread for 45059.6us
I20260709 13:17:05.861913  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:05.845484  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.856648  8910 raft_consensus.cc:2368] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
I20260709 13:17:05.845721  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:05.857102  8762 raft_consensus.cc:2368] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
I20260709 13:17:05.976346  8838 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:05.976621  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:05.848145  8765 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:05.853943  8916 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:05.977818  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.844827  8843 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:05.912840  8769 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:05.914090  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76884.3us
I20260709 13:17:05.918624  8761 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:17:05.982059  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 470314us
I20260709 13:17:05.919726  8763 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:05.929826  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.929678  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:05.933063  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:05.934978  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:05.885733  8909 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:05.935640  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:05.838338 12665 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:05.937767  8844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.011s	sys 0.025s
I20260709 13:17:05.940461  8666 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 8 to 9, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:05.942754  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:05.850745 12750 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:05.904083 12866 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:05.949168 12835 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:05.931941 12921 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.086s	user 0.004s	sys 0.001s
W20260709 13:17:05.960628  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 390699us
I20260709 13:17:05.962698 12751 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.013834  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:05.962908  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:06.014429  9459 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
W20260709 13:17:06.015163  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 52347us
I20260709 13:17:05.850600 12850 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:05.992923 12917 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:17:06.021061 12735 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:05.986109 12726 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.021234 12850 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.021838 12726 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.023788 12850 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.025189  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1950) took 2032 ms. Trace:
I20260709 13:17:06.025029 12751 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.025492 12836 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.015256 12773 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:06.025571  8911 rpcz_store.cc:276] 0709 13:17:03.992733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.993043 (+   310us) service_pool.cc:224] Handling call
0709 13:17:04.014094 (+ 21051us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.014517 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.014557 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.021092 (+  6535us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.693150 (+672058us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.142692 (+449542us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.305113 (+162421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.305210 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.022734 (+717524us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b24001f50c8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccebfb0 00007fce6f962488 00007fce6f962be8 00007fce6f93a398 00007fce6f93576a 00007fce6f934bb6
0709 13:17:06.024907 (+  2173us) raft_consensus.cc:1685] finished
0709 13:17:06.025000 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.025122 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13539,"prepare.queue_time_us":713830,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":65552,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":46187,"spinlock_wait_cycles":13241088,"thread_start_us":1195102,"threads_started":3,"wal-append.queue_time_us":764213}
I20260709 13:17:06.029263 12722 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:05.941672 12918 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.257s	user 0.000s	sys 0.009s
I20260709 13:17:06.030282 12722 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:05.994874  8652 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 74de73c0f36d4c3aa7a483c7fdb39e4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:17:06.032477  8652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75734.8us
I20260709 13:17:05.977723  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:05.994468  8837 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:05.991715  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1957) took 1749 ms. Trace:
I20260709 13:17:06.028678  8911 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.841293 12843 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:05.988185  8844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.012s	sys 0.025s
I20260709 13:17:05.994309  8913 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:05.997699  8916 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:06.044812  8916 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:05.957554  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 376169us
W20260709 13:17:06.047617 12937 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:17:06.048720 12905 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.726s	user 0.000s	sys 0.011s
I20260709 13:17:06.003037  8909 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:17:06.060261  8909 pending_rounds.cc:85] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:17:06.060731  8909 pending_rounds.cc:107] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:06.009428  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:06.049036  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:06.061072  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:05.971982 12941 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.012565  8808 leader_election.cc:400] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:06.001191 12781 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.986035 12929 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:06.017493 12930 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.017603 12922 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:06.018872 12906 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.667s	user 0.005s	sys 0.005s
I20260709 13:17:05.995299 12665 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:06.001495 12866 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:06.049402 12843 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.019817 12851 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.019315  8666 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 10 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.020232 12750 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:05.980080 12920 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.010672 12732 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:05.862465 12932 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:05.957880 12815 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.4, Last appended by leader: 4, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.968888 12911 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.028932 12835 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:05.964264  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1807) took 2566 ms. Trace:
I20260709 13:17:05.859295 12854 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.034897  8915 rpcz_store.cc:276] 0709 13:17:04.242402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.243203 (+   801us) service_pool.cc:224] Handling call
0709 13:17:04.243631 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.289193 (+ 45562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.289224 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.289844 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.919399 (+629555us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:05.862548 (+943149us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.991390 (+128842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.991468 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.991506 (+    38us) raft_consensus.cc:1685] finished
0709 13:17:05.991518 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.991659 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140396,"prepare.queue_time_us":488652,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":143720,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":1483202,"threads_started":2,"wal-append.queue_time_us":862023}
W20260709 13:17:05.995409  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 429777us
W20260709 13:17:06.032788  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.994728  8869 heartbeater.cc:646] Failed to heartbeat to 127.7.122.126:41961 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.122.126:41961 timed out after 15.000s (SENT)
I20260709 13:17:06.025985 12844 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.002600  8914 raft_consensus.cc:1217] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Deduplicated request from leader. Original: 6.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:17:06.191875  8914 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:17:06.061390  8910 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.192605  8912 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.061076  8909 raft_consensus.cc:2889] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:05.913427 12787 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:17:06.070544 12778 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:06.071465 12925 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:06.073045 12713 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:06.073328  8916 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:17:06.074169 12908 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.579s	user 0.005s	sys 0.005s
I20260709 13:17:06.032536 12865 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.075892  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1954) took 1979 ms. Trace:
W20260709 13:17:06.078918  8843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 1966) took 1616 ms (client timeout 1612 ms). Trace:
I20260709 13:17:06.081099  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.081830  8808 leader_election.cc:403] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.017627 12845 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.100623  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.220609  8838 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:17:06.220723  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 208341us
I20260709 13:17:06.220847  8840 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:17:06.220364  8843 rpcz_store.cc:269] 0709 13:17:04.462666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.483674 (+ 21008us) service_pool.cc:224] Handling call
0709 13:17:06.078696 (+1595022us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540021d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:06.078837 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300789632}
I20260709 13:17:06.221828  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.221995  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.100627  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.223680  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.224311  8835 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:06.224166 12865 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:06.108260  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.225081  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:05.992324 12820 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:17:06.019353 12863 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:06.149966  8839 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.149833  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.234104  8837 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
W20260709 13:17:06.151469  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47213.3us
W20260709 13:17:06.151424  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51947.5us
I20260709 13:17:06.098865 12836 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.097848 12852 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.178894  8764 rpcz_store.cc:276] 0709 13:17:03.398237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.398417 (+   180us) service_pool.cc:224] Handling call
0709 13:17:03.398881 (+   464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.818518 (+419637us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:04.159153 (+340635us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.114489 (+955336us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.115230 (+   741us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.115398 (+   168us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.115445 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.115542 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.964044 (+848502us) raft_consensus.cc:1685] finished
0709 13:17:05.964066 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.964200 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55721,"prepare.queue_time_us":58770,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":260058,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":222,"thread_start_us":1563216,"threads_started":3,"wal-append.queue_time_us":939073}
I20260709 13:17:06.088917 12759 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.193676  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1801) took 1132 ms. Trace:
I20260709 13:17:06.110625 12726 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.150957 12850 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.103381 12922 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.193221  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:06.166682 12893 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:06.209950  9466 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:06.211365  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1818) took 1146 ms. Trace:
I20260709 13:17:06.337282  8916 rpcz_store.cc:276] 0709 13:17:05.064842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.072656 (+1007814us) service_pool.cc:224] Handling call
0709 13:17:06.073000 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.211091 (+138091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.211308 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.209138  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:06.116039 12929 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:06.225056  8666 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 10, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 10 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:06.225962  8843 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:06.226619  8840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:06.344049  8840 raft_consensus.cc:606] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:06.344501  8840 raft_consensus.cc:614] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:06.304199 12931 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.293s
I20260709 13:17:06.225241  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.346326  8835 raft_consensus.cc:2410] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:06.229319  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:06.231048  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:06.347906  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 116917us
I20260709 13:17:06.218427  8917 rpcz_store.cc:276] 0709 13:17:04.096418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.096535 (+   117us) service_pool.cc:224] Handling call
0709 13:17:04.096944 (+   409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:04.130143 (+ 33199us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:04.824551 (+694408us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.105989 (+281438us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:05.106722 (+   733us) log.cc:844] Serialized 52 byte log entry
0709 13:17:05.106909 (+   187us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:05.407188 (+300279us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.516581 (+109393us) log.cc:844] Serialized 14 byte log entry
0709 13:17:05.516980 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.517048 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.850697 (+333649us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:05.858514 (+  7817us) spinlock_profiling.cc:243] Waited 5.73 ms on lock 0x7b180008cf80. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:06.075659 (+217145us) raft_consensus.cc:1685] finished
0709 13:17:06.075682 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.075832 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649956,"prepare.queue_time_us":1179809,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":117,"raft.queue_time_us":154795,"raft.run_cpu_time_us":715,"raft.run_wall_time_us":102529,"spinlock_wait_cycles":91495424,"thread_start_us":931856,"threads_started":2,"wal-append.queue_time_us":417107}
I20260709 13:17:06.082094 12774 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:17:06.102842 12727 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:17:06.357192  8666 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:06.359022  8666 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 13 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:06.177788 12732 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:06.242988  8912 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:06.234324  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:06.326802 12867 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.248834  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1937) took 1653 ms. Trace:
I20260709 13:17:06.248464  8909 rpcz_store.cc:276] 0709 13:17:05.061224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.999117 (+937893us) service_pool.cc:224] Handling call
0709 13:17:05.999425 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.193361 (+193936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.193593 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.248971  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:06.250860  8838 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.386023  8838 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:06.110865 12930 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.192171 12751 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.271303 12864 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.209534 12802 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:06.272135  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:06.215593 12925 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.277320  8910 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:06.097146 12941 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:06.293640  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.405035  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:06.305692 12945 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:06.306339 12901 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:06.308460  8836 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:06.309156  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 116020us
I20260709 13:17:06.310561 12576 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:06.311147 12928 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.312419 12908 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:06.313522 12781 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.200917 12854 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.191671 12851 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.241180 12836 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.315243 12787 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.317018 12920 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:06.419023 12901 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:06.436412 12915 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:06.281240 12922 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:06.437510  8768 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:06.438853 12576 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:06.436141 12901 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.439859 12576 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.272006 12820 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:06.333770  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1812) took 1270 ms. Trace:
I20260709 13:17:06.441461  8913 rpcz_store.cc:276] 0709 13:17:05.063587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.043989 (+980402us) service_pool.cc:224] Handling call
0709 13:17:06.044355 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.044601 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:06.059147 (+ 14546us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.332591 (+273444us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.332952 (+   361us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:06.333211 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.333354 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.333526 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37304,"prepare.queue_time_us":34464,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":9956,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9899,"thread_start_us":272180,"threads_started":1}
I20260709 13:17:06.440840 12901 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.443388 12820 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:06.278954  8837 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:06.446236 12787 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.447532  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.448166  8763 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:06.340189  8839 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:17:06.279628 12850 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.246701  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:06.228210 12665 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.331115 12940 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.388792  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 154498us
I20260709 13:17:06.465047  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:06.464690 12940 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.467414  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:06.397207  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1821) took 1271 ms. Trace:
I20260709 13:17:06.377204  8842 rpcz_store.cc:276] 0709 13:17:04.595348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.822920 (+227572us) service_pool.cc:224] Handling call
0709 13:17:04.823350 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.829233 (+  5883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.829267 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.837115 (+  7848us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.156367 (+319252us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:05.156408 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.156474 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.699111 (+542637us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:06.237482 (+538371us) raft_consensus.cc:1685] finished
0709 13:17:06.237511 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.248768 (+ 11257us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":253889,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":23500,"spinlock_wait_cycles":61953408,"thread_start_us":279292,"threads_started":1,"wal-append.queue_time_us":499891}
I20260709 13:17:06.468417  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:06.394164  9467 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:06.469477  8768 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.392251  8838 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.469177 12732 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.470270  8838 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:06.470741 12952 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:06.425014 12864 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:06.399343  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1803) took 1337 ms. Trace:
I20260709 13:17:06.406476  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.473598  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:06.473186 12864 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.407011  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.474120  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:06.474651 12935 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.475123 12935 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.473016  8914 rpcz_store.cc:276] 0709 13:17:05.061669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.995871 (+934202us) service_pool.cc:224] Handling call
0709 13:17:05.996165 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.192326 (+196161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.398236 (+205910us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b54003bd420. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd11dc0 00007fce6fd9da02 00007fce6fd99dd6 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:17:06.399094 (+   858us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b54000384d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:06.399266 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96321280}
I20260709 13:17:06.475541 12935 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:06.475440 12781 consensus_queue.cc:1175] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:17:06.412565  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 163699us
I20260709 13:17:06.401785 12802 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:06.477006  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.477383 12951 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.477944 12951 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.478705 12802 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.479292  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:06.468226  8910 rpcz_store.cc:276] 0709 13:17:05.125912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.976005 (+850093us) service_pool.cc:224] Handling call
0709 13:17:06.397137 (+421132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:06.479921  8837 raft_consensus.cc:606] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:06.480162 12951 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.480379  8837 raft_consensus.cc:614] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:06.480844 12665 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.409313  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.415498 12933 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:06.483999 12933 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:06.484419 12933 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.283442 12866 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.313576 12750 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.412983 12784 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.417554 12792 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:06.448589 12836 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.433449  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:06.504067  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:06.273118 12863 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:06.293112  9460 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:06.504666  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71418.4us
I20260709 13:17:06.356350 12893 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.418509 12932 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.457342  8762 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:06.463344  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.467654 12940 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.433135 12928 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.546527 12928 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.410778  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.546216 12781 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:06.547607  8765 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:06.402196 12925 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:06.548131 12781 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.548962 12781 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:06.549639 12854 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.549873 12781 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.551195 12781 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.551638 12851 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.414153  8666 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 7, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:06.416503 12941 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:06.493057  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.493208  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.557758  8842 raft_consensus.cc:2410] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:06.558213  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.558619  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.559183 12930 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.559504  8842 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:06.560035 12930 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.493826  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.561225  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:06.494876  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:06.562563 12850 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.395253 12867 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.499384  8768 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:06.505018  8837 raft_consensus.cc:606] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:06.572750  8837 raft_consensus.cc:614] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:06.485656 12926 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:06.452059  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:06.518728  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 409731us
I20260709 13:17:06.490907 12931 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.541477 12778 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:06.541687  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:06.543548 12802 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:06.460304 12929 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.561627  8835 raft_consensus.cc:2410] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:06.561946  9464 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:06.560539 12930 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.562103 12928 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.573664  8838 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:06.505867 12751 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:06.517341 12866 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:06.574365  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 225208us
I20260709 13:17:06.505453 12951 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.580193  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:06.582266  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.579394  9467 raft_consensus.cc:2376] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11. Re-sending same reply.
I20260709 13:17:06.561285 12787 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.531461 12792 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:06.606076  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 163100us
W20260709 13:17:06.680855  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.681452  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.682220  8763 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:06.577479 12926 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.684410  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:06.678932  8844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.014s	sys 0.039s
I20260709 13:17:06.637336  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:06.690659  8844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.039s
I20260709 13:17:06.691085  8765 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:17:06.691509  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1974) took 1562 ms. Trace:
I20260709 13:17:06.663479  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:06.692463  9459 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:06.665875  8912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1811) took 1602 ms (client timeout 1779 ms). Trace:
W20260709 13:17:06.693499  8912 rpcz_store.cc:269] 0709 13:17:05.063382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.540455 (+477073us) service_pool.cc:224] Handling call
0709 13:17:06.665616 (+1125161us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54001d4554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:06.665794 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386665728}
I20260709 13:17:06.572249 12867 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.633909  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:06.704475  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 133137us
I20260709 13:17:06.671897  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:06.578589 12931 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:06.635802  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.706915  8769 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:17:06.707329  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.696985 12970 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:06.708527  8769 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:06.691901  8844 rpcz_store.cc:276] 0709 13:17:05.129109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.310325 (+181216us) service_pool.cc:224] Handling call
0709 13:17:05.310902 (+   577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.311305 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.311339 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.311922 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.043572 (+731650us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:06.102846 (+ 59274us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.691177 (+588331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.691263 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.691306 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:06.691319 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.691452 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1482,"prepare.queue_time_us":71892,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":636,"raft.queue_time_us":65606,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":20361,"spinlock_wait_cycles":1387392,"thread_start_us":1319299,"threads_started":2,"wal-append.queue_time_us":1049700}
I20260709 13:17:06.517904 12922 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.710547 12951 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.689424 12926 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:06.619707 12751 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:06.571954 12863 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.662458 12434 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.617690 12850 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.679289 12722 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:06.633730 12920 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.789350  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:06.790372  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:06.791290  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:06.822229  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.823884  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.820662  8909 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:06.825277  8909 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:06.793147  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.799366  8913 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:06.827239  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.688241 12787 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:06.830035  9461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54286 (request call id 565) took 1275 ms. Trace:
I20260709 13:17:06.719362 12867 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.811137  8914 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:06.636715 12928 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.818593  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 544) took 1225 ms. Trace:
I20260709 13:17:06.853250  9466 rpcz_store.cc:276] 0709 13:17:05.627506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.685548 (+ 58042us) service_pool.cc:224] Handling call
0709 13:17:06.818406 (+1132858us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54004637d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:06.818523 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635145472}
I20260709 13:17:06.854022  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.811630 12751 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:06.818102 12950 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:06.855249  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.873185  8913 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:06.840425  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.874598  8916 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:06.855880  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.834832  9461 rpcz_store.cc:276] 0709 13:17:05.539691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.539895 (+   204us) service_pool.cc:224] Handling call
0709 13:17:05.540197 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.837382 (+297185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.837414 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.868579 (+ 31165us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.099941 (+231362us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:06.354710 (+254769us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.355086 (+   376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.799498 (+444412us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54005f0354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:06.799551 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.799594 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:06.814516 (+ 14922us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.814699 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183193,"prepare.queue_time_us":464403,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":183403,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":86353,"spinlock_wait_cycles":260912896,"thread_start_us":339870,"threads_started":2,"wal-append.queue_time_us":358686}
I20260709 13:17:06.769176 12713 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:06.861330  8917 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:06.867549  8760 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:06.882041  8917 pending_rounds.cc:85] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 5
W20260709 13:17:06.868197  8911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.029s	sys 0.033s
I20260709 13:17:06.838477  8909 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.882449  8917 pending_rounds.cc:107] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:06.882858  8917 raft_consensus.cc:2889] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.882900  8909 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.876721  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.884606  8912 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
W20260709 13:17:06.885721  8911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.029s	sys 0.033s
I20260709 13:17:06.903982  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.905139  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.914992  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.933605  8909 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:06.937098  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.939134  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.940718  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.943130  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.944144  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.945086  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1829) took 1382 ms. Trace:
W20260709 13:17:06.950011  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 265675us
W20260709 13:17:06.951280  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 243404us
I20260709 13:17:06.953399  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:06.951828  8808 leader_election.cc:400] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
I20260709 13:17:06.955662  8808 leader_election.cc:403] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.841079 12920 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.957306  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:06.918920 12727 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:06.830813 12434 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.834322 12722 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.917913 12773 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.960614  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:06.964255  8844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:06.854291 12787 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.851193 12850 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:06.970535  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:06.991021  8917 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:06.992923  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:06.993455  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:06.996109  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:06.982378  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.974906  8844 raft_consensus.cc:606] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:06.998905  8844 raft_consensus.cc:614] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:07.000036  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.000880  8844 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:07.009267 12962 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:07.010061 12962 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:07.014395 12960 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 13:17:07.016158 12953 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.316s	user 0.001s	sys 0.000s
I20260709 13:17:07.018260 12919 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.018953 12919 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:07.021847 12956 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:07.023129 12893 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:06.970839 12727 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.027063 12727 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:07.027832  8912 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:07.030166 12920 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:06.943327 12931 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.034309 12787 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:07.039808  8836 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:06.937268 12792 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:07.041462  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.053290  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:07.057361  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61563.8us
W20260709 13:17:06.998174 12665 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.001s
I20260709 13:17:07.065717  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:07.074658  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.130563  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72412.4us
I20260709 13:17:07.131356  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:07.132102  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 176852us
I20260709 13:17:07.135954  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.006119 12565 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:07.079505 12781 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.506s	user 0.012s	sys 0.000s
I20260709 13:17:07.007329 12784 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.184309  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:07.109277 12787 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.066365 12844 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:07.200350  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:07.189810  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58439.1us
I20260709 13:17:07.008093 12750 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.184s
I20260709 13:17:07.120548 12850 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:06.998588 12773 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.119040 12919 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:07.125257 12962 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:07.276880 12925 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.728s	user 0.006s	sys 0.006s
I20260709 13:17:07.281091 12959 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.214s
I20260709 13:17:07.282001 12944 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.239s
I20260709 13:17:07.068149 12956 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:07.291782 12951 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.292281 12893 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.292974  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.293414  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:07.412755  8841 raft_consensus.cc:606] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:07.413156  8841 raft_consensus.cc:614] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:07.414115  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.120112 12985 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
W20260709 13:17:07.307945 12963 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 13:17:07.308478 12970 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:07.308784  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:07.308014  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.315488 12972 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.431499  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:07.320214 12926 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.002s
I20260709 13:17:07.321987 12434 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:07.297091 12922 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:07.334817 12901 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.891s	user 0.010s	sys 0.000s
I20260709 13:17:07.337163 12911 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.341825 12835 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.353353  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.460448  8914 raft_consensus.cc:2376] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8. Re-sending same reply.
I20260709 13:17:07.354426 12896 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:07.355655  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.250743 12787 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.366315  8918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1816) took 2301 ms (client timeout 1601 ms). Trace:
W20260709 13:17:07.377360  8839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 445) took 1401 ms (client timeout 1683 ms). Trace:
W20260709 13:17:07.471705  8918 rpcz_store.cc:269] 0709 13:17:05.064425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.428895 (+364470us) service_pool.cc:224] Handling call
0709 13:17:07.366009 (+1937114us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b5400319f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:07.366214 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988247808}
W20260709 13:17:07.471982  8839 rpcz_store.cc:269] 0709 13:17:05.976159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.976389 (+   230us) service_pool.cc:224] Handling call
0709 13:17:07.377133 (+1400744us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b5400415354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:07.377294 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396970240}
I20260709 13:17:07.390856 12928 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:07.248543 12727 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 13:17:07.410988 12941 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:17:07.413380  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:07.422034  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.484181  8841 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:07.406526 12665 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.399207 12721 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:07.435859  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.491700  8917 raft_consensus.cc:2376] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11. Re-sending same reply.
I20260709 13:17:07.493175  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.437870  8913 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:07.301966 12844 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:07.423434 12836 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.880s	user 0.009s	sys 0.002s
I20260709 13:17:07.453781 12865 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.411233 12925 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:07.455020 12970 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.456619  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1806) took 2394 ms. Trace:
I20260709 13:17:07.425069 12815 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:07.468065  8809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.000s	sys 0.045s
W20260709 13:17:07.530437  8809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.840s	user 0.000s	sys 0.046s
I20260709 13:17:07.380151  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:07.473788  8843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.018s	sys 0.028s
W20260709 13:17:07.531998  8843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.019s	sys 0.028s
I20260709 13:17:07.485155 12985 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:07.532788  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1956) took 1325 ms. Trace:
I20260709 13:17:07.474341  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.402135 12849 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.482223  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.436498 12972 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.484340  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 71090.3us
I20260709 13:17:07.485512  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:07.484827  8835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.021s	sys 0.045s
W20260709 13:17:07.473132 12854 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.004s	sys 0.041s
I20260709 13:17:07.428086 12893 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:07.454707 12933 consensus_meta.cc:287] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.970s	user 0.012s	sys 0.000s
I20260709 13:17:07.478951 12787 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.518944  8762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.000s	sys 0.013s
W20260709 13:17:07.587623  8762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.001s	sys 0.013s
W20260709 13:17:07.528014  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.507970  8911 rpcz_store.cc:276] 0709 13:17:05.062329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.042866 (+980537us) service_pool.cc:224] Handling call
0709 13:17:06.051924 (+  9058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.164353 (+112429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.164405 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.181460 (+ 17055us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.886335 (+704875us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:06.941934 (+ 55599us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.946278 (+  4344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.946382 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.456383 (+510001us) raft_consensus.cc:1685] finished
0709 13:17:07.456404 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.456543 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73100,"prepare.queue_time_us":55606,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3171,"raft.queue_time_us":69795,"raft.run_cpu_time_us":981,"raft.run_wall_time_us":34673,"spinlock_wait_cycles":46464,"thread_start_us":634064,"threads_started":1,"wal-append.queue_time_us":1227339}
I20260709 13:17:07.538981  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.589476  8837 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:07.539237  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.491205 12721 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:07.491751 12835 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:07.457978 12863 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:07.439002 12926 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:07.599867  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.565609 12969 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:17:07.535856  8843 rpcz_store.cc:276] 0709 13:17:06.207162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.343129 (+135967us) service_pool.cc:224] Handling call
0709 13:17:06.343453 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.343667 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:06.358014 (+ 14347us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.532410 (+1174396us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.532462 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:07.532526 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.532589 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.532717 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17253,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2969,"raft.queue_time_us":234704,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":28760,"thread_start_us":1173904,"threads_started":2,"wal-append.queue_time_us":426877}
I20260709 13:17:07.530129 12836 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.576936 12972 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.573345 12970 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.478049 12896 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.598872 12835 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.541509  8918 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
W20260709 13:17:07.578653  8835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.029s	sys 0.050s
W20260709 13:17:07.627310  8840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.063s	user 0.005s	sys 0.031s
W20260709 13:17:07.627770  8840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.005s	sys 0.031s
I20260709 13:17:07.627859  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1990) took 1090 ms. Trace:
I20260709 13:17:07.581344  9459 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:07.582626  8838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.009s	sys 0.051s
W20260709 13:17:07.629236  8838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.009s	sys 0.051s
I20260709 13:17:07.583295  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.632061  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1991) took 1094 ms. Trace:
I20260709 13:17:07.628233  8835 rpcz_store.cc:276] 0709 13:17:06.537686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.603326 (+ 65640us) service_pool.cc:224] Handling call
0709 13:17:06.603664 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.603896 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:06.683718 (+ 79822us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.627493 (+943775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.627545 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.627589 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.627656 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.627801 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166245,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":11971,"raft.queue_time_us":1800,"thread_start_us":943417,"threads_started":1}
I20260709 13:17:07.632735  8838 rpcz_store.cc:276] 0709 13:17:06.538021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.611357 (+ 73336us) service_pool.cc:224] Handling call
0709 13:17:06.611746 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.612011 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:06.958216 (+346205us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.631543 (+673327us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.631632 (+    89us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.631717 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.631807 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.631974 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73200,"prepare.queue_time_us":165975,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":51,"thread_start_us":858914,"threads_started":2}
I20260709 13:17:07.633966  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.635010  8835 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:07.635030  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.636293  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:07.544481 12843 consensus_meta.cc:287] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.362s	user 0.015s	sys 0.000s
I20260709 13:17:07.495298 12665 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:07.581867 12854 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.005s	sys 0.042s
W20260709 13:17:07.586118 12751 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.683s	user 0.012s	sys 0.000s
I20260709 13:17:07.602823  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.621680 12944 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.570865 12925 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.613101  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.615315  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.645929  8835 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:07.648252  8837 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:07.631623 12781 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.596257 12933 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:07.654955  8808 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.014s	sys 0.026s
I20260709 13:17:07.649953  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:07.655313  8808 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.014s	sys 0.026s
I20260709 13:17:07.590884  8839 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:17:07.630218  8841 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:07.640336  8767 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:07.590058 12956 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.641557  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.541052 12849 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:07.643456  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.568257  8809 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:07.630442 12844 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.645720  8843 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:07.621802 12940 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.617726  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1835) took 1153 ms. Trace:
I20260709 13:17:07.614537 12974 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:07.649619  8917 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.648291  8911 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:07.628734  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1986) took 1093 ms. Trace:
I20260709 13:17:07.650897  8838 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:07.630342 12835 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.653005  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.590358 12985 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:07.642220 12721 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:07.747633  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 754423us
W20260709 13:17:07.656401  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 362889us
I20260709 13:17:07.749478  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.750694  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:07.680548 12981 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.192s	user 0.001s	sys 0.002s
W20260709 13:17:07.661751 12866 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.982s	user 0.009s	sys 0.004s
I20260709 13:17:07.754002 12941 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.754154 12926 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.754519 12941 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.755475 12896 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:07.757316 12836 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.757882 12933 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:07.758785  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:07.759030 12995 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:07.758800 12941 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.759444  8914 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:07.656775 12893 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:07.760394  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.761849 12982 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:07.762346 12982 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:07.762738 12982 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:07.763098  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.763618  8841 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:07.763726  8913 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:07.764225  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 196678us
I20260709 13:17:07.764824  8914 raft_consensus.cc:2376] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
W20260709 13:17:07.657614  8844 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.011s
I20260709 13:17:07.767966  8837 raft_consensus.cc:2410] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 13:17:07.676258  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.747557  8762 rpcz_store.cc:276] 0709 13:17:06.464456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.532209 (+ 67753us) service_pool.cc:224] Handling call
0709 13:17:06.532491 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.532720 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:06.877804 (+345084us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.617351 (+739547us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.617410 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:07.617454 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.617529 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.617663 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29150,"prepare.queue_time_us":425604,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":8373,"raft.queue_time_us":41704,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":9113,"thread_start_us":1044427,"threads_started":2,"wal-append.queue_time_us":778397}
W20260709 13:17:07.769022  8844 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.005s	sys 0.011s
W20260709 13:17:07.676255  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 472583us
I20260709 13:17:07.770526  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:07.771109  8762 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.747586  8840 rpcz_store.cc:276] 0709 13:17:06.535205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.563022 (+ 27817us) service_pool.cc:224] Handling call
0709 13:17:06.563406 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.563632 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:06.563978 (+   346us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.628395 (+1064417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:07.628447 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:07.628486 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.628575 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.628683 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135816,"prepare.queue_time_us":8303,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":1172,"spinlock_wait_cycles":5193856,"thread_start_us":1063868,"threads_started":1}
W20260709 13:17:07.772794  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.688604  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:07.772470  8843 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:07.775389  9463 raft_consensus.cc:2410] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:07.790760  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:07.654053 12935 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.178s	user 0.004s	sys 0.012s
I20260709 13:17:07.792316  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:07.787871  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:07.790001  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.796731  8844 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:07.796615  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.797091  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:07.797472  8913 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.797684  8914 raft_consensus.cc:2376] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12. Re-sending same reply.
I20260709 13:17:07.798574  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.798359  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.800730  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:07.805718  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.682711 12773 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:07.647151 12843 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.813532  8912 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:07.808213  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1973) took 1011 ms. Trace:
I20260709 13:17:07.813673  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.650799 12751 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.817924  8911 rpcz_store.cc:276] 0709 13:17:06.796489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.798027 (+1001538us) service_pool.cc:224] Handling call
0709 13:17:07.808130 (+ 10103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:07.819456  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.818011  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:07.820096  8918 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:07.787691 12975 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:07.828079  8914 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:07.829048  8911 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:07.833604  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1968) took 1045 ms. Trace:
I20260709 13:17:07.802603 12893 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:07.787897 12974 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.819914 12434 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:07.802870 12935 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.796788 12721 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.835245  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 1979) took 1027 ms. Trace:
I20260709 13:17:07.855953  8918 rpcz_store.cc:276] 0709 13:17:06.807976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.796512 (+988536us) service_pool.cc:224] Handling call
0709 13:17:07.835179 (+ 38667us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:07.849452  8769 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:07.816350 12844 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.809000 12925 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:07.833972  8911 rpcz_store.cc:276] 0709 13:17:06.788632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.822720 (+1034088us) service_pool.cc:224] Handling call
0709 13:17:07.823045 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.833322 (+ 10277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.833541 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:07.803177 12986 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:07.866075  8917 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:07.851851 12991 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:07.828051 12735 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.867255  8913 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:07.654125 12944 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:07.869269  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:07.872131  8918 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:07.872386  8844 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
W20260709 13:17:07.869961  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.870638  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:07.848932 12434 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:07.873395  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 306956us
I20260709 13:17:07.876510  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1972) took 1080 ms. Trace:
I20260709 13:17:07.849345 12974 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.879407  8914 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:07.879029  8918 rpcz_store.cc:276] 0709 13:17:06.796199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.856619 (+1060420us) service_pool.cc:224] Handling call
0709 13:17:07.871703 (+ 15084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.872702 (+   999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.876437 (+  3735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:07.880070  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1978) took 1082 ms. Trace:
I20260709 13:17:07.880599  8914 rpcz_store.cc:276] 0709 13:17:06.797938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.856940 (+1059002us) service_pool.cc:224] Handling call
0709 13:17:07.873251 (+ 16311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.879822 (+  6571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.880016 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:07.878813  8807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.892s (SENT) [suppressed 28 similar messages]
I20260709 13:17:07.882151  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:07.870153 12867 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.995s	user 0.014s	sys 0.001s
I20260709 13:17:07.905411  8913 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:07.906476  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 413) took 1006 ms. Trace:
I20260709 13:17:07.906915  8913 rpcz_store.cc:276] 0709 13:17:06.899921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.874654 (+974733us) service_pool.cc:224] Handling call
0709 13:17:07.905162 (+ 30508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.906085 (+   923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.906397 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:07.908900  8765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.016s	sys 0.019s
W20260709 13:17:07.875378 12792 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.014s	sys 0.019s
I20260709 13:17:07.869514  8656 maintenance_manager.cc:419] P bea3bb54fdd140bfadbad5c24f3a0fa7: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033357
W20260709 13:17:07.912885  8765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.017s	sys 0.019s
I20260709 13:17:07.869100 12943 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:07.916673  8760 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:07.916129 12792 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.015s	sys 0.019s
I20260709 13:17:07.918666  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:07.852185 12893 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.878644 12434 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:07.920290  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:07.886780 12866 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:07.922576  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.916579  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:07.879346 12735 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:07.917017 12993 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:17:07.913261 12665 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:07.910288 12992 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.918071  8918 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:07.981132  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 64633.6us
W20260709 13:17:07.988617  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 68412.7us
I20260709 13:17:07.922500 12928 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.942322 12836 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:07.911917 12867 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.993028  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:07.989691  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:07.994480  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 190198us
I20260709 13:17:07.878026 12986 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.976022 12989 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.035774  8836 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: [10.5-10.5]
W20260709 13:17:08.037034  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.021366  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:08.036002 12999 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.051440 12999 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:08.051700 13001 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.052102 12999 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.052809 12994 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.053303 12994 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:07.937677 12723 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 12.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:17:08.065215  8768 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:08.038519  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47356.8us
I20260709 13:17:08.066496  8882 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:08.068813  9460 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 546) took 2192 ms (client timeout 1640 ms). Trace:
I20260709 13:17:08.057160  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:08.063215  9431 connection.cc:256] RPC call timeout handler was delayed by -1.2205877509998118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
I20260709 13:17:08.070967  8761 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:08.071111  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.071676  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1833) took 1607 ms. Trace:
I20260709 13:17:08.072028  8761 rpcz_store.cc:276] 0709 13:17:06.463806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.070410 (+1606604us) service_pool.cc:224] Handling call
0709 13:17:08.070791 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.071405 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.071601 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.073122  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:08.040537 12956 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.976816 12943 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:07.986642 12866 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:08.069331  9460 rpcz_store.cc:269] 0709 13:17:05.861501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.861656 (+   155us) service_pool.cc:224] Handling call
0709 13:17:08.053872 (+2192216us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b54004c72d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:08.053995 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705556224}
I20260709 13:17:08.080384  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:08.073797  8761 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.085776  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:08.053694 12994 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.069983 12792 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:07.997056 12992 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.097477  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:08.098166 13001 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.019805 12928 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.102270  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:08.097249  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:08.037070 12836 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.107887 12986 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.108098 12992 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.087550 12781 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:08.108793  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1829) took 1649 ms. Trace:
I20260709 13:17:08.081928 12925 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:08.126685  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:08.112643  8762 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
I20260709 13:17:08.081825 12732 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:08.100725  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1832) took 1637 ms. Trace:
I20260709 13:17:08.142338  8764 rpcz_store.cc:276] 0709 13:17:06.463446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.099848 (+1636402us) service_pool.cc:224] Handling call
0709 13:17:08.100213 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.100408 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.100434 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.100480 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:08.100514 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.100566 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.100672 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.144034  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.092979 12576 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:08.117774  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:08.088092 12843 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.054159 12989 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:08.157516 13003 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:17:08.158981 12989 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.118844 12792 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:08.127542 13005 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:17:08.123669 12781 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:08.187556 12781 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:08.188141  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:08.189368  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.190583  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.191197 12735 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.191699  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.192425  8761 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:08.129838 12997 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.192638 12893 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.123344 12933 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:08.133374 12988 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:08.194352 12933 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.096982 12751 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.124135  8767 rpcz_store.cc:276] 0709 13:17:06.459207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.459376 (+   169us) service_pool.cc:224] Handling call
0709 13:17:06.459761 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.772356 (+1312595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.108505 (+336149us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400379454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:08.108696 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2714617088}
I20260709 13:17:08.104390 12985 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:08.197479  8843 raft_consensus.cc:2376] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7. Re-sending same reply.
I20260709 13:17:08.135450  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:08.138587  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:08.198931  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 63536.3us
I20260709 13:17:08.199512  8762 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:08.199766  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:08.200176  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1844) took 1213 ms. Trace:
I20260709 13:17:08.200017 12792 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.200486  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.200593  8762 rpcz_store.cc:276] 0709 13:17:06.987214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.199029 (+1211815us) service_pool.cc:224] Handling call
0709 13:17:08.199333 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.199937 (+   604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.200115 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:08.201301 12985 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:08.201864  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.202033 12997 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.202549  8840 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:08.111245 12970 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:08.203545  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.203703 12970 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:08.201876 12985 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:08.204787 12970 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.205387 12985 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.147040  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:08.125070 12996 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:17:08.148198  8764 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
W20260709 13:17:08.207568  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60668.6us
I20260709 13:17:08.208128 12727 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.208415  8764 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:08.209718  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:08.145519 12925 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.193929  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 378) took 1508 ms. Trace:
W20260709 13:17:08.149398 13009 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
W20260709 13:17:08.147895 12972 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.001s
W20260709 13:17:08.155198 12815 consensus_meta.cc:287] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.001s
I20260709 13:17:08.093199 12956 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:08.177637 12576 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:08.208612 12727 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:08.177906 13004 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:17:08.195039 12933 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.196127  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.247838  8767 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:08.142087 12732 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:08.210872  8765 rpcz_store.cc:276] 0709 13:17:06.685633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.721893 (+ 36260us) service_pool.cc:224] Handling call
0709 13:17:06.722612 (+   719us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.051819 (+329207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.051850 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.201444 (+149594us) log.cc:844] Serialized 52 byte log entry
0709 13:17:07.936628 (+735184us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.936676 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.936758 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.193617 (+256859us) raft_consensus.cc:1685] finished
0709 13:17:08.193649 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.193849 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46864,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":19940,"thread_start_us":871944,"threads_started":2,"wal-append.queue_time_us":809742}
I20260709 13:17:08.140647 13000 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.222007  8835 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:08.193678 13001 raft_consensus.cc:2764] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:08.222606 12802 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:08.262859  8842 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:08.216500 12989 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.265467  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1987) took 1729 ms. Trace:
I20260709 13:17:08.269157  8842 rpcz_store.cc:276] 0709 13:17:06.535620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.563053 (+ 27433us) service_pool.cc:224] Handling call
0709 13:17:08.262534 (+1699481us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:17:08.262691 (+   157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.265211 (+  2520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.265411 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11571456}
I20260709 13:17:08.258613 12901 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.274469 12901 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.260345 12773 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:17:08.276305 12773 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.276655 12773 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:08.277660 13011 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:08.277731 12773 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.279058 12773 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.248749 12727 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.298501  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:08.313989  8839 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.270671  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:08.317574  8842 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:08.299729  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:08.321314  8841 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:08.295074 12835 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 13:17:08.238015 12992 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:17:08.285024 13015 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:08.361624  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.293358 12867 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.280759 12944 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:08.286826 12802 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:08.429847  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.430550  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.433339  8765 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:08.223568 12972 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:08.434113  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 331872us
W20260709 13:17:08.483752  9434 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.683s (SENT)
I20260709 13:17:08.443282 12865 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.262215 12976 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 13:17:08.486459  8842 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:08.461014  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1841) took 1559 ms. Trace:
I20260709 13:17:08.484805  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:08.461688 12778 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:08.467793  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.468839  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.495797  8769 rpcz_store.cc:276] 0709 13:17:06.901923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.902490 (+   567us) service_pool.cc:224] Handling call
0709 13:17:06.902833 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.857642 (+954809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.460676 (+603034us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54001a7f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:08.460948 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152080640}
I20260709 13:17:08.469305  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.470959 12901 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.473423  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:08.266709 12721 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 13:17:08.478931  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.509049  8844 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:08.509579  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.509989  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.510255  8916 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:08.450431 12815 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:08.319406 12974 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.474922  8767 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:08.452968 12930 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.298311 12989 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.501688  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:08.526790  8915 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:08.351049 12999 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.539099  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.424535 12835 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.542845  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1839) took 1925 ms. Trace:
I20260709 13:17:08.497727 12778 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:08.513213  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:08.498490  8918 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:08.517599  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:08.486057  8839 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:08.557648  8844 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.544847  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.287671 12956 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.286695 12732 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:08.575076  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 413287us
I20260709 13:17:08.522842 12866 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.511163  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.549520  8768 rpcz_store.cc:276] 0709 13:17:06.617960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.620365 (+  2405us) service_pool.cc:224] Handling call
0709 13:17:06.687648 (+ 67283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:08.065862 (+1378214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.542531 (+476669us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400379954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:08.542770 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3167478528}
I20260709 13:17:08.516212 12986 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:08.566043  8807 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.047s (SENT)
I20260709 13:17:08.586797  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:08.504966  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:08.589463  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 84628.9us
I20260709 13:17:08.589674  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:08.526510 12722 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:08.590826 12975 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:08.591500 12992 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:08.592058  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.597957  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 374420us
I20260709 13:17:08.579077  8916 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:08.548161 12901 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:08.594245  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.595556  8837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.012s	sys 0.043s
I20260709 13:17:08.514600 12865 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:08.603605  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.526187 12815 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.604816  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.609468  8918 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:08.610044  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:08.593257 12994 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.611049  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:08.605582  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1971) took 1157 ms. Trace:
I20260709 13:17:08.617542  8837 rpcz_store.cc:276] 0709 13:17:07.448545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.768728 (+320183us) service_pool.cc:224] Handling call
0709 13:17:07.769416 (+   688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.769612 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:08.081465 (+311853us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.605149 (+523684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.605215 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:08.605278 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.605366 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.605510 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29551,"prepare.queue_time_us":357888,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":4023,"thread_start_us":777673,"threads_started":2}
I20260709 13:17:08.611996  8841 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:08.586651 13000 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:08.576495 12836 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:08.585719 12986 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:08.602057 12787 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.998s	user 0.012s	sys 0.000s
I20260709 13:17:08.627349  8918 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.625288  8844 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:08.600473 12992 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.636164  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.529417 12802 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:06.947342  8766 rpcz_store.cc:276] 0709 13:17:05.562594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.917439 (+354845us) service_pool.cc:224] Handling call
0709 13:17:05.917775 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:05.956591 (+ 38816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.956731 (+   140us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:05.969466 (+ 12735us) log.cc:844] Serialized 52 byte log entry
0709 13:17:06.204785 (+235319us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:06.686371 (+481586us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.717893 (+ 31522us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.944768 (+226875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.944835 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.944905 (+    70us) raft_consensus.cc:1685] finished
0709 13:17:06.944917 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.945036 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83326,"prepare.queue_time_us":663693,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":107829,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":36109,"spinlock_wait_cycles":19798912,"thread_start_us":842949,"threads_started":3,"wal-append.queue_time_us":378174}
I20260709 13:17:08.615908 12732 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.614605 12944 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.647406  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:08.623215 13000 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.650959  8844 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.631332 12867 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:08.643884 12992 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.614173 12901 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.650466 12944 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.629961 13023 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.657022 13000 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:08.641152 13025 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:08.670521  8916 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 13:17:08.730659  8916 pending_rounds.cc:85] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 4
I20260709 13:17:08.680469 13031 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:08.689182  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 99042.5us
I20260709 13:17:08.671824 12867 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.662092 12893 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:08.730981  8916 pending_rounds.cc:107] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 13:17:08.766252  8916 raft_consensus.cc:2889] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:08.693503 13023 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.642410 12787 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.736030  8844 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:08.689900 12944 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:08.720516 13018 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.297s	user 0.001s	sys 0.001s
I20260709 13:17:08.737975  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:08.507234 12576 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.775018 13039 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.776024 12974 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:08.732194 12781 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
W20260709 13:17:08.779886 12844 consensus_meta.cc:287] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.912s	user 0.008s	sys 0.001s
I20260709 13:17:08.780601 12893 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.781612 12901 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:08.786000  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 157557us
W20260709 13:17:08.786796  8734 connection.cc:256] RPC call timeout handler was delayed by -1.2480724580000242s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:17:08.788136  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.811661  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.817896  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:08.784467 13023 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.649870 12778 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.732882 13025 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:08.741304 12867 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:08.793418 12750 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.797499 12999 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.864755  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1847) took 1093 ms. Trace:
I20260709 13:17:08.869753  8913 rpcz_store.cc:276] 0709 13:17:07.771563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.907949 (+136386us) service_pool.cc:224] Handling call
0709 13:17:07.939221 (+ 31272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.969661 (+ 30440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.969706 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.970198 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.116013 (+145815us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:08.586073 (+470060us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.587161 (+  1088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.587982 (+   821us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.864457 (+276475us) raft_consensus.cc:1685] finished
0709 13:17:08.864487 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.864676 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":767,"prepare.queue_time_us":560323,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":3294,"raft.queue_time_us":3913,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":15756,"spinlock_wait_cycles":995584,"thread_start_us":589360,"threads_started":2,"wal-append.queue_time_us":354587}
I20260709 13:17:08.833033 12994 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.875123  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:08.876170  8909 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:08.837069 12989 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.809310 12835 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.788709  8918 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:08.849800 12972 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:08.811700 13022 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:17:08.692997 12986 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:08.811782 13020 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:17:08.803064 13039 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.917026 12865 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:08.869064 12727 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.005s
I20260709 13:17:08.785138 13031 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.917819 12727 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:08.854828 13030 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:17:08.918833 12990 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.225s	user 0.004s	sys 0.001s
I20260709 13:17:08.809772 12781 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:08.863086 13025 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:08.867533 12933 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.005s
I20260709 13:17:08.873477 12750 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:08.924373  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:08.878921  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 113611us
I20260709 13:17:08.936025  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:17:08.922627 13028 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
W20260709 13:17:08.922758 12982 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.159s	user 0.004s	sys 0.010s
W20260709 13:17:08.924546 12773 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.645s	user 0.005s	sys 0.005s
I20260709 13:17:08.945127  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:08.945318 12434 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.958s	user 0.013s	sys 0.000s
I20260709 13:17:08.945808  9460 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:08.920288 12727 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.946347 12781 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:08.947979 12750 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.945765  9463 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:08.919588 13031 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.964715  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:08.963429  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:08.969487  9460 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:08.971931  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.966298 12434 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.984289 12434 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.968807 12893 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.985503 13039 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:08.935431 12933 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:08.988950 12933 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:08.989199 12997 consensus_meta.cc:287] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.787s	user 0.008s	sys 0.005s
I20260709 13:17:08.989823 12997 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:08.991086 12943 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.992144 12865 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:09.011183 12925 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.992841 12865 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:08.994518 12787 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:09.010392 12935 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:08.960367 12982 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.020147 13023 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.053053 12815 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:08.786753  8652 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 74de73c0f36d4c3aa7a483c7fdb39e4a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:17:09.143955  8652 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 356988us
I20260709 13:17:08.803821  8763 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:09.154529  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.154922  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:09.155372  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 309917us
I20260709 13:17:08.881043  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.193500  8842 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:09.193886  8909 raft_consensus.cc:2376] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11. Re-sending same reply.
I20260709 13:17:09.194548  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.195667  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.196278  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 1997) took 2230 ms. Trace:
I20260709 13:17:09.178640 12403 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:09.186733 12864 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.188657  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1833) took 1438 ms (client timeout 1600 ms). Trace:
I20260709 13:17:08.831408  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.200075  8836 rpcz_store.cc:276] 0709 13:17:06.966085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.055760 (+ 89675us) service_pool.cc:224] Handling call
0709 13:17:07.293038 (+237278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.046961 (+753923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.195434 (+1148473us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540021c854. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:09.195977 (+   543us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669508864}
I20260709 13:17:09.203336  8910 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:09.177045 12865 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.197132  8909 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:17:09.201120  8760 rpcz_store.cc:269] 0709 13:17:07.749805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.870327 (+120522us) service_pool.cc:224] Handling call
0709 13:17:09.187902 (+1317575us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b54001a7554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.188313 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86610816}
I20260709 13:17:09.221213  8840 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:09.224169 12982 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:09.225634  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50936us
I20260709 13:17:09.255244 12928 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:09.256048 13023 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.256434 12866 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:09.257681 13000 consensus_meta.cc:287] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.004s
I20260709 13:17:09.257993 12976 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.258479 12976 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:09.258268 13000 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.263147  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.227990  8911 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:09.231510  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:09.266052  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 411) took 2399 ms. Trace:
I20260709 13:17:09.266682 13013 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:09.267689 13013 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:09.093242 12849 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:09.229609  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.230309  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:09.270767  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.271780  8909 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:09.229931  8917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1836) took 2283 ms (client timeout 2047 ms). Trace:
W20260709 13:17:09.231457  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.273221 12956 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.266574  8911 rpcz_store.cc:276] 0709 13:17:06.866372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.860307 (+993935us) service_pool.cc:224] Handling call
0709 13:17:09.227270 (+1366963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.264320 (+ 37050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.265761 (+  1441us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540026d250. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.265940 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142757760}
W20260709 13:17:09.273275  8917 rpcz_store.cc:269] 0709 13:17:06.946513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.492698 (+546185us) service_pool.cc:224] Handling call
0709 13:17:09.229459 (+1736761us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540031a454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.229683 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357898496}
I20260709 13:17:09.275969  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.276846  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.232561  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 416) took 2331 ms. Trace:
I20260709 13:17:09.281373  8915 rpcz_store.cc:276] 0709 13:17:06.901014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.805374 (+904360us) service_pool.cc:224] Handling call
0709 13:17:09.231958 (+1426584us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400293bd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.232286 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646273280}
I20260709 13:17:09.283452  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.265746 12976 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.287238 12976 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.293537  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1844) took 2091 ms. Trace:
I20260709 13:17:09.293764 12943 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:09.294612 12943 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:09.294057  8914 rpcz_store.cc:276] 0709 13:17:07.202345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.881563 (+679218us) service_pool.cc:224] Handling call
0709 13:17:07.911060 (+ 29497us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:07.911468 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.911501 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:07.922219 (+ 10718us) log.cc:844] Serialized 52 byte log entry
0709 13:17:08.117165 (+194946us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:08.117208 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.117277 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.264636 (+1147359us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b24001f4fa8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccebfb0 00007fce6f962488 00007fce6f962be8 00007fce6f93a398 00007fce6f93576a 00007fce6f934bb6
0709 13:17:09.292977 (+ 28341us) raft_consensus.cc:1685] finished
0709 13:17:09.293001 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.293323 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4266,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":16424,"spinlock_wait_cycles":40142208,"thread_start_us":142709,"threads_started":1,"wal-append.queue_time_us":316897}
I20260709 13:17:09.297483  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 454) took 1354 ms. Trace:
I20260709 13:17:09.298038  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.299050  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 2002) took 2003 ms. Trace:
I20260709 13:17:09.298064  8840 rpcz_store.cc:276] 0709 13:17:07.943541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.203236 (+259695us) service_pool.cc:224] Handling call
0709 13:17:09.297188 (+1093952us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54001d9f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.297410 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180803328}
I20260709 13:17:09.299693  8835 rpcz_store.cc:276] 0709 13:17:07.295682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.649648 (+353966us) service_pool.cc:224] Handling call
0709 13:17:09.298584 (+1648936us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54000ad554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.298824 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298037632}
I20260709 13:17:09.296447 12943 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.302481  8910 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:09.302575  8838 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:09.304181  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 1960) took 1870 ms. Trace:
I20260709 13:17:09.304625  8838 rpcz_store.cc:276] 0709 13:17:07.433407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.761237 (+327830us) service_pool.cc:224] Handling call
0709 13:17:09.301699 (+1540462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.303169 (+  1470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.303937 (+   768us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000ad550. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.304102 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3541814016}
W20260709 13:17:09.233685  8843 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36492 (request call id 453) took 1315 ms (client timeout 1683 ms). Trace:
I20260709 13:17:09.235769  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:09.237325 13042 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:09.238175  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:09.225663 12864 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.240132  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.251514 12931 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:09.226378  8912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1825) took 2287 ms (client timeout 1892 ms). Trace:
I20260709 13:17:09.272574  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:09.308681  8912 rpcz_store.cc:269] 0709 13:17:06.938900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.355335 (+416435us) service_pool.cc:224] Handling call
0709 13:17:09.225763 (+1870428us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b540026d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.226063 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772453760}
W20260709 13:17:09.314493  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46340.4us
I20260709 13:17:09.284219 12944 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.317224  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.244611  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:09.317957  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:09.307739  8843 rpcz_store.cc:269] 0709 13:17:07.917767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.918427 (+   660us) service_pool.cc:224] Handling call
0709 13:17:09.233134 (+1314707us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400415354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.233412 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":521587456}
I20260709 13:17:09.310233 13042 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:09.337284  8916 raft_consensus.cc:2376] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7. Re-sending same reply.
I20260709 13:17:09.338167 12787 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.338506  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.339236  8911 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:09.318795  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 365486us
I20260709 13:17:09.346477  8912 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:09.361996  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.362962  8916 raft_consensus.cc:2368] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:09.363190 12820 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.363682 12820 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:09.363866  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.364107  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.364135 12820 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.365463 12751 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.365674  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.366161 12751 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:09.367667 12751 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.371101 13025 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:09.375819 12867 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.010s
I20260709 13:17:09.376806 12820 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.385229 12944 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.391273  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.393782 13042 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.395538 13042 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.398736  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.400601  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.401109  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.401891  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.402135  9467 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:09.403786  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.405576  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.406368  9464 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:17:09.408057 12992 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.718s	user 0.008s	sys 0.011s
I20260709 13:17:09.409371  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.409521 12778 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.410046  8912 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:09.407939  8916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:09.410578  9463 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:09.409664  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.410866  8916 raft_consensus.cc:606] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:09.413447  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 169249us
W20260709 13:17:09.414484  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.357798 12956 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.348940 12787 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.425139  8917 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
W20260709 13:17:09.426292  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 257879us
I20260709 13:17:09.427032  8916 raft_consensus.cc:614] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:09.426848  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.358247 12866 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:09.380697 12864 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:09.436036  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.376494 12867 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.427556 12787 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.445389  8915 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
W20260709 13:17:09.449072  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 83560.9us
I20260709 13:17:09.458665 12943 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.459447 12943 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:09.460465 12820 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:09.454653  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.460843 12943 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.462539  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.465197 12750 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.456148 12956 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:09.466225 12750 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.466449 12956 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.469381 12956 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:09.470691 12941 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:09.473013  8763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1843) took 2477 ms (client timeout 1549 ms). Trace:
I20260709 13:17:09.473681  8764 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:09.473574  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.474028  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.474203  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.455428  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:09.454609  8909 raft_consensus.cc:2410] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:17:09.476514  8763 rpcz_store.cc:269] 0709 13:17:06.969482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.379804 (+410322us) service_pool.cc:224] Handling call
0709 13:17:09.436656 (+2056852us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540017dc54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:09.447175 (+ 10519us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2925791104}
I20260709 13:17:09.482239  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.408824 12992 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.484844  8760 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:09.473635  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:09.489526  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 217213us
I20260709 13:17:09.400982 13013 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.494946  8767 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:09.499365  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.500309  8761 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:09.500756  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.501701  8769 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:17:09.503722  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:09.503897  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.504539  9464 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.505110  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.506541  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.506644  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:09.508947  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.509769  8835 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.508786  8837 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:09.511145 12866 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:09.511509  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.511731 12866 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:09.508647  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.491494 12820 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:09.522980 12820 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.523556  8839 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:09.518721  9463 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:09.513110  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.514130  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.534392  8843 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:09.557693  8909 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.557844  8911 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:09.559764  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.508952 12997 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.560365  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 556449us
I20260709 13:17:09.562196  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.563350  8843 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:09.564275 13000 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.549090 12750 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.493979 12941 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.568053  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:09.556697 12944 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:09.581028  8666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 96) took 17380 ms (client timeout 15000 ms). Trace:
I20260709 13:17:09.585027  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.587596 12997 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.590993 12997 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:09.594105  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57403.4us
I20260709 13:17:09.594358  8764 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.596094  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:09.586400  9459 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:09.599714  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.600797  8914 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:09.604655  8910 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:09.601706  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:09.512827 12866 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.611232  8916 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:09.615542  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.615147  9464 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:09.623780  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:09.624784  9459 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:09.597332 13025 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:09.625454  9461 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.628607  9460 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:09.631829 12867 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.614557 12997 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.653684 13015 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.653791  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1858) took 1064 ms. Trace:
I20260709 13:17:09.654497  8912 rpcz_store.cc:276] 0709 13:17:08.588880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.410780 (+821900us) service_pool.cc:224] Handling call
0709 13:17:09.411281 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.411894 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.411925 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.412516 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.556442 (+143926us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.556502 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.556578 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.653477 (+ 96899us) raft_consensus.cc:1685] finished
0709 13:17:09.653496 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.653698 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":143131,"threads_started":1,"wal-append.queue_time_us":238657}
W20260709 13:17:09.658252  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 56164.6us
I20260709 13:17:09.622584 12944 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:09.669584  8912 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.670100 12944 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.671797  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.672456  8840 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:09.675806 12992 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.626153 12943 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.677170 12943 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.645962 12997 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:09.678164 12997 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.679669 12943 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.689229  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:09.690425  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 169079us
I20260709 13:17:09.692617 12815 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:09.693317  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.694010  9466 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:17:09.696410  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.697734  8768 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:09.699477  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.700520  8765 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
I20260709 13:17:09.703461  8769 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:09.705458  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.706815  8766 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:09.708814  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.709676  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 113719us
I20260709 13:17:09.709965  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:09.710752  8761 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.710633  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:09.714146 12943 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:09.715047 12943 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.716125  8910 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:09.717046 13025 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.718559  8809 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.719365 12943 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.719776  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:09.720124  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.721015 13000 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:09.722065 13000 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:09.722978  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:09.721036  9461 raft_consensus.cc:2410] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:09.670931  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.726704  8764 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:09.692592  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:09.627233 12751 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:09.736188  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.740218  8761 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:09.723619 13000 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.741637  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.743227  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:09.733208 12815 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:09.742597  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:09.745913  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.732842 12865 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:09.736122 12820 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.749787  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.749799  8912 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:09.750317  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.753746  8761 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:09.754201  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:09.758230  8915 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:09.749382  8843 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
W20260709 13:17:09.768944  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.775450  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:09.764698 12974 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:09.777172 12974 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:09.777621 12974 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.751334 12865 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.783469 12941 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:09.783664  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:09.789608 12778 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.790890  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.791714  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:09.792474  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:09.793231  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.793437  8767 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:09.796578  8910 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:09.794477  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 101990us
I20260709 13:17:09.793955  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:09.773869  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.756079 12815 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:09.772655 13025 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:09.812107  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:09.826527  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.854633  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:09.800557 12865 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:09.859324  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.859668  8835 raft_consensus.cc:2410] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:09.860106  8844 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:09.860713  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.861805  8836 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 7.
W20260709 13:17:09.862124 13054 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:17:09.865509  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 58147.2us
I20260709 13:17:09.814095  8839 raft_consensus.cc:2368] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14.
I20260709 13:17:09.857712  9466 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:09.858676 12857 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:09.869566  8843 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:09.882948  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:09.885032  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:09.891637  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.893958  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 84399.5us
I20260709 13:17:09.895044  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:09.897019  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:09.897781 12857 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:09.901037 12986 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.906327 12864 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:09.907408 12864 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:09.907737 12864 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:09.908272  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:09.909312  8916 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:09.909724  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:09.910796  8914 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:09.911330  8914 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:09.912396  8914 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:09.913386  8918 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:09.910854 12992 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.914001 12992 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.914388 12992 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:09.914712  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.909726  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:09.916756  8912 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:09.908641 12864 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.913432  8914 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.920588 12864 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.926245  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:09.877508  8837 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.866914 12941 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:09.887161  8734 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:09.866240 12820 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:09.957353  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1834) took 1984 ms. Trace:
I20260709 13:17:09.958221 12992 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:09.971484  8842 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:09.586167  8666 rpcz_store.cc:269] 0709 13:16:52.150449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:52.150601 (+   152us) service_pool.cc:224] Handling call
0709 13:17:09.516069 (+17365468us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:07.411012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:07.447257 (+ 36245us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:07.447310 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:17:07.447332 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:07.448491 (+  1159us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:07.448548 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:07.448574 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:07.450459 (+  1885us) tablet.cc:701] Row locks acquired
0709 13:17:07.450525 (+    66us) write_op.cc:260] PREPARE: finished
0709 13:17:07.463276 (+ 12751us) write_op.cc:270] Start()
0709 13:17:07.479737 (+ 16461us) write_op.cc:276] Timestamp: P: 1783603027457226 usec, L: 0
0709 13:17:07.479799 (+    62us) op_driver.cc:348] REPLICATION: starting
0709 13:17:07.599262 (+119463us) log.cc:844] Serialized 5213 byte log entry
0709 13:17:08.774268 (+1175006us) op_driver.cc:464] REPLICATION: finished
0709 13:17:09.047533 (+273265us) write_op.cc:301] APPLY: starting
0709 13:17:09.047625 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:09.060044 (+ 12419us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:09.071866 (+ 11822us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:09.101728 (+ 29862us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:09.102116 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=26
0709 13:17:09.102187 (+    71us) write_op.cc:312] APPLY: finished
0709 13:17:09.102661 (+   474us) log.cc:844] Serialized 94 byte log entry
0709 13:17:09.102913 (+   252us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:09.103122 (+   209us) write_op.cc:454] Released schema lock
0709 13:17:09.103193 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:09.103757 (+   564us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:09.103800 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":869442,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":272972,"apply.run_cpu_time_us":9905,"apply.run_wall_time_us":56171,"num_ops":13,"prepare.queue_time_us":625913,"prepare.run_cpu_time_us":44822,"prepare.run_wall_time_us":591707,"raft.queue_time_us":450024,"raft.run_cpu_time_us":14079,"raft.run_wall_time_us":115637,"replication_time_us":1290672,"thread_start_us":973652,"threads_started":4,"wal-append.queue_time_us":450676}]]}
I20260709 13:17:09.980899  8914 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:09.950747  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:09.875604 13025 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:09.983122  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:09.998032  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 78917.3us
I20260709 13:17:09.999307 12815 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.001088  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:10.001578 12866 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.003149 12992 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:10.012177  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 146287us
I20260709 13:17:09.949468 12941 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.016676  8767 raft_consensus.cc:2410] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:09.963217  8762 rpcz_store.cc:276] 0709 13:17:07.750405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.202701 (+452296us) service_pool.cc:224] Handling call
0709 13:17:08.203057 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:08.209771 (+  6714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:08.209805 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:08.210294 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.223773 (+1013479us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b180032c4a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:17:09.441046 (+217273us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:09.441113 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.441253 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.728433 (+287180us) raft_consensus.cc:1685] finished
0709 13:17:09.728452 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.735105 (+  6653us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6333,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":6459,"spinlock_wait_cycles":6872320,"thread_start_us":216789,"threads_started":1,"wal-append.queue_time_us":1475071}
I20260709 13:17:09.985955 12820 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:10.021519  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124662us
I20260709 13:17:10.030210  8761 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.034857  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:09.803347 12751 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.040741  8843 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:10.041584  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:10.021503 12941 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:10.052707  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.057847 12992 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:10.027261 12857 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:10.060578 12857 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.061094 12857 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:10.065217  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 208525us
I20260709 13:17:10.067737 12866 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:10.069082 12867 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:10.069335  8734 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:10.069507 12867 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:10.070569 12867 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.071875 12867 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.041829 13025 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.088325  8910 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:10.089623  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:10.095487  8768 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:10.099500  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.106108  8837 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:17:10.090201 13042 consensus_meta.cc:287] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.694s	user 0.003s	sys 0.012s
I20260709 13:17:10.101048  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:10.129956  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 76136.7us
W20260709 13:17:10.112007  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.113562 13059 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.133530  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.108176 12943 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:10.143025  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:10.151353  8761 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:10.157675  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:10.160352  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:10.141696 13042 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:10.167127  8764 raft_consensus.cc:2410] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:10.171825 12857 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.188613  8761 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:10.197711  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:10.198707  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:10.200380  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:10.202322  8910 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:10.203985  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:10.206933  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83891.7us
I20260709 13:17:10.208832  8918 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:10.208841  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:10.210094  8909 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:17:10.214373  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.161775 12974 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.216564  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:10.226061  8914 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:10.151567 13059 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.212250  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:10.213723 13013 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:17:10.219384  9431 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:10.221128 12997 consensus_meta.cc:287] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.006s
W20260709 13:17:10.208673 12931 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.006s
I20260709 13:17:10.229283 12857 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:10.242586  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.250864  8916 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.249531 13023 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:17:10.249524 13015 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.243891 13042 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:10.246858 13013 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:10.231539 12997 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.265035  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:10.269093  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 374274us
I20260709 13:17:10.273166  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:10.274026 12857 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:10.274518 12857 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.275012 12857 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:10.276615  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 450751us
I20260709 13:17:10.273186  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:10.272243  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 187753us
I20260709 13:17:10.281658 13072 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.282130 13072 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.282469 13072 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.273175  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:10.286948 13073 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:10.274204 12976 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.986s	user 0.008s	sys 0.007s
I20260709 13:17:10.260972 13015 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:10.269658 13013 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:10.297626  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:10.287503 13073 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:10.301770  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:10.261680 13001 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:10.305393  8843 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:10.306654  8912 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:10.314996 13001 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:10.317009 12787 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.835s	user 0.008s	sys 0.005s
I20260709 13:17:10.317598 13001 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:10.317488 12787 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.301813 12802 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.319283 12802 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.320806  8840 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:10.286983 13071 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.326128  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:10.326725  8760 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:10.333096  8840 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:10.300216 13015 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.295075 12751 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:10.306674 13073 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.317643 12857 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.372896 13069 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:10.370769 13059 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.376389 12941 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.335908 13071 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.383318 12956 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:10.384195 13071 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.386612 12997 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.379166  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 1993) took 1527 ms. Trace:
I20260709 13:17:10.389475 12857 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:10.866422  8917 rpcz_store.cc:276] 0709 13:17:08.834092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.437939 (+603847us) service_pool.cc:224] Handling call
0709 13:17:09.523782 (+ 85843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.556778 (+ 32996us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:09.735692 (+178914us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.083169 (+347477us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.248229 (+165060us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:10.278084 (+ 29855us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.278267 (+   183us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.279352 (+  1085us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.361241 (+ 81889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.361355 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.361420 (+    65us) raft_consensus.cc:1685] finished
0709 13:17:10.361441 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.361635 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31568,"prepare.queue_time_us":399344,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":114,"raft.queue_time_us":169199,"raft.run_cpu_time_us":397,"raft.run_wall_time_us":13513,"thread_start_us":636458,"threads_started":4,"wal-append.queue_time_us":435566}
I20260709 13:17:10.367213 12751 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.380700 12931 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:10.392819 12787 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.402465 12974 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:10.873955 13056 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 1.138s	user 0.002s	sys 0.004s
I20260709 13:17:10.409032 13013 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.402484 13025 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.875550 13025 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:10.414376 12865 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 13:17:10.879206 12865 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.880967 13013 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.881965 12865 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.425156 13077 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:10.426024 13073 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.403816 13015 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.436515 13072 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.884270 13077 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:10.885803 13073 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:10.886615 13072 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.438699 12941 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:10.770233  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.888974 12941 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:10.892081 13015 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.886615 13077 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:10.788569  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.894225  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.851046 12820 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.898757  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:10.898945  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:10.899660  8843 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:10.352674 12986 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:10.901217  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:10.901118  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:10.872797 12751 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:10.903168  8810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.003s	sys 0.002s
W20260709 13:17:10.903656  8810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.004s	sys 0.002s
I20260709 13:17:10.407632 13071 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.898356 13025 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.904847 12751 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.906966 13071 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:10.907033 13025 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:17:10.902091  8840 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:10.911420 13013 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:10.912052 13013 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:10.912688 13064 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.853s	user 0.000s	sys 0.004s
I20260709 13:17:10.919842  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:10.923194 13013 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:10.924926  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:17:10.925228 13013 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:10.930792 13025 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.937414 13072 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:10.938798  8884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.015s	sys 0.026s
I20260709 13:17:10.938575 13072 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:10.939338  8884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.015s	sys 0.027s
W20260709 13:17:10.941332  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.941263  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 654911us
I20260709 13:17:10.942039 13084 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.943048 13072 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:10.942720 13084 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.944977  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:10.945943 13084 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.953217 13084 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.953970 13084 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.954741  8837 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:10.955714 12982 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.956248 12982 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.957167  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:10.957820  8841 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:10.958482 12982 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.956207 13084 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.963143 13084 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:10.963768 13084 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.966084 13084 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:10.966678 13084 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:10.967243 13084 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:10.969439 13084 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:10.970795  8916 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.711s	user 0.014s	sys 0.004s
I20260709 13:17:10.985195  8916 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:10.971611  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:10.987457 13077 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.987895 13077 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:10.988256 13077 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:10.972548  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 697193us
I20260709 13:17:10.991468 13025 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:10.994135  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.978508  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.004849  8842 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.006992 13079 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.007622 13079 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.019729  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.021096 13077 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.010322 13079 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.022635  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.023360  8841 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:11.024163  8835 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:11.024497  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.024993  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.025326  8841 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:11.025710  8838 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:11.025537  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.026152  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.026274  8835 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:11.026844  8841 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.026710  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.027429  8838 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.021485  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.023392  8842 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:11.024097  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.032742  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.033510  8842 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.034137  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.023439 13077 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:11.037467  8837 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.043502  8838 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:11.044183  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.046228  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:11.048851  8768 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.939s	user 0.004s	sys 0.009s
I20260709 13:17:11.049268  8768 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:11.050928  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.051218  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.052026  8842 raft_consensus.cc:2410] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:11.053696  8842 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 13:17:11.054482  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.055399  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.055383  8843 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:11.068065  8735 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.072358  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1875) took 1010 ms. Trace:
I20260709 13:17:11.072801  8841 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:11.072754  8768 rpcz_store.cc:276] 0709 13:17:10.049263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.049427 (+   164us) service_pool.cc:224] Handling call
0709 13:17:11.049813 (+1000386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.080471 12751 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.081092 12751 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.081568 12751 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.085619  8655 maintenance_manager.cc:643] P bea3bb54fdd140bfadbad5c24f3a0fa7: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 3.050s	user 0.140s	sys 0.086s Metrics: {"bytes_written":30155,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":11088,"dirs.run_cpu_time_us":461,"dirs.run_wall_time_us":11625,"drs_written":1,"lbm_read_time_us":415,"lbm_reads_lt_1ms":4,"lbm_write_time_us":5565,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":61818,"threads_started":2,"update_count":13,"wal-append.queue_time_us":55175}
W20260709 13:17:11.088672  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 143794us
W20260709 13:17:11.089404  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.090940  8656 maintenance_manager.cc:419] P bea3bb54fdd140bfadbad5c24f3a0fa7: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 7830 bytes on disk
I20260709 13:17:11.101154  8655 maintenance_manager.cc:643] P bea3bb54fdd140bfadbad5c24f3a0fa7: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.004s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":413,"lbm_reads_lt_1ms":4}
I20260709 13:17:11.109782  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.118474 13091 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.119164 13091 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.121683 13091 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.126992 12857 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.104967 13088 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:11.129597 13088 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.130019 13088 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.140381  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.142796  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.142069 13091 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.144963 13091 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.145454 13091 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.153595 13088 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.155181 13088 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.161922 13091 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.164366 13091 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:11.165040 13000 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.095s	user 0.007s	sys 0.019s
I20260709 13:17:10.994323 13025 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:11.171320 13025 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:11.172569 13025 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.173911 13025 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.174681 12751 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.177414 12751 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.178084 12751 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:11.180939  8913 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.019s
I20260709 13:17:11.181416  8913 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
W20260709 13:17:11.167784 13000 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.007s	sys 0.019s
I20260709 13:17:11.190490  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1860) took 1496 ms. Trace:
I20260709 13:17:11.191087  8760 rpcz_store.cc:276] 0709 13:17:09.694086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.701676 (+  7590us) service_pool.cc:224] Handling call
0709 13:17:09.702202 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.333798 (+631596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.190190 (+856392us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b5400190d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:11.190423 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435850496}
W20260709 13:17:11.193636  8809 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.016s	sys 0.017s
W20260709 13:17:11.194017  8809 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.016s	sys 0.017s
I20260709 13:17:11.195358  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.196352  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.203116 13091 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:11.203253 13088 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:17:11.212247  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.213284  8844 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:11.215884  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.216084  8768 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:11.216650  8764 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:11.216773  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.217890  8761 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:11.221014 12787 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.222163  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.222780 12787 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:11.223613 12787 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:11.225348 12815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.165s	user 0.014s	sys 0.011s
W20260709 13:17:11.225683 12815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.014s	sys 0.011s
I20260709 13:17:11.227233  8764 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:11.227871  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.228756  8760 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:11.229660  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.230331  8767 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:11.230865  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.232647  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.232743  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.234200  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.237663  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:11.239140  8913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 2003) took 2396 ms (client timeout 1650 ms). Trace:
I20260709 13:17:11.239382  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:11.239557  8913 rpcz_store.cc:269] 0709 13:17:08.843227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.194039 (+350812us) service_pool.cc:224] Handling call
0709 13:17:11.238969 (+2044930us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002940d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:11.239068 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644125056}
I20260709 13:17:11.242861  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.243800 13025 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:11.244254  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.244537  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:11.245162  9461 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.244323 13025 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:11.242960  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.246819  8760 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:11.246582 13025 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.247738  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.248090 12751 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.248371  8767 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:11.248531 12751 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.249471 12751 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.250789  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.251348  8767 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.239936  8768 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.252774  8761 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:11.256235  9461 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:11.258991  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:11.259438  8764 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:11.259763  8765 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:11.272579  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73502.5us
I20260709 13:17:11.274102 13097 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:11.274231 13096 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:11.274590 13097 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.274748  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.275682 13097 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.276796 13097 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.259939 12751 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.294991  8765 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:11.265687 13091 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.301846 13091 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.292836 13000 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.305778 13000 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.321583  8768 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:11.286824 12815 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.323884  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.324796  8768 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:11.310375 13000 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.338338  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.338464  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.339076  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.339831  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.340278  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.339247  8761 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.341944  8769 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:11.345062  8768 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:11.328898 12815 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:11.353657  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.354560 12815 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.359794  8767 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:11.360246 13013 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:11.360749 13013 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.361382 12941 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:11.362169 12941 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.363083 13013 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.363875 13000 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.364472 13000 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.365360  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.366928 12941 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.368763 13000 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.370077 13072 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.379840 13072 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.382710 13072 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.370584 12956 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.383752 12956 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.391896 12956 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.411708  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.412261  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.413002  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.414204  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.415549  8766 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.413002  8769 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:11.416728  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.417555  8764 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:11.418756  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.419015  8767 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.420032  8761 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
W20260709 13:17:11.419968  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 145359us
I20260709 13:17:11.421376  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.422461  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.423225  8768 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 7: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:11.418248 12802 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.425498  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.433799 13015 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.434415 13015 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.436645 13015 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.447919  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.448987  8768 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:11.452086  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.453015  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.454638  8844 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:11.457626  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.458418  8841 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:11.462148  8839 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:11.463692  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.444253 13096 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:11.469828  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.467410  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.470723  8841 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.461813 12787 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.494722  8841 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:11.458431 13097 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.456143 13015 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:11.486037  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.489877  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.506062  8839 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.506604  8768 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:17:11.508275  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:11.514192  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.516011  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.516813  8762 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:17:11.518108  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.501991 12802 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.517748  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:11.521260  8761 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:11.522894  8763 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:17:11.528671  9461 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:11.518714 13102 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:17:11.532907  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.534080  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.540403  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.541006  8762 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:11.519910 12787 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:11.511118 13015 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.512430 13097 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.544596  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.550436 13015 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:11.550596  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.550689  9461 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:11.527179 13095 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.554766  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.555039 13095 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:11.556244 13106 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:11.555961 13095 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.518704 13088 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:17:11.501921 13096 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.561383 13095 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.553002  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.521919 12802 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.553471  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:11.563266  9466 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:11.565785  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.591889  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 600623us
I20260709 13:17:11.597764  8768 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:11.610523 12976 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:11.611229 12976 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.611554 13001 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:11.611617  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 522065us
I20260709 13:17:11.612257 13001 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.613590  9466 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:11.614560 13001 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:11.615195 13001 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:11.616073 13001 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.616463 13001 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:11.619870 12802 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.610725  8662 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 12, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 12 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.621891  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:11.624109  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:11.552420 12787 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.634459  8839 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:11.636235  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:11.643326  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:11.644495  8761 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:11.655328  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:11.656767  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:11.657069  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:11.658097  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:11.658463  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:11.659840  8884 leader_election.cc:400] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14.
I20260709 13:17:11.660104  8884 leader_election.cc:403] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:11.621078 13001 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.656163  8662 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:11.662168  9467 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:11.662362  8662 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 10, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 10 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:11.665176 12815 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.665704 13102 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.666062  9463 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:11.665927 12815 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.666436 13102 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:11.667292 13102 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.663980  8662 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 11, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.667853  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:11.669193  8662 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 5 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 10 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:11.675418  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 48601.5us
W20260709 13:17:11.701730  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53283.2us
I20260709 13:17:11.713088  8735 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.605341 13075 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:17:11.651676 13071 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:11.714836 13069 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:17:11.673514 12976 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:11.729365  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:11.705505 12857 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:11.733415  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.709687 13073 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.709235 12864 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.713475 13076 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:11.740590  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.730144 13092 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:11.745874 12815 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.746347 13073 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:11.750296 13108 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.003s
I20260709 13:17:11.750500 13073 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.746907 12864 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.753436 12864 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.747179  8662 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:11.758531  8662 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 9 to 10, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 10 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:11.762022 12787 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.735231 13102 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.766957 13097 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.727638 13071 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:11.770399 13071 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.772269 13071 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.726826 13042 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:11.775667 13042 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.760470  8662 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 8 to 10, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 10 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.714654 13099 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:11.780139 13099 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.779982  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:11.780982  8839 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:11.781343 13099 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.782714  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.783859 13102 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:11.784307 13102 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:11.784758 13102 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.790351 13092 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:11.792204  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62137.8us
I20260709 13:17:11.795257  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:11.797434  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.797626 13102 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:11.798719  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 88276.9us
I20260709 13:17:11.801121  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:11.801780  8839 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:11.801192 13097 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:11.805286  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:11.809504  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.810990 13095 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.811028  8839 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:11.811511 13095 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.811977 13095 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.812687  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.813905 13088 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:11.814522 13088 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:11.810132 13097 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.776402 13042 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.820008 13088 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.820801 12864 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.823081 13042 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:11.824960  8839 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:11.784480  8662 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 10 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.823748 12864 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:11.830412  8662 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 3 to 11. New cstate: current_term: 11 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:11.836112  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 202791us
I20260709 13:17:11.823877 13042 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.834209 13096 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:17:11.843984 13102 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:11.850895  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:11.853740  8662 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 9, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:11.886929  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.888252  8882 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.805181 13073 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.889676 13076 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14.
I20260709 13:17:11.890478 13073 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:11.890972 13076 raft_consensus.cc:2764] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:11.891129 13073 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:11.891947 13073 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:11.881570 13092 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:11.851943 12802 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:17:11.897679  8840 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:11.890009  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:11.906152  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50518.4us
I20260709 13:17:11.913008  8662 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:11.917266 12864 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.904009 13015 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:17:11.918609  8839 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:11.919528  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:11.921150 13069 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.922019 13015 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:11.924010  8840 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:11.925274 13075 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.925736 13075 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:11.926273 12787 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:11.926753 13075 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.928158 13075 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.939118  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:11.946801  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 235907us
W20260709 13:17:11.955906  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53209.7us
I20260709 13:17:11.956503  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:11.957966  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.940056 12857 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:11.963981  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:11.946513 13001 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.915450 13000 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:11.967607  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 65079.8us
W20260709 13:17:11.970801  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47942.5us
I20260709 13:17:11.966898 12802 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.973822 12802 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:11.974119 13095 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:11.959463 13092 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:11.984253  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.992777  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.997604  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:12.001394  8939 debug-util.cc:398] Leaking SignalData structure 0x7b080004f560 after lost signal to thread 7660
W20260709 13:17:12.002887  8939 debug-util.cc:398] Leaking SignalData structure 0x7b080013d7e0 after lost signal to thread 8701
W20260709 13:17:12.004526  8939 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa4c0 after lost signal to thread 8793
W20260709 13:17:12.005131  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.008776  8732 leader_election.cc:400] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:12.009294  8732 leader_election.cc:403] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:12.021827  8939 debug-util.cc:398] Leaking SignalData structure 0x7b0800061aa0 after lost signal to thread 8794
I20260709 13:17:12.011682  8662 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 5 to 7, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 7 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.989776 13117 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:12.024982  8939 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff840 after lost signal to thread 8868
I20260709 13:17:12.027473  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.029057  8662 catalog_manager.cc:5697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 5 to 11, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:12.029872  8939 debug-util.cc:398] Leaking SignalData structure 0x7b0800345220 after lost signal to thread 8942
I20260709 13:17:11.945873 13073 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:12.032114  8939 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9400 after lost signal to thread 9492
I20260709 13:17:12.032406  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:11.997045 12956 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:11.999130 13095 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:12.035537  8939 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7b40 after lost signal to thread 9493
W20260709 13:17:12.045821  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.061004  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.062450  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.063344 13096 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.063784 13096 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.064111 13096 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.063990  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:12.065295 13119 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:12.065917 13119 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:12.066819 13119 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.073035 13096 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.037987 13117 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:12.037271 12956 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:12.031778 13102 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:12.055862 12857 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.076634 13096 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:12.026312 13000 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:12.077978 13000 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.074693 13117 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.073608 12802 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:12.076001 12956 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.086547  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.091291  9461 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:12.092695  8838 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:12.093807  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.094962  8843 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:12.096874  8837 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.097337  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:12.097801  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:12.098693  9466 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:12.057658 13069 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:12.111797  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.111878  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.082077 12787 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.088258 13099 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:12.116989  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.133745  8841 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:12.135874  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.107254 13120 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:12.134912 13069 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:12.138051 13120 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.138607 13069 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:12.146399  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 111624us
I20260709 13:17:12.147639  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.150728  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.152812  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.145519 13126 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:17:12.155170 13120 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.156037 13126 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:12.157305 13126 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:12.157667 13126 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:12.158589 13126 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.158814 13129 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:12.160343  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.166931  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.167754  8837 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:17:12.163166  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.173000  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.140478 12976 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.140327 13095 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.162370 13126 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.177392 13120 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.162995 13042 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.133037 13127 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:17:12.181085  8841 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:12.182168  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.195598  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.227609  8837 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:12.234428  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.236735  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 125070us
I20260709 13:17:12.246363  9464 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:12.175204 13099 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:12.260939 13099 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 12.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.235181 13120 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:17:12.264201  8837 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:12.253294  8835 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.189297 13042 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.189422 12976 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.186398 12802 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:12.258535 13126 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:12.195433 13095 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.266433  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.246071 12864 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.304337  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.305164  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:12.304003  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124268us
I20260709 13:17:12.309099 13107 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.309907 13107 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.314208  8912 raft_consensus.cc:2410] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:12.316321  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.317162  8916 raft_consensus.cc:2368] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15.
I20260709 13:17:12.317950  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.318747  8838 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:12.338291  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.339401  8914 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:12.342988  8917 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:12.338063  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:12.347081  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:12.290208 12802 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:12.290441 13095 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.291114 13126 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:12.351711  8911 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:12.352437  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.353945  8837 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:12.355672  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.297376 13096 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:17:12.350260 13075 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.381860  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.347318 12857 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.382917  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.389326  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 87107.8us
I20260709 13:17:12.406991  8914 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:12.407531  8911 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:12.411123  8918 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.409292  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.411899  8910 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.318480 12864 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:12.411964  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.376724 13102 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:12.376998 13092 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.421875  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.422915  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.426671  8915 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:12.426781  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.425351  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.436416  8918 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:17:12.410594 13015 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:12.439802  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.423048 13119 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.452733  8910 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
W20260709 13:17:12.453034  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 115057us
I20260709 13:17:12.453894  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:12.455451  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.415378 13075 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.440034 13015 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.461675  8911 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:12.424592 12857 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.459899  8917 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:12.439365 13107 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:12.430050 13092 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.473116  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.475021  8912 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:12.476212 13138 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:17:12.478283 13137 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:17:12.480077 13132 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:12.474452 13107 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:17:12.483762 13107 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:12.484493 13107 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:12.463754 13015 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.466082 13102 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:12.496354  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:12.484829 13107 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:12.439234 12802 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.458706 13119 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.513659 12802 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.515312 13119 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:12.489217 12815 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.517444  8910 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:12.517336 12815 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.451128 13126 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.520174  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.520509 13102 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:12.520977  8910 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:12.521636  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.522320  8915 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:12.503153  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.504657 13042 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.506444  8841 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:12.509258  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:12.524887  8762 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:17:12.509527 12864 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.499078  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.509994  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.511032  8765 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:12.509939  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:12.533468  8761 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:12.541213  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:12.544322 12956 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:12.549739  8912 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:12.521674 13102 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.554971  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.555650  8915 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:12.556469 13131 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:17:12.562304  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:12.567289  8763 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:12.563110 13148 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.569105 13148 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.583844  8760 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:12.585433  8761 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:12.592765  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.593305  8839 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:12.592473  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:12.593786  8915 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:12.594506  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.605404  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:12.606645  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.607270  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.609913  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.614084  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.617458  8760 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.568336 12787 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:17:12.620410  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.621102  8914 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:12.622067  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011917cac276499ba01c77d911c67d8d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:12.622826  8839 raft_consensus.cc:606] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:12.619690  8915 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:12.623247  8839 raft_consensus.cc:614] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:12.625311  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:12.630431  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.631183  8918 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:12.632007 13015 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.639822  8760 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:12.642730 13092 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.639367 13088 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.645674 13088 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:12.646083 13088 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.646418 12815 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:12.647404 13095 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.648768  8769 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:12.650108  8914 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:12.651284  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.651356  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.651975  8914 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
W20260709 13:17:12.653280 13135 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.392s	user 0.004s	sys 0.000s
I20260709 13:17:12.653929 13126 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.654376  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.655270  8913 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:12.655643  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:12.656641  8808 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.600s (SENT)
W20260709 13:17:12.657745 13136 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.290s	user 0.003s	sys 0.000s
I20260709 13:17:12.659497 13148 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:12.662323 13075 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.663659  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:12.664278  8841 raft_consensus.cc:606] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:12.664618  8841 raft_consensus.cc:614] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:12.612248 13107 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.652619  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.666075  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.666870  8839 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:12.667378 12857 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.669076  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:12.669762  9462 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
W20260709 13:17:12.671540 13144 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:17:12.674750  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.676208  8918 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:12.679788  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54531us
W20260709 13:17:12.713416  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.714443  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:12.716323 12815 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.677949  8914 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.716789 12815 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.717283 12815 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.719515  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.720207  8913 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:12.721105  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.721204  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.721593  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.722209  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.722443  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.722733  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.723027  8909 raft_consensus.cc:2376] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14. Re-sending same reply.
I20260709 13:17:12.723855  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.723968  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.728153  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.728580  8909 raft_consensus.cc:2368] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15.
I20260709 13:17:12.726987  8842 raft_consensus.cc:2410] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:17:12.717182  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.723320  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.727813  8918 raft_consensus.cc:2376] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15. Re-sending same reply.
I20260709 13:17:12.729950  8915 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:12.732332  8914 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:12.735176  9464 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:12.736660  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 282832us
I20260709 13:17:12.737542  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:12.739480  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 65505.4us
I20260709 13:17:12.740998  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:12.743304  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 94874us
I20260709 13:17:12.744192  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.743331  9431 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.744923  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:12.738497 13160 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.744962  8912 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:12.741973  8769 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:12.748371  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:12.748598  8918 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:12.750509  8839 raft_consensus.cc:606] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:12.751026  8839 raft_consensus.cc:614] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:12.733691 12787 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:12.763847 12857 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:12.761433 13092 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.763953 13088 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.764786 13092 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.747002 13160 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:12.766988  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:12.767349  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 208766us
I20260709 13:17:12.768432  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.777067 13042 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:12.769343 13001 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:17:12.769550 12864 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:17:12.786191 13001 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:12.786659 13001 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:12.786695 12864 consensus_queue.cc:1243] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:12.787514 12864 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:12.788002 12864 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:12.768175 13160 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.789726 12976 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.791177 13015 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:12.793648  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.805575  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.809623  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.810195  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:12.810447  8918 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:12.811133  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:12.818504  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57418.8us
I20260709 13:17:12.819200  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:12.819237  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76039.4us
I20260709 13:17:12.827543  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.828759  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:12.831488  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.829602  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.835005  8767 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:12.835590  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.837684  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.838264  8918 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:12.804816 13015 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:12.839428  8765 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:12.787688 13001 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.810497 13099 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.851935  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:12.766198 12787 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.843695  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:12.846437 13171 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:12.855989  8918 raft_consensus.cc:606] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:12.848150 13102 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:12.856477  8918 raft_consensus.cc:614] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:12.809684 13096 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.841490  8760 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:12.856069 13171 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:12.862159  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.853744  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 108903us
I20260709 13:17:12.816948 13042 consensus_queue.cc:1243] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:12.851665  8762 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:12.865743  8808 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.783s (SENT)
I20260709 13:17:12.866883  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.867069  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:12.836748 12857 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:12.866922  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.842415 13119 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:12.871551  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:12.875756  8843 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.828327 12976 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:12.851838 13088 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:12.872429  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:12.881328  8912 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:12.878352  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:12.892896 13157 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:12.869477 13171 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.900004  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.900707  8840 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
W20260709 13:17:12.888382  8807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.532s (SENT) [suppressed 53 similar messages]
I20260709 13:17:12.904417  8912 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:12.906327  8844 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:12.910391  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 91237.1us
I20260709 13:17:12.911746  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:12.912230 13015 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:12.913820 13015 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:12.875401 13119 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:12.915758  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:12.920077  8913 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:12.875108 13167 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:12.869086 13120 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:12.898334 13001 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.925134  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:12.928817  8843 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:12.855475 12864 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:12.869859 13096 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:12.938176 13159 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 13:17:12.938601 13092 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:12.922043 13119 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.922580 12976 consensus_queue.cc:1243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:12.923065 13167 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.987211 13139 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:17:12.982324 13167 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:12.993424  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:12.996791  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 85213.5us
I20260709 13:17:13.004042  8839 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:13.006536  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.006937  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.007395  8843 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 14 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:13.010912  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.026898  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.035382  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.008401  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.037730 12802 raft_consensus.cc:2764] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:17:13.037863  8807 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.783s (SENT)
I20260709 13:17:13.038444  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:13.039556 13180 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.040364 13139 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.934602 13000 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:17:13.041152 13099 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.041361  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:13.041678 13099 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.042176 13099 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.044034  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.040112 13180 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:13.046594  8808 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.936s (SENT)
I20260709 13:17:13.045222  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.048297  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:13.050897  8836 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:13.050001  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.055716  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:12.994899 13095 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:13.056565  8843 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:13.041381 13000 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:13.064947 13128 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:13.065119 12802 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:13.065442 13181 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:17:13.075354  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.055584 13139 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.102384  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.088698  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.113111  8838 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:13.114207  8837 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:13.119210 13187 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:13.119808 13187 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:13.121054 12787 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:13.121706  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.122344 13180 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.122980  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:13.123288 13184 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:13.124853 13176 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:13.125551 13167 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.129104 13092 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:13.129642  8808 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.960s (SENT)
I20260709 13:17:13.129894 13092 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.130381 13092 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.128573 12986 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.132578  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.116011  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.135607  8844 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:13.070623 13000 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:13.127936 13167 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.142900  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.149417  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:13.111635 13095 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.130079 13160 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.131247 13139 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:13.151016  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:13.162657  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.133682 13092 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.167584  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.170711 13176 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.167752 13139 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:13.182723  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 311507us
I20260709 13:17:13.150604 12986 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:13.203454  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 326292us
W20260709 13:17:13.203722  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 130558us
I20260709 13:17:13.205736  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:13.206302  8808 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.091s (SENT)
I20260709 13:17:13.215770  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:13.216199  9462 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:13.168087 13117 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.217051 13186 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.177680 13076 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.217912 13076 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.218334 13076 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.218129  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:13.223735  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:13.251699  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.253966 13129 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.254638 12802 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:13.255170 12802 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.255843 13198 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:13.255908 13181 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:13.257717 13181 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:13.258558 13181 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.260226 13180 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.260834 13071 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:13.261418 13071 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:13.260937 13180 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.262285 13071 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.263516 13071 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.263556 13180 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.255851 13158 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:13.255328 13195 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:17:13.268784 13160 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.120762 13187 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.270606 13075 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:13.271050 13075 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:13.271910 13075 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.272333 13000 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.254745 13129 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:13.255602 12802 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.278715  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:13.304759  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 137284us
I20260709 13:17:13.306770  8884 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.311131  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:13.274262 13096 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.282143 13129 consensus_queue.cc:1243] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:13.314888 13000 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:13.315591 12815 consensus_meta.cc:287] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.006s
I20260709 13:17:13.327183 13125 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:13.327217 12815 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.329075  8839 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:13.330935 12815 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:13.334507 13099 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:13.340554  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 86045.2us
I20260709 13:17:13.313546 12986 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.344796  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:13.345319  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.346763  8761 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:13.346961  8768 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:13.318641 13075 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.349165  8768 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:13.349587  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:13.351547  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.350606  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.356454  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.357700  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.358510  8766 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:13.355614  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.356624  8768 raft_consensus.cc:2376] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12. Re-sending same reply.
I20260709 13:17:13.355692  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.357614  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.359555  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.349967  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:13.360555  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.349411 13125 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:13.347975 12956 raft_consensus.cc:2764] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 13:17:13.367399  8761 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:13.365502  8768 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:13.365929  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:13.350777 13120 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.360563 13001 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:13.370353  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:13.371815  8807 leader_election.cc:400] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15.
I20260709 13:17:13.371079  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.373288  8768 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:13.373782  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:13.374363 13117 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:13.374874 13117 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.375268 13117 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.375378  8807 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.364486 12815 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.368368 13128 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:13.382287 12956 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.385653  9466 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:13.388139 13134 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.389653 13126 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:13.389838 13119 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.380380 13176 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:13.385288 12815 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.387835 13139 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.397886 12956 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:13.399051 13160 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:13.416018  9464 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:13.416894 13200 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.400056 12815 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:13.360592 13042 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:13.427834  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.428565  8912 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:13.401347  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.401408 13091 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:13.402735  9462 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:13.404424  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:13.443161  9459 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:13.404788  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:13.444094  9463 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:13.407717  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.378005 13198 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.373036 13120 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:13.388690 13134 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:13.409353 13171 consensus_meta.cc:287] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.000s
I20260709 13:17:13.428474  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.431016  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 2035) took 1342 ms. Trace:
W20260709 13:17:13.451619  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 101711us
I20260709 13:17:13.391443 13186 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:13.435012  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.429414  8768 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:13.445875  8769 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.455746 13205 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:13.452250  8842 rpcz_store.cc:276] 0709 13:17:12.088234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.088851 (+   617us) service_pool.cc:224] Handling call
0709 13:17:13.430768 (+1341917us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54001d9f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:13.430942 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453982464}
I20260709 13:17:13.458057  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.457544  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.413345 12956 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:13.445380  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.443276  8914 pending_rounds.cc:85] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:17:13.451484  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.452631  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.460127  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.501842  8760 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:17:13.502170  8768 raft_consensus.cc:2376] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14. Re-sending same reply.
I20260709 13:17:13.457542  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:13.500547  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.417446 13200 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.391021 13076 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.445902  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.385504 13125 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.504436  8913 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:13.502094  8761 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:13.451242 13120 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.446302 13198 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:13.506709  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.525862  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.445327 13160 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.458958  8917 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:13.511512  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.528983  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.530077  8766 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:13.531155  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.451449 13134 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.514773  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.506354  8840 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:13.514961  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.506387  8914 pending_rounds.cc:107] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:17:13.457967 13186 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.532552  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.465534 13187 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:13.540786  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.543604  8914 raft_consensus.cc:2889] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.544025  8766 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:13.533681  8767 raft_consensus.cc:2376] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13. Re-sending same reply.
I20260709 13:17:13.533162  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.546859  8764 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 4.
I20260709 13:17:13.546985  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.547711  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:13.548370  8764 raft_consensus.cc:2376] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:17:13.548579 13161 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.549212 13161 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.504782 13129 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.554409  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.555925  8768 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:13.558358  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.559135  8909 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:13.533643 13198 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.580951 12956 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.465204 13171 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.563715  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.566457  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.567819  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:13.594271  8840 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:13.567775  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 117175us
I20260709 13:17:13.569118  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.569936  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.572587  8835 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.573031  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.595934  8838 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:13.573138  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.574008  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:13.595942  8843 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:13.575068 13139 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.575169 13200 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:13.542693 12815 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:17:13.607134  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 154399us
I20260709 13:17:13.576303 12802 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.579859  8769 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:13.510491 12986 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:17:13.545385 13186 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.596311  8841 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:13.512945 13128 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:13.546516 13187 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:13.610616  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:13.551841 13161 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:13.615221  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.606873 12815 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:13.545061 13160 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:13.640090  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67031.5us
I20260709 13:17:13.643640  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.558658 13129 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.648777 13119 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:13.651260 13180 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.651626 13171 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.681151 13076 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:13.684525 13220 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.685154 13220 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:13.685578 13220 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.692587 12815 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.689177 13187 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.705123  8842 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:13.697597 13128 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.651278 13092 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.716504  8916 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:13.720566  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 77036.3us
I20260709 13:17:13.721869  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.722815  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:13.723645 13195 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.723940 13224 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:13.724089 13195 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:13.724439 13224 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.724574 13195 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.724824 13224 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:13.730697 13187 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.753607 13211 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.754269 13211 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:13.754691 13211 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:13.759122 13209 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:13.761806 13129 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.767448 13224 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.771929  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.782745  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:13.782917 12802 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.783739 13088 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.784740 13171 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.784582 13088 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:13.785562 13171 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.786156 13171 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.786540 13194 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:13.787179 13194 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:13.783902  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:13.789994 13161 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:13.790555 13161 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.790948 13161 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:13.788460 13194 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.792317 13194 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.793001  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:13.801306 13096 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:13.801985 13096 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.802407 13096 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:13.809051 13134 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.817811 13092 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:13.826416 13071 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.562s	user 0.013s	sys 0.000s
I20260709 13:17:13.827314 13224 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:13.828490  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.829030  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.830683  8839 raft_consensus.cc:2410] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:13.831740  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:13.833784 13000 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.834381  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.834455 13000 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.870131 13140 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:13.835281  8917 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:13.870636 13140 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:13.871572  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:13.871508 13140 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.872376  8917 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.840386 13161 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.876278 13161 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.841566 13120 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.843024 13171 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.878140  8911 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:13.847733 13129 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:13.853194 13204 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.345s	user 0.005s	sys 0.000s
I20260709 13:17:13.853921 13187 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:13.856679  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.857100  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:13.900249  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.858294  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:13.900735  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44147.8us
I20260709 13:17:13.832554  8915 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.859961 13186 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:13.859192  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.902881  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.860745  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.918459  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:13.918833  8837 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:13.872848 13140 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:13.863157 13218 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.281s	user 0.003s	sys 0.004s
I20260709 13:17:13.863636  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:13.784623 13198 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.699025 13180 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.841646 13096 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:13.896814  8840 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:13.902760 13187 consensus_queue.cc:1243] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:13.930720  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:13.860697 13099 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:13.703648 13117 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:13.934281 13214 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.353s	user 0.004s	sys 0.002s
I20260709 13:17:13.936228  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:13.947544  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.949476  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:13.970242  8839 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:13.953372  8917 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:13.857824  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:13.902561 13069 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:13.971421  8840 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:13.973891  8840 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.982122  8840 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:13.954552 13176 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:13.988011  8913 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:13.954733 13126 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.946389 13088 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:13.899526 13129 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:13.977007  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:13.957619 13075 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:13.991552  8918 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:13.942112 13073 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:17:13.980422 13134 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:13.968006 13119 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:14.000087 13126 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:14.004981 13217 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:17:13.989967 13000 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.021132 13196 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:13.996275 13088 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.026422 13186 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:13.965678 13071 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:14.030030 13096 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.030331  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:13.995669  8917 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:14.051512  8915 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:14.053491  8913 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
W20260709 13:17:14.055207  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 446741us
I20260709 13:17:13.990767 13076 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:13.997229 13221 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.064936  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:14.093163  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:14.065418 13088 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.066082 13092 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.066339 12815 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.085861  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.105026  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.087345  8910 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:14.087432  8915 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.002442 13075 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.098230 13221 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.099049 13092 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.101804  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:14.106460  8768 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:14.107105  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:14.107537  8766 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:14.128355  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:14.061887 13120 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:14.146711  8764 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.127854  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:14.115403  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:14.073503 13171 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.113054  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:14.052919 13119 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:14.172254  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:14.181466  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 68517.5us
I20260709 13:17:14.181461  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:14.095118 13176 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.096099 13076 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.140542 13117 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:14.184587  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:14.178597 13217 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:14.149709 13000 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.123144 13128 raft_consensus.cc:2764] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:14.194767  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.198304  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.203261  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.204274  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.187755 13228 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.100240 13069 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 13:17:14.239229  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.206677  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.207023  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.208463 13224 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.205380 13228 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:14.209446  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.210659 13226 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:14.211172 12864 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.215557  8764 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:14.217638 13129 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.199342 13134 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.197077 13186 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.187984 13220 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.004s
I20260709 13:17:14.219874  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.221822  8913 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:14.229163 13158 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.186800 13091 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.267737  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.259557  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:14.263664  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.269534  8917 raft_consensus.cc:2410] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:14.265563  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.188913 13099 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:14.270380  8912 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:14.228544 13207 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:14.267598  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60628.4us
I20260709 13:17:14.279596  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.197888 13000 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.282163  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.197515 13092 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:14.289603  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.293316  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.293561  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:14.283429 13127 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:14.255571 13228 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.194898 13195 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.299319 13195 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.300107 13129 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:14.300691 13129 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.301282 13129 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.279345 13220 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.303470 13220 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.303594  8838 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:14.304726  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.301307  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.295640 13221 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:14.257232 13180 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.310094  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:14.313198 13230 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:17:14.295675 13231 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:17:14.314628  8909 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:14.286353 13000 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.314075  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.329238  8913 raft_consensus.cc:2410] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:14.306874 12802 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.333192  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.284773 13186 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:14.347869 13222 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:14.320386 13195 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:14.328689 13220 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.304916 13092 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:14.353348 13222 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:14.353682 13210 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.369586 13222 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.285250 13091 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:14.352444  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 112260us
I20260709 13:17:14.359040 12802 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:17:14.363056 13076 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:14.365542 13092 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.308519 13099 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:14.386391 13091 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.387818 13099 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.389051 13096 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.391369 13119 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:14.350423 13194 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.005s
I20260709 13:17:14.373973  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.377671  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.395316  8915 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:14.381412  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.396965  8913 raft_consensus.cc:2410] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:14.385135  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:14.397662  9464 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.385613  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:14.399096  9463 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:14.385788  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:14.403357  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.406857  8916 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:14.357896 13195 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:14.445544  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:14.450883 13237 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:14.453364  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:14.455868 13235 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:14.457571  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:14.457479  9461 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:14.464759  9464 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:14.467067  9463 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:14.469349 13096 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.471532 13096 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.469426  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 75879.6us
I20260709 13:17:14.472060 13096 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:14.473047 13238 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:17:14.478719  8913 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:14.380920 13161 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:14.592998  8916 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:14.598017 12956 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.598623 13107 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.603927 13129 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.607144 13228 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:14.610172  9467 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:14.476948 13195 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.532739 13180 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.446931 13091 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.172s
I20260709 13:17:14.618865  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:14.620307  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:14.445221 13192 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.150s
I20260709 13:17:14.629791  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:14.632946  8916 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:14.589087 13075 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:14.634435  8835 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:14.635840  8840 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:14.636013  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.637324  8913 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:14.638025  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:14.639375  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:14.614621 13177 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.641242  8840 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:14.661531  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.673786  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.674435  8913 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.675993  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.630170 12815 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.663619 13210 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:14.640547 13107 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.547158 13161 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:14.685740  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 379851us
W20260709 13:17:14.651525 13140 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.000s
I20260709 13:17:14.710750 13161 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.706571 13210 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.715061 13210 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.672499 13177 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:14.718407  8914 raft_consensus.cc:2410] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:14.676223 13164 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:14.720444 13164 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.723027 13000 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.724843  8916 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:14.702914 12815 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.727133 12815 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.727955 13107 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:17:14.729475 13249 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:14.632731 13180 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.703222 13228 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.733500 12986 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.734025 12986 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.735242 13180 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.706914 13220 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.738561  8916 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:14.739662  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.742286  8915 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:14.742722  8918 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:14.707612  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:14.670297 13173 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:17:14.680372 13127 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:14.745967  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.747972  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:14.749325  8916 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:14.751080  8916 pending_rounds.cc:85] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 6
I20260709 13:17:14.750936  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.751345  8916 pending_rounds.cc:107] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:14.751603  8916 raft_consensus.cc:2889] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:14.752290 13242 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:17:14.753269 13000 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.753450 13247 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:14.754009 13186 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:14.757472 13129 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.758744 13096 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:14.760375  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:14.771746 13211 consensus_meta.cc:287] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.017s	user 0.013s	sys 0.000s
I20260709 13:17:14.773383 13247 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:14.774397 13247 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.777853  8841 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:17:14.767225  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:14.780113  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.749763 13200 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:14.793563  8807 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:14.779561 13224 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.003s
I20260709 13:17:14.766418 13129 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:14.772301 13211 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.810456  8913 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:14.811470  8917 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:14.811759  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:14.812575  8841 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.815151  8840 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.815151  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:14.815968  8835 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.817188  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:14.794755 12956 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:14.807487  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 160373us
I20260709 13:17:14.821874  8843 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [9.6-13.8]
I20260709 13:17:14.794118 13220 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:14.820631  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.819205  8840 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:14.823952  8836 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:14.824995  8836 pending_rounds.cc:85] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 5
I20260709 13:17:14.825274  8836 pending_rounds.cc:107] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:14.825516  8836 raft_consensus.cc:2889] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.780247 13000 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:17:14.793875 13200 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:14.807132 13129 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.833977  8844 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.828437  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:14.818810 13224 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:14.835868  8913 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:14.836349  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.823297 12815 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:14.916105  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:14.897864  8841 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:14.909549  8837 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:14.926174  8835 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:14.910226  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:14.911055  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:14.909412  8844 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:14.833402 13167 consensus_queue.cc:1059] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:14.897478  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.898017 13186 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.835568 13129 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.837244 13127 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:14.925601  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2061) took 1066 ms. Trace:
I20260709 13:17:14.974817  8838 rpcz_store.cc:276] 0709 13:17:13.858984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.859104 (+   120us) service_pool.cc:224] Handling call
0709 13:17:13.859402 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.304019 (+444617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.925221 (+621202us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540039dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:14.925508 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021102464}
W20260709 13:17:14.913450 13248 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:17:14.912111 13102 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.836458 13220 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:14.948833  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 287514us
I20260709 13:17:14.964242  8913 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
W20260709 13:17:14.985595  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.986224  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:14.993872  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:14.998575  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.941871 13117 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:14.938457 13091 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:17:14.938859 13192 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:17:14.941030 13173 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:17:14.983628 13102 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.014237  8913 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:14.990799 13140 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.019626 13181 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:15.010340  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.026003  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:14.978868 13194 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:15.029278  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:14.950052 13099 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:17:15.036917 13193 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:15.037539 13182 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:15.037806 13252 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:15.038007 13182 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:15.038136  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.038463 13182 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.039320  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.040086  8843 raft_consensus.cc:2410] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:15.041188 13102 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.042503 13102 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:15.043942 13251 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:14.983554 13186 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.012252 13117 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.061235 13193 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.053498 13192 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.080080 13118 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:15.028561 13140 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.010654 13200 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.072383 13075 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.089361 13091 consensus_queue.cc:1243] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:15.080783 13118 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.093323  8913 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
W20260709 13:17:15.090819  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 97067.5us
I20260709 13:17:15.077646 13192 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.081974 13211 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.085091 13246 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:15.100008  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:15.086725 12864 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:17:15.116118  8909 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:15.117537  8909 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:15.120217 13236 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.120792 13236 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.122424 13140 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.122931 13236 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:15.124189 13255 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:15.124578  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1930) took 1677 ms. Trace:
I20260709 13:17:15.064602 13220 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.125012  8911 rpcz_store.cc:276] 0709 13:17:13.446983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.065238 (+618255us) service_pool.cc:224] Handling call
0709 13:17:14.065541 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.188752 (+123211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:14.328228 (+139476us) log.cc:844] Serialized 14 byte log entry
0709 13:17:14.760369 (+432141us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:14.760424 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:14.760477 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:15.124337 (+363860us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000fc654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:15.124385 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.124518 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13638,"prepare.queue_time_us":66607,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":685,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10674,"spinlock_wait_cycles":282632448,"thread_start_us":506701,"threads_started":2,"wal-append.queue_time_us":493145}
I20260709 13:17:15.128458  8909 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:15.093513 13075 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.145344  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:15.131457 13099 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:15.149935  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:15.129874 13195 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.156404  8910 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:17:15.156735  8910 pending_rounds.cc:85] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:17:15.157009  8910 pending_rounds.cc:107] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:17:15.157302  8910 raft_consensus.cc:2889] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.143119 13236 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.128327 13246 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.161082  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:15.164903 13118 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.135856 13193 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.157152 13186 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.150612 13099 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.175746 13096 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:15.176234 13096 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.177070 13096 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.178323 13096 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.179497 13099 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.153383 13192 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.185609 13192 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.231246  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:15.162014 13236 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.237149  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:15.237859  8910 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.226675 13139 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.301868 13139 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.302500 13129 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.304304 13139 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.305088 13075 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.305280  8913 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:15.306998  8910 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:15.259367  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.270568 13246 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.271574 13160 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.274740 13177 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.275470 12956 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.277463 13247 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:15.326071 13247 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.327644 13198 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.277627  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:15.304668 13129 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.279937  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.281735 12815 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:15.289678  8916 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:15.296913  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54286 (request call id 584) took 2249 ms. Trace:
I20260709 13:17:15.337246  9465 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:15.337416  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 59877.6us
I20260709 13:17:15.300431 13134 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.302208  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:15.333976  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.266350 13236 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.310312  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:15.323674  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.279227  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:15.342609  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.298677 13182 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.341779  8844 raft_consensus.cc:2376] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8. Re-sending same reply.
I20260709 13:17:15.340009  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.337457  9467 rpcz_store.cc:276] 0709 13:17:13.047937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.048089 (+   152us) service_pool.cc:224] Handling call
0709 13:17:15.296632 (+2248543us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540057ce54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:15.296799 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3586930432}
I20260709 13:17:15.284724 13117 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.347276  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.348717  8769 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:15.348551  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.349546  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.345917  8809 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:15.350229  8764 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:15.352305  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.354610  8839 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:15.355118  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.356704  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:15.328827 13247 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.360006  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:15.362928  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:15.378264  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.394457  8838 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:15.395103  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.395763  8764 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:15.393626  8911 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:17:15.365547  8910 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:15.373597  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.397311  8734 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.383800  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.400997  8769 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:15.344129 13198 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.402858  9434 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:15.341354 13134 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:15.344660 13180 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.406517  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.352418 13177 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.420735  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.423202  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.423991  8767 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:15.419466  9460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39884 (request call id 7) took 2867 ms. Trace:
I20260709 13:17:15.418408  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.381560 13254 raft_consensus.cc:3055] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:15.436966  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.353649 13236 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:15.350099 13069 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:15.433560  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.445340  8760 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:15.363406 13258 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:17:15.448221 13134 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.449754 13134 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.370177 13182 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.387497 13117 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:15.453311 13117 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:15.454619  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.455348  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:15.456363  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:15.457675  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.459162  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.461194  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.462913  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:15.461997 13117 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.436957 13254 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:15.466224 13254 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.467276 13254 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:15.373183 13129 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:15.468369 13129 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:15.469316 12976 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:15.469799 12976 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.434474  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.438186  8764 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:15.470137 13198 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:15.425133  9460 rpcz_store.cc:276] 0709 13:17:12.538463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.538648 (+   185us) service_pool.cc:224] Handling call
0709 13:17:15.386394 (+2847746us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540057ce54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fda0735 00007fce6fd989fa 00007fce74d604c9 00007fce6e2dcc54 00007fce6e2dcbe2 00007fce6e2dcb11 00007fce6e2dca8c 00007fce6e2dbd42 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:15.405799 (+ 19405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4760948992}
I20260709 13:17:15.439459  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.470716 13198 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.404769 13102 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.436924 13160 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:15.471760  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.347302 13246 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:17:15.457544  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:15.470171 12976 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.475077 13129 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.475828 13075 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.478988 13075 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:15.479466 13075 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.471905 13160 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:15.476886  8839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
W20260709 13:17:15.477598  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3b34c95a175945b88b17f07fbc650abf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:15.484370  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:15.365898 13186 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:17:15.485541  8839 raft_consensus.cc:606] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:15.486335  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.433707  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.504303  8767 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:15.508256  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.508984  8760 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:17:15.428512 13173 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:17:15.483714 13140 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:15.507107 13247 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.426115 13180 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.540876  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.550625  8839 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:15.555747  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.553928 13096 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.557921 13096 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.557094  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.559175  8839 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:15.560060 13096 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.560392  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.561836  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.561990  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.562294  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.563236  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.565265  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 2021) took 1357 ms. Trace:
I20260709 13:17:15.565654  8914 rpcz_store.cc:276] 0709 13:17:14.208081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.219578 (+ 11497us) service_pool.cc:224] Handling call
0709 13:17:15.565041 (+1345463us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b540026c354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:15.565207 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060908288}
I20260709 13:17:15.547595  8843 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:15.569288  8915 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:15.569664  8915 pending_rounds.cc:85] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 4
I20260709 13:17:15.569859  8915 pending_rounds.cc:107] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:15.570080  8915 raft_consensus.cc:2889] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.538021 12815 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:15.544644 12956 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.545552 13140 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:15.592854  8768 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:15.625098  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:15.625924  8840 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:15.627486  8840 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:15.589114 12864 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.587956 13096 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.549829 13247 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.621819 13140 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.623370 13182 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:15.651382  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 167075us
I20260709 13:17:15.623835 13069 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.632143 13125 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:15.657066  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.655493  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:15.663461  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.591354 12815 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.639050 13198 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.619963 12956 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.674062  8842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:15.686990  8842 raft_consensus.cc:606] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:15.687466  8842 raft_consensus.cc:614] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:15.669977  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.691845  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:15.694284  8842 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:15.668905  8732 connection.cc:256] RPC call timeout handler was delayed by -1.2037431050000578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:17:15.698202  8732 connection.cc:256] RPC call timeout handler was delayed by -1.1659431049999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1562s for a response
W20260709 13:17:15.698690  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0822431050000887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:17:15.699165  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0732431050000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:17:15.699671  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0327431050000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 13:17:15.702128  8842 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:15.706553  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:15.729372 13277 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.730208 13277 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.647648 13096 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.624403 13160 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.683876 13125 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.708449 13161 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:15.700457 13194 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.708069 13099 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:15.680896 13182 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.671130 13069 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.746426  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.764343  8844 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:15.765117  8838 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:15.749286  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.762221  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.767977  9461 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:15.753589 13161 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.770006 13161 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:15.744788 13247 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.774369  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.751509 12815 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:15.737413 13268 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:15.762800 13193 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:15.780779  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.778127  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:15.806607  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.808682  8844 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 13:17:15.780092  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.754364 13194 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:15.757262 13099 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.748672 13276 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:15.761329 13069 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.747668 13125 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.759114 13182 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.736429 13096 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.758955 13126 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.732828 13277 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.823490  8843 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 13:17:15.824792  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 176876us
W20260709 13:17:15.832429  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.809219 13175 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:15.841718 12956 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:15.846156 13276 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:15.838809  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 146849us
W20260709 13:17:15.855651  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 220284us
I20260709 13:17:15.820813 13194 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.822033 13099 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.855125  8843 pending_rounds.cc:85] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 6
I20260709 13:17:15.881522  8843 pending_rounds.cc:107] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:15.881350  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:15.834129 13193 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.881821  8843 raft_consensus.cc:2889] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.878211  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.879488  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.854290 13069 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:15.883760  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.858680 13175 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:15.880492 13180 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.897204  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:15.922695  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 267273us
I20260709 13:17:15.895171 13117 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:15.896840 13182 consensus_queue.cc:1059] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:15.893690 13096 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:15.918651 12976 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.921305 13193 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.922920  9462 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:15.898437  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.923797  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:15.937119  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53463.7us
I20260709 13:17:15.884765 13161 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:15.940059  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:15.907507 13075 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.988181 13117 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:15.938277 12986 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:15.950728  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:15.976483  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:16.032490 12864 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.948671 13288 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.027568 13286 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.029385 13192 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:15.952729 13194 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:15.945878 12787 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:16.006440  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:15.971724  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:15.959388  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:16.026005  8915 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.034840  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:15.924885 13069 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:16.027721  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75772.8us
I20260709 13:17:16.028661  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.035019  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.015483  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.052150  8911 raft_consensus.cc:2410] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 12 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:16.052418  8917 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:16.053545  8765 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:16.056579  8918 raft_consensus.cc:2393] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:16.040813  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.037506  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:16.047986  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 205315us
W20260709 13:17:16.060425  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.062822  8909 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:16.048995  8766 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
W20260709 13:17:16.035288  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 84691.5us
I20260709 13:17:16.066385  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.028244 13180 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.031109 13161 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:16.060056 13160 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.093194 13160 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.094573  9464 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:16.095544  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.095748 13160 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:16.095748 13293 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.097285  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:16.100744 13069 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.046701 13194 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.101562 13069 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:16.102022 13069 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.102421 13069 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.102209 13236 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:16.103324 13236 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.103689 13236 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:16.104472 13293 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:16.114193  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 215909us
I20260709 13:17:16.059607 13117 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.080199 13200 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.087316  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2090) took 1180 ms. Trace:
I20260709 13:17:16.117548  8838 rpcz_store.cc:276] 0709 13:17:14.907164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.564090 (+656926us) service_pool.cc:224] Handling call
0709 13:17:15.764897 (+200807us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.765490 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.087100 (+321610us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001e5850. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:16.087248 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461059328}
W20260709 13:17:16.041333 13281 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:17:16.031380 13182 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.041875 13192 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.040488 13286 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.106439  8916 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:16.035243 12864 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.107842  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:16.041648 13277 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.946902 13099 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.033280 13289 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:16.076958 13161 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:16.140540  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:16.128168  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:16.050732 13175 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.047066 12787 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.140057 13278 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:16.146248 13278 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:16.146867 12787 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:16.147130 13278 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.141657 13099 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.134254 13286 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.142171 13289 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.153208 13118 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:16.154727 13289 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:16.156024 13075 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:16.156795 13192 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:16.143396 13161 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.115310 13290 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:16.145527 13276 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:16.037379 13288 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.144842 13175 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.158805  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.206610 12986 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:16.206761  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48042.5us
I20260709 13:17:16.207661  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.208467 13075 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.208814  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:16.159678  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 219706us
I20260709 13:17:16.161727  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:16.210434  8763 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.211576  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.212826  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.213583 13180 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.214255 13180 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.215525  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.141608  8766 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:16.111907 13140 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.181535  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:16.163764 13096 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:16.140417 12864 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.114450 13198 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:17:16.196372  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:16.232020  9464 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:16.165634 13161 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.205101  8735 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:16.217898  8763 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:16.216976 13192 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:17:16.221412 13289 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:16.221719  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.224714 13075 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:16.228883  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.104581 13236 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:16.237062  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 100975us
I20260709 13:17:16.240521  8911 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.227684 13290 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.248092  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:16.249497  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.250787  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.252804  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.253490  8840 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:16.254478  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.255463  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.256189  8843 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:16.237924 12976 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:16.261691 13292 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:17:16.262215  8838 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.278347  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.263547 12864 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:16.264599  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 497) took 1210 ms. Trace:
I20260709 13:17:16.261595  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.271878  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:16.276633 13192 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.277300  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:16.257867 12787 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:16.237277 13096 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:16.283386  8839 rpcz_store.cc:276] 0709 13:17:15.054046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.564897 (+510851us) service_pool.cc:224] Handling call
0709 13:17:15.565213 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.695696 (+130483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:15.695766 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:15.707550 (+ 11784us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.082123 (+374573us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b18003f0b80. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:17:16.201313 (+119190us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:16.201372 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.264277 (+ 62905us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003a5f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:16.264323 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.264365 (+    42us) raft_consensus.cc:1685] finished
0709 13:17:16.264383 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.264535 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25534,"raft.queue_time_us":33887,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":10406,"spinlock_wait_cycles":281031296,"thread_start_us":118939,"threads_started":1,"wal-append.queue_time_us":479748}
W20260709 13:17:16.285820  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.289951  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:16.287925 13186 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.020s
I20260709 13:17:16.248526 13293 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:16.298184 13186 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.006s	sys 0.020s
I20260709 13:17:16.298920 13186 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.299086 13286 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.301497 13286 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:16.303798  8734 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:16.293542 13236 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.305688 13186 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.281332 13102 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.287043 12787 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:16.308560 13186 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:16.308956 12787 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.313364 13277 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:17:16.335774  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:17:16.337833  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.294823 13300 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.297407 13192 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.302486 13293 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.323009 13175 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.335208  8666 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:17:16.352525  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 135953us
I20260709 13:17:16.336299 13186 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:16.362174  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.342329 13102 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.353241 13293 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.358556 13175 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.405901  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:16.410288 13117 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:16.410593 13195 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:16.413054 13288 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:16.413239  8666 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.419641  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:16.378445 13102 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:16.412592 13117 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:16.415786  8666 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:16.429759  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 139917us
I20260709 13:17:16.404088 13175 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:16.429077  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 185056us
I20260709 13:17:16.377177 13186 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.421311 12986 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.442654  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:16.447207  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.427354 13102 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.424024 12815 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:16.430780 13117 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:16.465703  8841 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:16.465689  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.466572  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.484733  8844 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:17:16.480957  8838 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:16.381141 13096 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.446123 13140 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:16.492946  8844 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:17:16.489714  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45841.4us
W20260709 13:17:16.496752  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.497021  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.497612  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.497789  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.498176  8916 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.498303  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.498638  8915 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.495352  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.500509  8911 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.500641  8913 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.482440 13161 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.486224 13117 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.505578  8909 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:17:16.506511  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.510037  8918 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.506018  9434 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:16.508798  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.511498  8912 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:16.517040  8912 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.506956  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.519390  9467 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.520440  8909 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:16.523730  8911 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:16.456825 13289 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:17:16.525506 13127 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.531262 13160 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:16.527802 13173 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:16.528216 13015 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:17:16.533484  8910 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.536482  8916 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:16.538573 13186 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:16.485524 12815 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.513507 13194 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:17:16.561295  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 154784us
I20260709 13:17:16.562521  8915 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
W20260709 13:17:16.564779  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57911.5us
W20260709 13:17:16.566249  8808 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.658s (SENT)
I20260709 13:17:16.572697  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:16.570389  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 253443us
I20260709 13:17:16.573472  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.578416  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.572253  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:16.577540 13099 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.550408 13222 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:16.582732  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.580682  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:16.564129 13173 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.569499 13316 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.589748  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.599293  8915 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:16.600699  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.566012 13314 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.606441  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.607198  8916 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:16.603068  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.581934 13253 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:16.619781  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.584175 13305 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:16.564931 13127 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.617792  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.592949 13289 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.633561  8916 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:16.620657  8915 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:16.641605  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:16.621083  8808 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.206s (SENT)
I20260709 13:17:16.581766 13182 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:16.590808 13198 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.627693  8911 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.603068  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:16.667191  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 64208.7us
I20260709 13:17:16.670212  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:16.670810  8763 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.630061  8918 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:16.591416 13173 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:16.652309  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 136761us
I20260709 13:17:16.625757 13253 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:16.661767  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.673272  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:16.619522 13317 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.681751 13317 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.682226 13317 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.684149  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.661489  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.685290  8910 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:16.625188 13305 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.686980 13305 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:16.678982  8918 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:16.680739  8766 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:16.677134  8911 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:16.698446  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:16.699671  8764 raft_consensus.cc:2410] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:16.700011  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:16.700387  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:16.700994  8768 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.703297  8918 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:16.705710  8766 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:16.680135 13186 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:16.708775  8769 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:16.665637 13300 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:16.711459  8913 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.701961 13075 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.712937  8765 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:16.713606  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.701802 13311 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.606551 13316 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.718094  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.681944 13322 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:16.726099  8912 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:16.721138  8763 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:16.728302  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:16.728946  8764 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:16.760578  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:16.801872  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.836333  8915 raft_consensus.cc:2376] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12. Re-sending same reply.
I20260709 13:17:16.837893  8916 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:16.838052  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.839131  8764 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:16.839533  8835 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:16.737758  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.723183  8768 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:16.759618  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.843209  8911 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:16.789219  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:16.748000  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.742s (SENT)
W20260709 13:17:16.845888  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.799326 13263 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:16.845943  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:16.846859 13263 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:16.847880  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.847997 13263 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.849954  8841 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:16.741503  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.844635  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.853880  8911 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:16.860399  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.862232  8835 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:16.719097 13069 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.004s
I20260709 13:17:16.852339  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.864528  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:16.866338  8666 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 14, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.632320  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:16.875555  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 278974us
I20260709 13:17:16.877099  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.868485  8666 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 10, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 10 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.803675 13161 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:16.871495  8764 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.788561 13276 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:16.894533  8764 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.750463 13186 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:16.865646 13311 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.725790 12787 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.927735  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:16.955287  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 78312.9us
I20260709 13:17:16.956230  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:16.956532  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:16.938421 13325 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:16.893226 13263 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:16.937390 13293 consensus_meta.cc:287] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
W20260709 13:17:16.946486  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 198706us
I20260709 13:17:16.969097  8913 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:16.938900 13015 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:16.948773  8666 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 11, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:16.873116 13107 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:16.950702 13314 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:16.934890 13315 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.422s	user 0.002s	sys 0.009s
W20260709 13:17:16.959393  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 324885us
I20260709 13:17:16.929920  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:16.960937  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.965054 13253 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.965864  8764 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:17:16.891368 13322 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.896023 13140 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.893755 13161 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:16.855293  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:16.976208 12976 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.925498 13222 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.865612 13075 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.941592 12815 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:16.928480 13200 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.894098 13194 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:17:16.944202 13276 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:16.882474 13096 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.871801 13069 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.989470  8764 pending_rounds.cc:85] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 6
I20260709 13:17:17.017195  8764 pending_rounds.cc:107] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:16.979943 13182 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:17:17.017616  8764 raft_consensus.cc:2889] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.989672  8760 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:16.990227  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60389.6us
I20260709 13:17:17.004503 13308 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:17.020126 13308 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:17.020458  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.021422 13308 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.022082  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:16.967108 13288 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:16.930579 13127 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:16.934310 13175 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:16.927277 13305 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.967729 13309 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.008404 13253 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:17.011579  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55152.9us
I20260709 13:17:17.069840  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.071753  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:16.991887 13322 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:16.979046 13293 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:16.998960 13314 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.038977  8666 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 12, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 12 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:16.979063 13015 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:17.073405  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49921.1us
W20260709 13:17:17.029702 13301 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:17:17.007983 13107 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:16.999143 13140 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.083280  8666 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:17.095175  8666 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:17.095228  8837 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:17.002893 13222 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.061699 13290 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:17.068274 13306 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:17.025328 13288 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:17:17.016724 13200 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:17.086083 13236 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.780s	user 0.009s	sys 0.003s
I20260709 13:17:17.093304 13015 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:17.063323 13096 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:17.081705 13278 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:17.103116  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 105884us
W20260709 13:17:17.136077  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64409.3us
I20260709 13:17:17.027761 13186 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.096966 13277 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:17:17.063645 13161 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.093559 13314 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.120121 13306 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:17.161934  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.128180 13290 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:17.103188 13107 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.113989 13134 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:17.135577 13316 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.143160 13309 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:17.177141  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.131124 12815 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:17:17.180550  8662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 219) took 16779 ms (client timeout 15000 ms). Trace:
I20260709 13:17:17.130991 13195 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:17:17.125269 13276 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.168017 12787 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:17.210454  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73026.6us
I20260709 13:17:17.147737 13236 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:17:17.206497 13334 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:17.179229 13161 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:17.212381  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.969s (SENT)
I20260709 13:17:17.201480 13198 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.200776 13311 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:17.217952  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.237063  9432 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:17.260847  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48481.1us
I20260709 13:17:17.168272 13278 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:17.164988 13339 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:17:17.137183 13322 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:17.214820 13117 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
W20260709 13:17:17.315682  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.216984  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67500.1us
W20260709 13:17:17.282581 13335 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:17:17.283541 13278 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.289194 13069 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.231973 13353 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:17:17.234440 13134 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:17.261976 13198 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.258176 13306 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.266047 13341 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:17.262938  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 85915us
W20260709 13:17:17.299239 13327 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 13:17:17.296820 13102 consensus_meta.cc:287] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
W20260709 13:17:17.189698  8662 rpcz_store.cc:269] 0709 13:17:00.401604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.402053 (+   449us) service_pool.cc:224] Handling call
0709 13:17:01.058043 (+655990us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b5400002490. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc760b2 00007fce75befa89 00007fce75b87da6 00007fce75b59088 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc
0709 13:17:17.180451 (+16122408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:12.530243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:12.531029 (+   786us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:12.531073 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:17:12.531092 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:12.633528 (+102436us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:12.633644 (+   116us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:12.633677 (+    33us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:17:12.634990 (+  1313us) tablet.cc:701] Row locks acquired
0709 13:17:12.635042 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:17:12.635255 (+   213us) write_op.cc:270] Start()
0709 13:17:12.635400 (+   145us) write_op.cc:276] Timestamp: P: 1783603032635165 usec, L: 0
0709 13:17:12.635428 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:17:12.636223 (+   795us) log.cc:844] Serialized 5534 byte log entry
0709 13:17:13.141382 (+505159us) op_driver.cc:464] REPLICATION: finished
0709 13:17:13.337117 (+195735us) write_op.cc:301] APPLY: starting
0709 13:17:13.337229 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:13.688662 (+351433us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:13.689553 (+   891us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:14.296963 (+607410us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:14.297311 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:17:14.297357 (+    46us) write_op.cc:312] APPLY: finished
0709 13:17:14.297746 (+   389us) log.cc:844] Serialized 128 byte log entry
0709 13:17:14.618666 (+320920us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:14.626877 (+  8211us) write_op.cc:454] Released schema lock
0709 13:17:14.639922 (+ 13045us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:14.745487 (+105565us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:14.747256 (+  1769us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7141,"reported_tablets":53,"spinlock_wait_cycles":23202304,"child_traces":[["op",{"apply.queue_time_us":174786,"apply.run_cpu_time_us":69633,"apply.run_wall_time_us":1349970,"cfile_cache_hit":54,"cfile_cache_hit_bytes":56349,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":7700,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":14,"prepare.queue_time_us":67810,"prepare.run_cpu_time_us":14254,"prepare.run_wall_time_us":237772,"raft.queue_time_us":201427,"raft.run_cpu_time_us":16960,"raft.run_wall_time_us":113938,"replication_time_us":505721,"thread_start_us":689529,"threads_started":5,"wal-append.queue_time_us":661491,"wal-append.run_cpu_time_us":46925,"wal-append.run_wall_time_us":2311298}]]}
W20260709 13:17:17.349725  9432 leader_election.cc:336] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.212s (SENT)
I20260709 13:17:17.366500  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:17.366719  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:17.367290  8913 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:17.333549 13305 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.367354  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:17.271297 13345 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:17.395725  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46061.2us
I20260709 13:17:17.309813 13293 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.299760 13175 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:17.267611 13075 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.301331 13140 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.297719 13200 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:17.237856 13290 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.329509 13134 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:17.413092  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 201546us
W20260709 13:17:17.413679  8842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.008s	sys 0.009s
W20260709 13:17:17.334326 13317 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.006s
I20260709 13:17:17.302927 13107 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.378623 13278 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:17.457041  9431 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.018s	sys 0.014s
W20260709 13:17:17.483572  9431 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.018s	sys 0.014s
W20260709 13:17:17.484310  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 632030us
W20260709 13:17:17.461349  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54353.1us
W20260709 13:17:17.468415  8842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.009s	sys 0.009s
I20260709 13:17:17.472137  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:17.444726 13335 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:17:17.486315  9467 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:17.487731  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.491617  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 219415us
I20260709 13:17:17.494683  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.494809  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:17.495960  9467 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.402014 13102 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:17.500234  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.503872  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:17.514441  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 182577us
I20260709 13:17:17.330879 13117 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.527333  8840 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:17.527398  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 389954us
I20260709 13:17:17.484465 13222 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.483172 13278 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:17.529923  8910 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:17.534674  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:17.551739  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:17.553061  8840 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.555861  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:17.574416  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:17.575088  8844 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.477850 13317 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:17.583985  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52807.8us
I20260709 13:17:17.578564  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:17.581389  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:17.584877  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.585788  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:17.555271 13173 consensus_meta.cc:287] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.845s	user 0.011s	sys 0.002s
W20260709 13:17:17.587069  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.528220 13314 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.533776 13069 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:17.585726  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.572850 13139 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:17.604485  8840 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:17.526784 13328 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:17:17.598390 13263 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
W20260709 13:17:17.644943  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 59284us
I20260709 13:17:17.583570 13075 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:17.649294  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:17.587611 13117 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:17.652892 13359 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:17.654940 13366 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:17.655479 13366 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:17.655819  8844 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:17.626039 13173 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.658851 13173 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.660446  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:17.641156 13139 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.661389  8844 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.663375 13139 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.663913 13139 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.641215 12815 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:17:17.665586 12815 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:17.665953 12815 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:17.666782 12815 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.667979 12815 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.643038 13278 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.669848 13278 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:17.671016 13348 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.465s	user 0.000s	sys 0.008s
I20260709 13:17:17.672365  8844 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:17.673961 13118 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.674746 13118 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.675396  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:17.676050  8918 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.677775 13118 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:17.678907 13361 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:17:17.685060  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 561127us
W20260709 13:17:17.686627  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 553709us
I20260709 13:17:17.688218 13344 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:17.557114 13365 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 13:17:17.689882 13289 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.690333 13344 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.692854 13344 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.693367 13289 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:17.696329  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.697118  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.698751 13175 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:17.699546 13175 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.701568  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.703846  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.627959 13069 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.706537  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.712432  9467 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
W20260709 13:17:17.718569  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.603s (SENT)
I20260709 13:17:17.719040  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.712419  8760 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.714280  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.721196  8761 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.724489  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.533289 13134 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.725164  8764 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:17.641085 13195 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:17.691182 13338 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.535s	user 0.001s	sys 0.003s
W20260709 13:17:17.696398 13337 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.485s	user 0.000s	sys 0.005s
I20260709 13:17:17.726765  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.735754  8762 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:17.727213  8918 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
W20260709 13:17:17.731551  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50490.6us
I20260709 13:17:17.722327 13069 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.734297  8734 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:17:17.717988 13340 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.388s	user 0.001s	sys 0.001s
I20260709 13:17:17.626209 13015 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.690374 12986 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.705902 13367 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.793180 13367 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.714699 13075 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.795737 13367 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.753734  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 457) took 1044 ms. Trace:
I20260709 13:17:17.716002 13276 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.796640  8910 rpcz_store.cc:276] 0709 13:17:16.709770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.709939 (+   169us) service_pool.cc:224] Handling call
0709 13:17:16.710279 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.541728 (+831449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.753394 (+211666us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540031a954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:17.753650 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884601728}
I20260709 13:17:17.755966  8764 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:17.732925  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:17.757776  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:17.760848  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.803211  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45554.1us
I20260709 13:17:17.764505  8768 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:17.758884 12976 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.003s
W20260709 13:17:17.808151  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75336.1us
I20260709 13:17:17.765075  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.757520 13173 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:17.777053 13015 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.808574  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:17.778788 13102 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:17.780202 13175 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:17.815563  8762 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:17.815833  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:17.737210 13301 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:17.765318 13369 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.791911  8761 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:17.777782  9465 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:17.733476 13195 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:17.799642  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.655877 13366 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.805689  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:17.806946  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:17.777787  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:17.832800  8910 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:17.808959  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.809165  8765 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 13:17:17.803584  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3b34c95a175945b88b17f07fbc650abf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:17.756470 13139 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:17.770669 13314 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:17.824998 13369 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.827056 13342 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:17.829239  8760 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:17.796203 13075 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:17.834947  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:17.814774 12976 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.800963 13367 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.817169 13328 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:17.846007  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.822749 13198 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.863229  9464 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:17.863314  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:17.866647  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 217442us
I20260709 13:17:17.867425  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.867939  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.868631  8760 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:17.868711  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.843439 13102 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.864353 13195 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.817780 13336 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:17:17.871874  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.870816  8760 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:17.803814 12986 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.873709  8765 raft_consensus.cc:2368] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
I20260709 13:17:17.874452  8768 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:17:17.878340  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:17.874997  8764 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:17.878855  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:17.883551  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.872000  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.885509  8768 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 8: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:17.885768  8766 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:17.885483  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.879853  8734 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:17:17.891947  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.857743 13314 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:17.901125  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.899206  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:17.899755  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.870862 13117 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.900694  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.903347  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.905601  8766 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:17.909219  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.859794 13289 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:17.906713  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.884143 13373 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.877589 13102 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.870549 13357 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.911430  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.883276 13175 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.849916 13139 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.912460  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:17.869760 13099 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.879699 13328 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:17.881783  8910 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:17:17.929415  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:17.930176  8760 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:17.914310  8763 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:17.934213 13369 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.875438 13075 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:17.937294  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.903859 13127 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.897522 13198 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:17.921362  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.905509 13345 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:17.930318  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.864611 13367 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.936506  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.916028  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.869397 13364 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.928218 12976 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.903970 13355 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:17:17.907326 13117 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.910946 13194 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:17.919028 13102 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.921947 13200 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:17.917063 13373 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:17.951293  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.908169 13317 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:17.880014 13326 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:17:17.938539  8763 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:17.954955 13345 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:17.956404  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.956596  8762 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:17.935902 13175 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:17.961002 12986 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:17.963493  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:17.963546 13161 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.003s
I20260709 13:17:17.929003 13357 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:17.941371 13127 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:18.048110 13127 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.050693 13139 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:17.935626 13263 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:17.972539  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.942606 13365 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:17.981768  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2096) took 1241 ms. Trace:
I20260709 13:17:17.982311 13198 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:18.033916 13194 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:18.038326  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:17.958695 13367 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.042831  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.092559  8918 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.038838 13200 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:18.051963  8766 raft_consensus.cc:2376] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12. Re-sending same reply.
I20260709 13:17:17.981170 13117 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:17.998904  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 99768.7us
I20260709 13:17:18.036063 13373 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.057137 13263 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:18.100780  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.099228  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.101560  8766 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.067324 13357 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.103492  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:18.074457 13366 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.075879  8765 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:18.080104 13345 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.082814 13075 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.108925  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:17.980785 13314 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.084645 13193 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:18.085677  8837 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:18.086144  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.086720  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:18.086985  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.087347  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.086992  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.088434  8844 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:18.053267  8842 rpcz_store.cc:276] 0709 13:17:16.740688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.741549 (+   861us) service_pool.cc:224] Handling call
0709 13:17:16.741843 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.742047 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:16.866716 (+124669us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.980845 (+1114129us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18002fee40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a
0709 13:17:17.981290 (+   445us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.981448 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.981488 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:17.981535 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.981606 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.981715 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5774,"prepare.queue_time_us":93410,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":3857,"raft.queue_time_us":122293,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":17458,"spinlock_wait_cycles":4675968,"thread_start_us":692262,"threads_started":2,"wal-append.queue_time_us":616112}
I20260709 13:17:18.089337  8760 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:18.089531  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.112363  8763 raft_consensus.cc:2376] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:17:17.997226 13328 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.057734 13365 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:18.098492 13355 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:18.105794  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.105966  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.106884  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.130688  8764 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:18.054466 13069 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.105243 13278 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.106899 13358 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.110870  8835 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:18.111440  8844 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:18.111459  8839 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:18.110278  8836 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:18.094129 13354 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:18.098305 12986 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.119935  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 508) took 1443 ms. Trace:
I20260709 13:17:18.104511 13367 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:18.162892 13367 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:18.163035 13322 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.124032 13365 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.163379 13182 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.163949 13182 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.100376 13290 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.975643 12976 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.107254  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:18.135083  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.137645 13195 raft_consensus.cc:2764] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:17:18.137109 13253 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 1.062s	user 0.012s	sys 0.002s
I20260709 13:17:18.104960 13173 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:17:18.109010 13381 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.192657  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.116576 13075 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.113523 13193 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:18.150391 13357 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:17:18.192500  9460 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:18.161074 13263 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.150158 13354 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.162597 13373 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.126943  9465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 602) took 1004 ms. Trace:
I20260709 13:17:18.139688  8765 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:18.163398 13367 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:18.172286  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.148319  8766 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:18.205428  9465 rpcz_store.cc:276] 0709 13:17:17.122880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.123016 (+   136us) service_pool.cc:224] Handling call
0709 13:17:17.142723 (+ 19707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.828978 (+686255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.126683 (+297705us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54004637d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:18.126880 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459889024}
I20260709 13:17:18.214799  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.215467  8766 raft_consensus.cc:2376] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12. Re-sending same reply.
I20260709 13:17:18.216296  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.216781  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.148737 13352 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:17:18.153069  8838 rpcz_store.cc:276] 0709 13:17:16.676526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.676635 (+   109us) service_pool.cc:224] Handling call
0709 13:17:16.676967 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.677298 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.677337 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.677831 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.895655 (+217824us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:16.895703 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.895890 (+   187us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.056280 (+1160390us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b24002a2318. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccebfb0 00007fce6f962488 00007fce6f962be8 00007fce6f93a398 00007fce6f93576a 00007fce6f934bb6
0709 13:17:18.113671 (+ 57391us) raft_consensus.cc:1685] finished
0709 13:17:18.113871 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.119868 (+  5997us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15725,"raft.queue_time_us":959,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3628,"spinlock_wait_cycles":8771840,"thread_start_us":213790,"threads_started":1,"wal-append.queue_time_us":305034}
I20260709 13:17:18.196419 13381 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:18.147900 13278 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:18.173195  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66065.4us
W20260709 13:17:18.206243  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.150795 13222 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:18.206239  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:18.206818  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.209046  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.173856 13366 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.178402 13317 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:18.138747 13355 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:18.259433  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.156478  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.239281  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.276281  8766 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.239193  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.175323 13200 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.204972 13336 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.174770 13194 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.246758  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:18.294764  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48119.7us
I20260709 13:17:18.196969 13193 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.177671 13290 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.249531  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.305094  8760 raft_consensus.cc:2376] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11. Re-sending same reply.
I20260709 13:17:18.250501  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.306164  8765 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:18.306718  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.307408  8840 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:18.306775  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.225603 13195 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:18.238871 12815 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:18.280055  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 123714us
I20260709 13:17:18.281101  8764 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:18.198400 13182 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.289743 13383 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.239274 13139 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:18.299103  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:18.171047 12986 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.299947  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.337477  8911 raft_consensus.cc:2376] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13. Re-sending same reply.
I20260709 13:17:18.294008 13277 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:18.299965  8913 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:18.302389  8838 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:18.279577 13317 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:18.247371 13314 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:17:18.326282  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.304069 13276 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.319002  8766 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:18.329243  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:18.330571  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.284459 13117 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.345793  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.346768  8760 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
I20260709 13:17:18.348003  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:18.324492  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.308693  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:18.335078 13344 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:18.336225 13389 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:18.302654  8915 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:18.329599 12815 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.353746  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.349759  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.350163  8842 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.351082  8912 raft_consensus.cc:2410] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:18.355392  8760 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:18.332847 13193 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:18.342686 13382 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.244s	user 0.003s	sys 0.002s
I20260709 13:17:18.329829 13195 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:18.358418  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.355051  8764 raft_consensus.cc:2376] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13. Re-sending same reply.
I20260709 13:17:18.362638  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:18.371470  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.372143  8760 raft_consensus.cc:2376] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12. Re-sending same reply.
I20260709 13:17:18.372938  8766 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:18.373114  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.373934  8760 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:18.340252 13277 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.296734 13336 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.381214  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.370878 13175 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:18.377313  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.341456 13383 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:18.350783 13358 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.383647  8760 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
W20260709 13:17:18.393759  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.357986 12815 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:18.402141  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.426589 13385 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:17:18.428320 13075 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.376513 13102 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.376185 13195 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.433590 13306 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:18.434197 13306 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.435478 13354 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.357635 13069 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:18.436522 13306 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:18.437333  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.377096 13277 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.433173  8766 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:18.438536 13358 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.441416 13383 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:18.444072 13391 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:17:18.444360 12986 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:18.444804 12976 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:18.445813 13390 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:18.447027 13290 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.282853 13367 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.432783 13102 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.343609 13381 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.453280 13069 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.453713  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:18.466943  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 73620.3us
I20260709 13:17:18.473510  8760 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:18.467657  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.475175  8842 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:18.475296  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.477716  8763 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:18.485641  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.486915  8763 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:18.480722 13069 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.489910 13107 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:18.490161  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.491135  8764 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:17:18.492357  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.495153 13306 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.490535 13107 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:18.498768  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.499104  8764 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:18.493067 13317 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.520905  8910 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.503296 13355 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.504797  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.527344  8843 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:18.505038 13015 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:18.514999  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.515481  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.515769  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.500473 13373 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.492920 13069 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:18.516363  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.521818  8760 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:18.542737  8835 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:17:18.542914  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.543524  8760 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.500931  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.547475  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.505434 13127 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.551607  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.553145  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.556026  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.556675  8767 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:18.541092 12986 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.560986  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.532721 13015 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:18.563323  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.563975  8915 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:18.564771  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.565438  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.565635  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.566241  8916 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:18.567080  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:18.567612  8909 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.569247  8838 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:18.570851  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.571717  8763 raft_consensus.cc:2410] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:18.572221  8838 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:18.573526  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.573722  8914 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: [14.12-16.13]
I20260709 13:17:18.574781  8918 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:17:18.576362  8767 raft_consensus.cc:2410] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:18.577768  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.578830  8912 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:18.579209  8838 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:18.580463  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:18.581398  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.520360 13107 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.533005 13306 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.588665  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.591797  8760 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 9.
I20260709 13:17:18.591741  8909 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:18.592303  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:18.592689  8840 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:18.592922  8842 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.594841  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.599952  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.607026  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.608461  8767 raft_consensus.cc:2410] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:18.610513  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.614627  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:18.615727  8835 raft_consensus.cc:2393] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 8: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:18.623991  8913 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:18.625375  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.626034  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.626669  8835 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:18.631390  8842 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:18.572525 12986 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.620173 13305 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.623116 13322 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:18.643738  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.646116  8835 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.632584 13182 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.638422 13358 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.636293 13107 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.649133  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.658649  8764 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 7.
I20260709 13:17:18.644260  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.659448  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:18.659744  8842 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
W20260709 13:17:18.661433  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.667946  8917 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:18.669011  8843 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:18.669605  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:18.670094  8917 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.690558  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:18.710500  8915 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:18.649580 13314 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:18.719425 13180 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:18.720155 13326 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:18.721139 13314 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.723930  8917 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:18.724182 13314 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:18.633885 13015 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.728299  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:18.647769 13305 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.734154  8915 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:18.735293  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.651001 13182 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.736265  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:18.709721 13373 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:18.720278 13277 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.650144 13322 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:18.752840  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.727358 13355 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:17:18.738718 13015 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:18.754444 13198 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:17:18.760775  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:18.761919 13396 log.cc:927] Time spent T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:17:18.762683  8844 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.782626  8844 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.762779  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.652103  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:18.727578 13314 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:17:18.733414 13394 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:17:18.784968  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.768788 13127 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.793643  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.748454 13373 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:18.789029 13397 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 13:17:18.783486 13180 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:18.798915  8844 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:17:18.798938  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:18.800624  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.802121  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:18.797672  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:18.811980  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 98339.4us
I20260709 13:17:18.791679 13222 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:18.815371  8844 pending_rounds.cc:85] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 8
I20260709 13:17:18.816426  8844 pending_rounds.cc:107] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:17:18.805902  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:18.813980  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 103028us
I20260709 13:17:18.820075  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:18.816987  8844 raft_consensus.cc:2889] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.814081 13180 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:18.825809 13180 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.826165 12815 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.826947 13278 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.827049 13180 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.821524 13069 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:18.822713  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.816083  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:18.815146  8768 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:18.832158  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:18.834214 13134 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.794973 13306 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.794780 13394 consensus_queue.cc:1243] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:18.839517  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.838588  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:18.842185  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:18.842388  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:18.842870 13362 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.843034  9467 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:18.844008  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:18.845255  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:18.846220  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:18.846817  8764 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:18.848310 13381 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:18.848901 13381 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:18.849471  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.850906  8768 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:18.859948  9465 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:18.827713 13222 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:18.829924 13069 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:18.803375 13195 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.875880  9467 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:17:18.877473  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57536.2us
I20260709 13:17:18.845921 12986 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.885174  8765 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.887334  8762 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.889221  8762 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:18.891798  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:18.895718  8839 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:18.890688  8762 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:18.878351 13069 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:18.898254  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66152.2us
I20260709 13:17:18.898403  8762 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:18.880256 13358 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.882905 13407 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:18.904304 13412 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.906355  8765 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:17:18.858381 13409 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:17:18.904177  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:18.896551 12815 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.909916 13418 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.910488  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:18.911406  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 64186.3us
I20260709 13:17:18.907058 13305 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.908944 13394 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.849782 13381 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.880316 13410 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:17:18.918835  9462 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:18.907451 13407 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:18.908655 13277 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.923669 13414 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:18.911379 13406 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:18.927778 13416 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.928303  8807 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:18.929039 12815 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:18.916138 13355 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:18.934018  8765 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:18.908536 13358 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.906836 13222 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:18.926090 13182 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.947956  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:18.946216 13418 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.952260  8761 raft_consensus.cc:1217] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Deduplicated request from leader. Original: 7.3->[9.4-11.5]   Dedup: 11.5->[]
I20260709 13:17:18.949254  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1975) took 1190 ms. Trace:
I20260709 13:17:21.693310  8769 rpcz_store.cc:276] 0709 13:17:17.759486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.759602 (+   116us) service_pool.cc:224] Handling call
0709 13:17:17.762539 (+  2937us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:17.763593 (+  1054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.763638 (+    45us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:17.764498 (+   860us) log.cc:844] Serialized 78 byte log entry
0709 13:17:18.756546 (+992048us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b18002bb580. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:17:18.828844 (+ 72298us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:18.925549 (+ 96705us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.941690 (+ 16141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.942086 (+   396us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.942151 (+    65us) raft_consensus.cc:1685] finished
0709 13:17:18.948904 (+  6753us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.949167 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9845,"prepare.queue_time_us":149812,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":17827,"raft.queue_time_us":26052,"raft.run_cpu_time_us":319,"raft.run_wall_time_us":38236,"spinlock_wait_cycles":10703232,"thread_start_us":156256,"threads_started":2,"wal-append.queue_time_us":1108383,"wal-append.run_cpu_time_us":3001,"wal-append.run_wall_time_us":1025179}
I20260709 13:17:20.778191 13427 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.337702 13423 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.702523 13423 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:20.756209 13424 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.711076 13424 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:20.768343 13426 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:21.713809 13426 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:21.280922 13428 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.292848 13430 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:21.297971 13431 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.718238 13431 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.717967 13430 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:21.719447 13428 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.299551 13432 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:21.386543  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2119) took 2796 ms. Trace:
I20260709 13:17:18.968837  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:21.326988  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 1980) took 3027 ms. Trace:
W20260709 13:17:21.261775  9432 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.206s (SENT) [suppressed 45 similar messages]
W20260709 13:17:19.045061  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.087142  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.400257  9462 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54308 (request call id 543) took 2557 ms (client timeout 2404 ms). Trace:
W20260709 13:17:21.964880  9462 rpcz_store.cc:269] 0709 13:17:18.842597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.843759 (+  1162us) service_pool.cc:224] Handling call
0709 13:17:21.399626 (+2555867us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b5400620054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:21.399914 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170551040}
I20260709 13:17:20.081154 12986 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.667973 13015 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.429239 13069 consensus_meta.cc:287] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 1.520s	user 0.009s	sys 0.005s
I20260709 13:17:21.987303 13366 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.988204 13069 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:19.665386 13140 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.990602 13139 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:21.990866 13140 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.991572 13139 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.353761 13117 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:21.994849 13139 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:20.290791 13134 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.456s	user 0.008s	sys 0.008s
W20260709 13:17:20.293211 13277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.047s	sys 0.144s
W20260709 13:17:19.019161 13193 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:17:21.351222 13127 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:20.353216 13180 consensus_meta.cc:287] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.526s	user 0.006s	sys 0.007s
I20260709 13:17:18.948649 13317 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:17:19.310047 13195 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.971438 13306 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:18.946189 13355 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:21.358132 13357 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:18.975526 13358 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:18.939582 13373 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:18.947490 13406 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:18.973016 13413 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:17:18.945947 13414 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.978935 13418 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.435362 13410 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:18.988745 13394 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.990873 13407 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:18.973623 13408 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:17:21.429347  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 2.5008e+06us
I20260709 13:17:21.439592 13434 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.449419 13436 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.454135 13438 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.461675  8883 connection.cc:256] RPC call timeout handler was delayed by -1.5162268589999712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
I20260709 13:17:21.468731  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1986) took 3378 ms. Trace:
W20260709 13:17:21.470288  8764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.600s	user 0.035s	sys 0.128s
I20260709 13:17:21.475243  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1987) took 3382 ms. Trace:
I20260709 13:17:21.503858 13441 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:21.523353 13440 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.525624  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.526556  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:21.538384  8762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.633s	user 0.092s	sys 0.108s
I20260709 13:17:21.539619  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2132) took 2875 ms. Trace:
W20260709 13:17:21.569459 13326 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.818s	user 0.011s	sys 0.032s
I20260709 13:17:21.594022 13443 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.594987 13445 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.602061 13444 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.605444  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.613998 13446 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.630582 13314 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.632802 13439 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.637218 13448 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:21.638103  8732 connection.cc:256] RPC call timeout handler was delayed by -1.3640420179999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 13:17:21.641345 13447 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:21.641652  8913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 1987) took 3078 ms (client timeout 2207 ms). Trace:
I20260709 13:17:21.648710 13336 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:21.721371 13430 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:21.722139 13431 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:21.721449  8839 rpcz_store.cc:276] 0709 13:17:18.590086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.590701 (+   615us) service_pool.cc:224] Handling call
0709 13:17:18.591045 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.896241 (+305196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.385793 (+2489552us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540021d254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:21.386230 (+   437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700246912}
I20260709 13:17:21.721505 13432 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:21.723544 13423 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:21.724269  8761 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260709 13:17:21.727092 13428 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:21.699746 13427 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.784785 13194 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.796447 13426 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:21.797931 13424 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:21.772706  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1988) took 3677 ms. Trace:
I20260709 13:17:21.814437  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1989) took 3718 ms. Trace:
W20260709 13:17:21.816582  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 2.84756e+06us
I20260709 13:17:21.817113 13429 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:21.839442 13102 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.839864  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.848088 13409 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:21.858579  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 557141us
I20260709 13:17:21.871454 13322 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:21.875823  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 2.94712e+06us
I20260709 13:17:21.890362  8918 rpcz_store.cc:276] 0709 13:17:18.299051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.299188 (+   137us) service_pool.cc:224] Handling call
0709 13:17:18.301968 (+  2780us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.575257 (+273289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.326168 (+2750911us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54000389d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:21.326721 (+   553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":626758528}
W20260709 13:17:21.459628  8735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.545s	user 0.036s	sys 0.102s
I20260709 13:17:21.909431 13222 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:21.911652  8766 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 1980) took 3986 ms (client timeout 2262 ms). Trace:
I20260709 13:17:21.912663 13367 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.912786  8768 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:21.948441  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 686898us
I20260709 13:17:21.950402 13328 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.957510  8666 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 97) took 10543 ms. Trace:
I20260709 13:17:21.958839 13392 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:21.959671  8653 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:17:21.970705 12815 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.984962 13015 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:21.976128 12986 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:21.988489 13366 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:21.989367 13352 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:21.425519 13435 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.161441  8732 connection.cc:256] RPC call timeout handler was delayed by -1.195742017999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
W20260709 13:17:22.164382  8732 connection.cc:256] RPC call timeout handler was delayed by -1.1714420179998797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:17:22.164798  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0832420179999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 13:17:22.162853  8883 connection.cc:256] RPC call timeout handler was delayed by -1.3653275780000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:17:22.165266  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0769420179999543s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:17:21.998402 13453 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:21.998809 13452 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:22.169757 12815 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.010664  8663 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 3 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.170732 13407 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:22.013520 13277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.036s	user 0.049s	sys 0.146s
I20260709 13:17:22.173096 13414 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.175158 13432 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.174712  8663 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 7 to 8, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 8 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:22.175910 13440 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.177151 13102 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.179286 13336 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:22.179948 13102 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.179550  8663 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 6 to 8, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 8 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:22.180346 13336 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.180784  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:22.162421  8765 rpcz_store.cc:276] 0709 13:17:18.090103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.466312 (+3376209us) service_pool.cc:224] Handling call
0709 13:17:21.467335 (+  1023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.467758 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.467812 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.468013 (+   201us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:21.468286 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.468360 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.468498 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.005309 13140 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:22.161602  8653 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 202116us
I20260709 13:17:22.185626 13435 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.185979 13453 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.186208 13194 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.187027 12815 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.188561 13435 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.188561 13194 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.169956 13452 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.190521 13015 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.191032 12986 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.191272 13452 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.188581 13453 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.161867  8769 rpcz_store.cc:276] 0709 13:17:18.095769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.813150 (+3717381us) service_pool.cc:224] Handling call
0709 13:17:21.813637 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.814044 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.814071 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.814131 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.814175 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.814231 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.814363 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.164486  8763 rpcz_store.cc:276] 0709 13:17:18.092564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.473101 (+3380537us) service_pool.cc:224] Handling call
0709 13:17:21.473743 (+   642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.474607 (+   864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.474649 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.474733 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.474779 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.474839 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.474985 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:22.163563  8913 rpcz_store.cc:269] 0709 13:17:18.563528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.564549 (+  1021us) service_pool.cc:224] Handling call
0709 13:17:21.641177 (+3076628us) spinlock_profiling.cc:243] Waited 58.6 ms on lock 0x7b54000eb354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:21.641400 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134738816}
I20260709 13:17:22.188851 13436 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.162572  8767 rpcz_store.cc:276] 0709 13:17:18.095424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.770955 (+3675531us) service_pool.cc:224] Handling call
0709 13:17:21.771420 (+   465us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.772148 (+   728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.772175 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.772245 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.772275 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.772330 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.772535 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:22.165771  8732 connection.cc:256] RPC call timeout handler was delayed by -1.072442017999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:17:22.194301  8732 connection.cc:256] RPC call timeout handler was delayed by -1.0337420179998844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 13:17:22.197599  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.198431 13418 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.199307 13438 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.199935 13134 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.200470 13134 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:22.200929 13134 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.201054 13306 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.201668 13306 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.202196 13438 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.203099 13314 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.205478 13195 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:22.166958 13326 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.445s	user 0.014s	sys 0.042s
I20260709 13:17:22.162750 13127 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:22.207295 13427 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.208472 13439 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.209048 13127 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.209141 13447 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.211231 13127 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.211293 13439 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.211839 13447 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.211953 13444 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.212669 13328 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.238818 13373 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.239114 13139 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:22.161793 13409 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:22.228135 13445 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.239717 13139 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.240722  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1916) took 4370 ms. Trace:
I20260709 13:17:22.239530 13373 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.241389  8761 rpcz_store.cc:276] 0709 13:17:17.870353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.870462 (+   109us) service_pool.cc:224] Handling call
0709 13:17:18.952064 (+1081602us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:22.188776 (+3236712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.240469 (+ 51693us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540034e9d0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:22.240639 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473556352}
I20260709 13:17:22.242275 13445 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.242326 13139 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.016274  8760 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:22.243711 13373 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.015542 13069 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.162250 13357 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:22.246312 13357 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.213860 13344 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:22.214986 13434 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.248238 13357 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.249361 13328 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.249858 13434 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.213112 13352 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.247812 13344 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:22.213513  8763 raft_consensus.cc:1240] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.215588 13436 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.219777 13366 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.221792  9462 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:22.224117 13452 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:22.255761  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 406) took 3803 ms. Trace:
I20260709 13:17:22.256206  8763 rpcz_store.cc:276] 0709 13:17:18.450705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.212709 (+3762004us) service_pool.cc:224] Handling call
0709 13:17:22.213238 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.253310 (+ 40072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.253597 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.185590  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1936) took 4307 ms. Trace:
W20260709 13:17:22.225932  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50416.4us
W20260709 13:17:22.226269  8764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.356s	user 0.036s	sys 0.133s
I20260709 13:17:22.164049 13410 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.257345  8768 rpcz_store.cc:276] 0709 13:17:17.877816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.851742 (+973926us) service_pool.cc:224] Handling call
0709 13:17:21.912269 (+3060527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.181543 (+269274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.185251 (+  3708us) spinlock_profiling.cc:243] Waited 3.06 s on lock 0x7b540003e650. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:22.185497 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7037730048}
I20260709 13:17:22.261013  8768 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.261592  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 415) took 3775 ms. Trace:
I20260709 13:17:22.261873  8768 rpcz_store.cc:276] 0709 13:17:18.485896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.260433 (+3774537us) service_pool.cc:224] Handling call
0709 13:17:22.260828 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.261360 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.261542 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.262539 13306 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.263350  8768 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:22.264154  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 420) took 3466 ms. Trace:
I20260709 13:17:22.228227  8769 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:22.227030 13392 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:22.228890  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.228454 13406 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.228506 13426 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:22.226073  9434 connection.cc:256] RPC call timeout handler was delayed by -1.1976622679999309s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 13:17:22.163672 13429 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.231954 13015 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.232002 13453 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:22.233271 13448 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.233196 13446 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.235219 13444 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.236044 13443 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:22.236958  8762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.331s	user 0.094s	sys 0.115s
I20260709 13:17:22.236752 13414 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.267901 13140 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 13:17:22.284626  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.250000 13328 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.214015 13441 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:22.254361  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.162508  8766 rpcz_store.cc:269] 0709 13:17:17.924608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.380840 (+456232us) service_pool.cc:224] Handling call
0709 13:17:21.910929 (+3530089us) spinlock_profiling.cc:243] Waited 50.9 ms on lock 0x7b540003e654. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:21.911275 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116971392}
W20260709 13:17:22.240970  8735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.326s	user 0.037s	sys 0.111s
I20260709 13:17:22.258333 13452 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.259262  8763 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:22.259886 13410 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.293372 13452 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:22.294123  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 3.38097e+06us
I20260709 13:17:22.295550  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:22.297173 13453 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.298607 13448 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.299432 13441 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.299706 13453 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.299908 13414 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.267665 13392 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.302359  8735 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:22.302852  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1990) took 4151 ms. Trace:
W20260709 13:17:22.226033  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48460.3us
I20260709 13:17:22.231390 13314 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.265120  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 407) took 3814 ms. Trace:
I20260709 13:17:22.269134  8768 rpcz_store.cc:276] 0709 13:17:18.798210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.262607 (+3464397us) service_pool.cc:224] Handling call
0709 13:17:22.262974 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.263805 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.264101 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.163127  8841 rpcz_store.cc:276] 0709 13:17:18.663542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.664022 (+   480us) service_pool.cc:224] Handling call
0709 13:17:18.664425 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.726946 (+ 62521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.726976 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:21.488070 (+2761094us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b2c0010b308. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:17:21.501712 (+ 13642us) log.cc:844] Serialized 52 byte log entry
0709 13:17:21.518370 (+ 16658us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.518987 (+   617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.520474 (+  1487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.537212 (+ 16738us) raft_consensus.cc:1685] finished
0709 13:17:21.537245 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.539343 (+  2098us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78095,"raft.queue_time_us":62948,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":3293,"spinlock_wait_cycles":3088128,"thread_start_us":15957,"threads_started":1,"wal-append.queue_time_us":19716}
I20260709 13:17:22.264086  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:22.272161 13429 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.291579  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 413) took 3839 ms. Trace:
I20260709 13:17:22.303804  8769 rpcz_store.cc:276] 0709 13:17:18.450986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.227495 (+3776509us) service_pool.cc:224] Handling call
0709 13:17:22.227947 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.264783 (+ 36836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.265029 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.304488  8763 rpcz_store.cc:276] 0709 13:17:18.452561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.258407 (+3805846us) service_pool.cc:224] Handling call
0709 13:17:22.258910 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.291306 (+ 32396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.291523 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.303303  8765 rpcz_store.cc:276] 0709 13:17:18.151222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.181818 (+4030596us) service_pool.cc:224] Handling call
0709 13:17:22.182479 (+   661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.301145 (+118666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.301181 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.301252 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:22.301310 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.302605 (+  1295us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400198054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:22.302655 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.302797 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":272238464}
I20260709 13:17:22.162380  8666 rpcz_store.cc:276] 0709 13:17:11.413852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.414036 (+   184us) service_pool.cc:224] Handling call
0709 13:17:11.437982 (+ 23946us) spinlock_profiling.cc:243] Waited 5.07 ms on lock 0x7b5400002490. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc760b2 00007fce75befa89 00007fce75b87da6 00007fce75b59088 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc
0709 13:17:21.957227 (+10519245us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:17.276502 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:17.277332 (+   830us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:17.277386 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:17:17.277425 (+    39us) tablet.cc:662] Decoding operations
0709 13:17:17.278751 (+  1326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:17.278833 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:17.278874 (+    41us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:17:17.279940 (+  1066us) tablet.cc:701] Row locks acquired
0709 13:17:17.279970 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:17:17.280181 (+   211us) write_op.cc:270] Start()
0709 13:17:17.280336 (+   155us) write_op.cc:276] Timestamp: P: 1783603037280108 usec, L: 0
0709 13:17:17.280366 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:17:17.359097 (+ 78731us) log.cc:844] Serialized 3631 byte log entry
0709 13:17:17.868729 (+509632us) op_driver.cc:464] REPLICATION: finished
0709 13:17:17.889711 (+ 20982us) write_op.cc:301] APPLY: starting
0709 13:17:17.889793 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:17.894190 (+  4397us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:17.894309 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:17.998961 (+104652us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:18.055250 (+ 56289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:17:18.077475 (+ 22225us) write_op.cc:312] APPLY: finished
0709 13:17:18.077810 (+   335us) log.cc:844] Serialized 88 byte log entry
0709 13:17:18.078019 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:18.078158 (+   139us) write_op.cc:454] Released schema lock
0709 13:17:18.078207 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:18.078690 (+   483us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:18.078722 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1989154,"reported_tablets":20,"spinlock_wait_cycles":11649920,"child_traces":[["op",{"apply.queue_time_us":20726,"apply.run_cpu_time_us":13028,"apply.run_wall_time_us":188943,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":137745,"prepare.run_cpu_time_us":116121,"prepare.run_wall_time_us":457663,"raft.queue_time_us":74710,"raft.run_cpu_time_us":2431,"raft.run_wall_time_us":21015,"replication_time_us":588186,"thread_start_us":473009,"threads_started":4,"wal-append.queue_time_us":431892,"wal-append.run_cpu_time_us":18202,"wal-append.run_wall_time_us":1447776}]]}
I20260709 13:17:22.297052  8663 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:22.252941 13352 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.291589  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 408) took 3840 ms. Trace:
I20260709 13:17:22.306519  8767 rpcz_store.cc:276] 0709 13:17:18.451238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.217518 (+3766280us) service_pool.cc:224] Handling call
0709 13:17:22.272483 (+ 54965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.291220 (+ 18737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.291250 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.291310 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:22.291352 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.291410 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.291533 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:22.286875 13306 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.315181 13352 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:22.316021 13352 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:22.317028 13015 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.317370 13352 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.240792 13409 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.318797 13409 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.319867 13015 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.320940 13139 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.321728 12815 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:22.321600 13139 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.322470 13434 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:22.323016 13434 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.322575 12815 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.323385 13434 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.323817 13139 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.290465 13440 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.321930 13366 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.329408 13440 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:22.329783 13366 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.330252 13443 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.330852 13440 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.285379 13355 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.332021 13366 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:22.339397  8807 connection.cc:256] RPC call timeout handler was delayed by -2.3029699010000968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 13:17:22.339664  8760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 1983) took 3678 ms (client timeout 2023 ms). Trace:
W20260709 13:17:22.341886  8807 connection.cc:256] RPC call timeout handler was delayed by -1.9780699010000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2207s for a response
W20260709 13:17:22.342621  8807 connection.cc:256] RPC call timeout handler was delayed by -1.7183980019999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:17:22.319958 13134 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:22.343122  8807 connection.cc:256] RPC call timeout handler was delayed by -1.5347980019998886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 13:17:22.343434  8807 connection.cc:256] RPC call timeout handler was delayed by -1.347169901000143s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2908s for a response
W20260709 13:17:22.342836  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 115160us
W20260709 13:17:22.342283  8760 rpcz_store.cc:269] 0709 13:17:18.661100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.762546 (+101446us) service_pool.cc:224] Handling call
0709 13:17:22.289065 (+3526519us) spinlock_profiling.cc:243] Waited 3.23 s on lock 0x7b540034f8d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:22.339594 (+ 50529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7431894400}
I20260709 13:17:22.330914 13443 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.353159  8663 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 7 to 9, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 9 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:22.360443  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 412) took 3908 ms. Trace:
I20260709 13:17:22.350281  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:22.367825  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.368929  8912 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:22.373097  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.351068  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.264942 13344 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.355255 13328 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.380206  9462 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:22.351190 13444 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.381356 13444 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.356164 13443 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:22.383827 13443 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.385249 13443 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.387162  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.388569  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.388993  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.389094  8838 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:22.389683  8838 pending_rounds.cc:85] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 6
I20260709 13:17:22.390050  8838 pending_rounds.cc:107] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 10.7
W20260709 13:17:22.390337  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49084.7us
I20260709 13:17:22.390545  8838 raft_consensus.cc:2889] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:22.391631  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:22.392592 13127 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.392817 13436 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:22.393142 13306 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.393298 13127 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.393625 13306 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.393572 13436 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:22.394249 13306 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:22.395191  8734 connection.cc:256] RPC call timeout handler was delayed by -1.3494938450000973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:17:22.395807 13436 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.397063 13441 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:22.398175 13441 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.398600  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.399184  9467 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:22.399397  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.399638 13326 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:22.400162  9464 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:22.400229 13326 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.401113 13426 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:22.400559  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.350041 13139 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.418696  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 154757us
I20260709 13:17:22.365517  8761 rpcz_store.cc:276] 0709 13:17:18.452304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.242417 (+3790113us) service_pool.cc:224] Handling call
0709 13:17:22.242849 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.243269 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.243307 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.243841 (+   534us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.277482 (+ 33641us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:22.359858 (+ 82376us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.360141 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.360208 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.360244 (+    36us) raft_consensus.cc:1685] finished
0709 13:17:22.360256 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.360377 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3261,"raft.queue_time_us":7646,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":50935,"thread_start_us":114001,"threads_started":2,"wal-append.queue_time_us":33655}
W20260709 13:17:22.418098  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 77110.9us
I20260709 13:17:22.417925  9465 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:22.429539 13355 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:22.432122  8911 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:22.437577  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.439553 12815 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.442742 13429 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.444344 13015 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.415916 13314 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.438921  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.438855  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:22.445868  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52992.5us
W20260709 13:17:22.454038  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.471503  8916 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:22.475351  8918 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.466435  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:22.477602  8913 raft_consensus.cc:1217] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Deduplicated request from leader. Original: 8.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 13:17:22.481652  8913 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:17:22.470530 13326 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.487090  8663 catalog_manager.cc:5697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:22.488497  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.453629 13139 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.489584  8915 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:22.488233  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.490801  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.492194  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.493316  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.494011  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.473765 13314 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.494117  8917 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:22.452498 13134 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.498199  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.499164  8912 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:22.500036  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:22.502200 13328 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.502409 13139 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.504690  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.466840 13448 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:17:22.505594  8917 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:22.505858 13448 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:22.506255 13448 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:22.489634  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2137) took 3900 ms. Trace:
I20260709 13:17:22.507174 13448 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.507081  8838 rpcz_store.cc:276] 0709 13:17:18.589185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.589314 (+   129us) service_pool.cc:224] Handling call
0709 13:17:18.589568 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.391893 (+3802325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.489352 (+ 97459us) spinlock_profiling.cc:243] Waited 3.8 s on lock 0x7b54001fd6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:22.489575 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8736463616}
I20260709 13:17:22.509617  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 1930) took 4633 ms. Trace:
I20260709 13:17:22.510056  8764 rpcz_store.cc:276] 0709 13:17:17.876261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.848415 (+972154us) service_pool.cc:224] Handling call
0709 13:17:18.848711 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:22.258578 (+3409867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.258638 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:22.259283 (+   645us) log.cc:844] Serialized 26 byte log entry
0709 13:17:22.346736 (+ 87453us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:22.346786 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.363304 (+ 16518us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.509318 (+146014us) raft_consensus.cc:1685] finished
0709 13:17:22.509346 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.509534 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62635,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":3468077,"threads_started":2,"wal-append.queue_time_us":176537}
I20260709 13:17:22.511209  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.512089  8769 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:22.499212 13446 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.453548 13336 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.706101 13445 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.706387  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 240073us
I20260709 13:17:22.707052  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.706815 13445 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.708184  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.708292  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:22.709301 13445 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.649940  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.709857  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.710583  8768 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:22.710583  8765 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:22.517006  8916 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
W20260709 13:17:22.609236  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.713068  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:22.462558 13015 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.711864  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.711771  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.712646  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:22.459899  8865 debug-util.cc:398] Leaking SignalData structure 0x7b08001736a0 after lost signal to thread 7660
I20260709 13:17:22.556434  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:22.713596  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.713842  8765 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.539796  8915 raft_consensus.cc:2410] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:22.514307  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.621428 13444 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:22.716120  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.718158  8865 debug-util.cc:398] Leaking SignalData structure 0x7b0800202620 after lost signal to thread 8701
W20260709 13:17:22.711308  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.717407  8769 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:17:22.718411 13195 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:22.720932 13407 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.549s	user 0.011s	sys 0.004s
I20260709 13:17:22.556221  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.722653  8768 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:22.723635 13344 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.689318 13441 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.727036 13222 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.727643  8916 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:17:22.729691 13015 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:22.731504  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.735126  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.701140 13127 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.738386  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.744793  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:22.721769  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.619256  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.745707  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:22.747568  8865 debug-util.cc:398] Leaking SignalData structure 0x7b08003baf60 after lost signal to thread 8793
I20260709 13:17:22.716105  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:22.746677  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.754391  8764 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
W20260709 13:17:22.757251  8865 debug-util.cc:398] Leaking SignalData structure 0x7b080031f280 after lost signal to thread 8868
I20260709 13:17:22.749840  8766 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:22.760443  8912 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:22.764164  8865 debug-util.cc:398] Leaking SignalData structure 0x7b08003642e0 after lost signal to thread 8869
W20260709 13:17:22.760898  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.766525  8865 debug-util.cc:398] Leaking SignalData structure 0x7b080038cb80 after lost signal to thread 8942
W20260709 13:17:22.766944  8865 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2080 after lost signal to thread 8943
W20260709 13:17:22.768419  8865 debug-util.cc:398] Leaking SignalData structure 0x7b08003a35c0 after lost signal to thread 9492
I20260709 13:17:22.768590  8915 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:17:22.769737  8865 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9ce0 after lost signal to thread 9493
I20260709 13:17:22.768707  8763 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:22.770009  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 373197us
I20260709 13:17:22.513190 13406 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:22.777374  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.772358  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:22.539000  8663 catalog_manager.cc:5697] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 4 to 6, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 6 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:22.781158  8918 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:22.781495  8769 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 13:17:22.796053  8761 raft_consensus.cc:2393] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:22.796022  8911 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:22.794713  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.799755  8912 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:22.771342 13448 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:22.803927  8768 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:22.810627  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:22.812021  8734 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:22.573194 13314 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:22.818811  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:22.593186 13139 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:22.824168  8760 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:22.825027  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 91767.9us
I20260709 13:17:22.807180 13430 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.832329  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:22.765775 13195 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:22.837143  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.837675  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.837512 13441 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:22.836993 13175 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.838018  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.838991  9464 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:22.839169 13441 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:22.839546  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.839471 13314 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.840045  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.840248 13355 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:22.840773  9465 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:22.838605 13175 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:22.842943  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 82676.4us
I20260709 13:17:22.843321  8734 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:22.840209 13314 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.845713 13314 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.849277 13407 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.849606  8912 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:22.849789 13407 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.849936  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:22.850235 13407 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.840788 13355 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:22.850857 13222 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.850916 13355 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.852460  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:22.853021  8909 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:22.853783 13127 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:22.855899  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:22.799325 13429 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:22.819641  9460 raft_consensus.cc:2376] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14. Re-sending same reply.
W20260709 13:17:22.857543  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.859431  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.576298 13410 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:22.873977  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.865134  9466 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:22.877599  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 442702us
I20260709 13:17:22.883256  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.862569 13441 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:22.888689  9464 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
W20260709 13:17:22.893885  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.895613 13441 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.901373  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.901826  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:22.891533 13127 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:22.901962  9461 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:22.908571  8912 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:22.918262  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.909512  8760 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:22.921836  8763 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:22.919858  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.931339  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:22.933032  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.910719 13443 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.003s
I20260709 13:17:22.939885  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:22.948318  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56240.5us
W20260709 13:17:22.949993  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 94150.9us
I20260709 13:17:22.951030  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:22.953645  8912 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:22.954800 13441 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:22.955261  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.956512  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.947788 13447 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:22.957863  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.958461  8764 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:22.959362  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.960363 13441 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:22.961795  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:22.962550  8769 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:22.964756  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:22.965481  9466 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.971338 13336 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:22.977267  8765 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:22.979110  8663 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 6 to 9, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:22.991467  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:22.986220  8663 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 3 to 5, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 5 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:22.909740 13429 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:17:22.995587  9466 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:22.985173  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:22.997098  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:23.004976  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.021740  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:23.022785  9464 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
W20260709 13:17:22.993510 13306 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.598s	user 0.013s	sys 0.001s
I20260709 13:17:23.026132 13430 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:23.026767  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.008090 13336 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:23.019860 13448 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.987686 13436 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 13:17:23.030905 13468 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:17:23.052102 13195 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:23.056926 13409 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.727s	user 0.015s	sys 0.000s
I20260709 13:17:23.057312 13175 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.061347  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.062067  8841 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:23.063529  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.065388  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.066411  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.067233  8911 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:23.067101 13306 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.068446  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.068871  8910 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:23.070569  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.071295  8765 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:23.071533  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.072814  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.073621  8764 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:23.074005 13306 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:23.074520  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.074641 13314 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.075359  8761 raft_consensus.cc:2410] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:23.076707  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:23.077463  8654 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:17:23.030696  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79881.4us
I20260709 13:17:23.031767 13406 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.033370 13410 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.033808 13180 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:23.034205 13127 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:22.999720  8663 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 5 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:23.083578  8768 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:23.044502  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.044502  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:23.048085  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.049620 13448 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:23.085729 13448 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:23.051489  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.089217  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:23.089593  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.089984  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.091861  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 1984) took 5108 ms. Trace:
I20260709 13:17:23.084611  8763 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:22.956612 13407 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:23.110183  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 65742.3us
I20260709 13:17:23.114557  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.120915  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:23.132797  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 88360.6us
I20260709 13:17:23.045305 13336 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.133582  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:23.137614  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.138552  8764 raft_consensus.cc:2410] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:23.131887  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.140842 13336 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:23.141196  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.140959  8838 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:23.140938  8841 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:17:23.148104 13434 consensus_meta.cc:287] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.824s	user 0.007s	sys 0.006s
I20260709 13:17:23.149289  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.141883  8839 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:23.092252  8762 rpcz_store.cc:276] 0709 13:17:17.973790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.904545 (+930755us) service_pool.cc:224] Handling call
0709 13:17:18.905024 (+   479us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:22.285278 (+3380254us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:22.453340 (+168062us) log.cc:844] Serialized 14 byte log entry
0709 13:17:22.924223 (+470883us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:22.994147 (+ 69924us) log.cc:844] Serialized 52 byte log entry
0709 13:17:22.994382 (+   235us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:22.994433 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.010485 (+ 16052us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:23.081689 (+ 71204us) raft_consensus.cc:1685] finished
0709 13:17:23.081714 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.081883 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":185391,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":34048,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":10876,"thread_start_us":3885089,"threads_started":3,"wal-append.queue_time_us":505050}
I20260709 13:17:23.153951  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.155030  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.091506 13127 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:23.150151  8766 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:23.161513  8760 raft_consensus.cc:2410] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:23.151551  8761 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:23.164428  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:23.134509 13139 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:23.178084  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:23.181027  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.182401  8769 raft_consensus.cc:2410] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:23.135970 13314 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.186188  8839 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:23.187682 13306 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:23.188501  8765 raft_consensus.cc:2410] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:23.195636  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.197343  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.197400  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.196542  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.173272 13139 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.208415  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:23.209043  8761 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.198884  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.167972 13436 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.169544 13127 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.201366  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:23.148679 13434 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.182842 13328 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.106985 13180 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.210201  8836 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
W20260709 13:17:23.220752  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.218005  8840 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:23.222048  8841 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:23.235261  8838 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:23.210748 13139 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.206848 13306 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:23.236963  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.244280  8839 raft_consensus.cc:2410] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:17:23.215029 13436 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.239030  8844 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.199867 13355 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.241601  8763 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:23.242479  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.229156  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:23.259093  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.219025 13328 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:23.279878  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.239720 13409 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.285941  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.286865  8837 raft_consensus.cc:2410] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:23.286628 13306 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.288271  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.290531  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.291849  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.282322 13328 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.293416  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.293551  8838 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:23.259405 13436 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.294749  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.294919 13180 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.295584  8836 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:23.296944  8840 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
W20260709 13:17:23.297427  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 95061.3us
I20260709 13:17:23.298413  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.299134  8844 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:23.299659  8732 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:23.300750 13448 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.301472 13448 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.302837 13355 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.307431  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:23.307512  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.308370  8839 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:23.312847  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.313061  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.313689  8844 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:23.315189  8837 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:23.315373  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.319196  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:23.319522  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:23.320973  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.320560  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 176060us
I20260709 13:17:23.322152  8840 raft_consensus.cc:2410] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:23.327822  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.328727  8836 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.333220  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.337071  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.338261  8838 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:23.341624 13472 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:17:23.345896 13344 consensus_meta.cc:287] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.598s	user 0.011s	sys 0.000s
I20260709 13:17:23.346560 13407 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:23.347546  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.257994 13336 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.349014  9461 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:17:23.350382 13434 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.315024 13180 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:17:23.366379  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 186837us
I20260709 13:17:23.371656  9431 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:23.377802  8761 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:23.361744 13448 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:23.388396  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.388664  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.389467  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.390388  8840 raft_consensus.cc:2393] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.392556 13336 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.393458 13336 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:23.399197  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.397274  8841 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:23.400504  8838 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 8.
I20260709 13:17:23.405154  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.406042  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.362920 13426 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:23.409054  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.409924  8837 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.411042  8843 raft_consensus.cc:2410] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:23.413645  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:23.400372  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48146.3us
I20260709 13:17:23.416819  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.419516  8837 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.420120  8836 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.422791  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.423754  8843 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.426643  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.427373  8840 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.381394 13328 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.431624  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:23.443971  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.405560 13344 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:17:23.407275 13448 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.452682  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:23.453300  8761 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:23.453685  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:23.454492  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:23.457095  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 85543.9us
I20260709 13:17:23.449612 13430 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.462679 13277 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:23.463138 13277 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:23.464021 13277 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.465250  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.465875  8838 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:23.451179 13446 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.469600 13446 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.470391 13448 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.471920 13446 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.441992  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011917cac276499ba01c77d911c67d8d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:23.478456  8841 raft_consensus.cc:606] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:23.486930 13430 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.489401 13430 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.491267  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:23.495406  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:23.494148 13127 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.497596  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.497205  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.496297  8767 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:23.498040  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.497820  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.514232  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.514739  8761 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:23.517076  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:23.513418 13409 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.518388  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:23.518623  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.459718 13015 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.437215 13436 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.524472  8841 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:23.461231 13306 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.526751  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73172us
I20260709 13:17:23.523582 13015 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.533389  8835 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:23.535645 13486 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:23.535429 13139 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.540805 13127 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.495551 13277 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:23.570510 13486 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:23.572252 13486 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.551210  8844 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.551982  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.574369  8842 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.574882  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.552006  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.575770  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:23.576154  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.557065 13344 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:23.577167 13127 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.576771  8844 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:23.558182  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.574246 13015 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.559237 13328 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.585202  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.586169  8836 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:23.586576  8840 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:23.586905 13306 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.589308  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:23.589943  9460 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.591615  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:23.592573 13355 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:23.568430  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.549487  8916 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:23.557802 13446 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:23.556586  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:23.595471 13222 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:23.595913 13446 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.596266  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.597016  8842 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:23.597143  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.600389 13344 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.600805 13344 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.601208 13344 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.602419 13448 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.602856 13448 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.603220 13448 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.593572 13409 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:23.604041 13409 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:23.605051 13409 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.606323 13409 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.600090  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.609083 13306 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.610306 13446 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.610739 13446 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.611083 13446 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.612300  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:23.614770 13222 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:23.588165 13436 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.626616  9460 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:23.629266  8767 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:23.628221  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:23.633524  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:23.634510  9462 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:23.639048 13306 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:23.640085 13306 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:23.641211  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.642207  8916 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:23.630813 13355 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.639166  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:23.662461  8913 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.625588 13139 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.647653 13488 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:23.648205  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:23.665428  9431 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:23.654137  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.629086 13314 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:23.631119 13180 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.633882 13407 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.641458 13306 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.686075  9462 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
W20260709 13:17:23.667244  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 100967us
I20260709 13:17:23.671034 13493 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.676059  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:23.677933 13127 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:23.674428 13328 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:23.661787 13410 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.693405  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.695839 13015 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.697319 13446 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.689114 13407 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.703481 13407 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.690140 13127 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:23.704259 13127 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.671959 13355 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.709736 13355 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.710304 13355 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:23.710783  8843 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.726537  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.726671  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:23.728003  9462 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:23.730134  8837 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:23.734753  8913 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:23.735478  8915 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:23.735935  9460 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:23.710779 13355 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:23.757390  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 316116us
I20260709 13:17:23.757711  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.763937  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.719123 13222 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:23.766397  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.780717  9462 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:23.722594 13410 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:23.798840  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 128226us
I20260709 13:17:23.818202  8916 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:23.812103  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56530.4us
I20260709 13:17:23.819116  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.824506  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.782562 13446 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.825924  8838 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:23.831519  8837 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:17:23.838379  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.840958  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:23.833812  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 109691us
I20260709 13:17:23.812534 13277 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:23.853550  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.855726  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.906147 13314 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:23.906840 13314 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:23.915858 13490 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:17:23.917743 13410 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.920083  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:23.897419  8912 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:23.927012  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:23.928246  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 104708us
I20260709 13:17:23.870682 13434 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:23.933260  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:23.937999  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.850107 13344 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.941181  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.900947 13504 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.942926  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.944270  8843 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:23.944947  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.944768  8843 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:23.857127 13502 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:17:23.952311  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.946712  8835 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
W20260709 13:17:23.953738  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 59870.7us
I20260709 13:17:23.952008  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.849534 13355 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.960244  8836 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:23.963510  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.950296 13314 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:23.954145 13426 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.963042  8843 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:23.943542 13434 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.969033  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:23.971016  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:23.950904 13504 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:23.981307  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:23.981230  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.982264  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:23.985242  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:24.058941  8768 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.978917  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:23.980599  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.978423  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:23.981856  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:23.966617 13426 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.061475  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:23.961359 13505 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:17:24.090791  8764 raft_consensus.cc:2368] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
W20260709 13:17:24.044786 13501 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:17:24.067072  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.067862  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:24.093788  8844 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:24.096290  8836 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
W20260709 13:17:24.097553  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 177548us
I20260709 13:17:23.986411 13493 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.070432  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:24.064962 13498 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 13:17:24.073166 13314 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.077335  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:24.078143  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.078851  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:24.081254  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:24.081930  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 10 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.082508 13139 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.112464  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.083276  8843 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.091923  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:23.974069  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.100195  8913 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:24.072322  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:23.984396 13434 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:23.980312 13344 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.149268  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.149530  9465 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.105330  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.106448  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:24.106487  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:24.109531  8910 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:24.109874  8918 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:24.111248  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.066746 13426 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.082901  8911 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.150941  8766 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:24.131467  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 159261us
I20260709 13:17:24.162000  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:24.151157  8840 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.109560  8909 raft_consensus.cc:2376] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13. Re-sending same reply.
I20260709 13:17:24.108479  8916 raft_consensus.cc:2376] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10. Re-sending same reply.
I20260709 13:17:24.111661 13436 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:17:24.147307  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:24.062595 13511 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:17:24.147985  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.166277  8835 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:24.162501  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.165915  8843 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:24.146943  8917 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:24.167825  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.168646  8762 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:24.168742  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.170759  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.108289 13314 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.182689  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:24.183383  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 97983.9us
I20260709 13:17:24.183367  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:24.188364  8843 raft_consensus.cc:2410] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 10 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:17:24.166723 13448 consensus_meta.cc:287] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.003s
I20260709 13:17:24.146899 13446 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.192449  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:24.195101  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 239035us
I20260709 13:17:24.200349  8767 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:24.205539  8761 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:24.150496 13514 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:24.219707  8764 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:24.149521 13139 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:24.189971 13314 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.223704 13484 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:17:24.228575 13504 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.185714 13127 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.208632 13511 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:24.208026 13430 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:24.235610  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73171.8us
I20260709 13:17:24.242636  8769 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:24.274641  8769 pending_rounds.cc:85] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 6
I20260709 13:17:24.275084  8769 pending_rounds.cc:107] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:24.275367  8769 raft_consensus.cc:2889] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.275718  8769 pending_rounds.cc:107] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:24.276016  8769 raft_consensus.cc:2889] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.247313  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.240397  8840 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
W20260709 13:17:24.260470  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.277243  8763 raft_consensus.cc:2410] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:24.277679  8843 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:24.207863 13485 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:24.261624  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.281941  8761 raft_consensus.cc:2410] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:17:24.264689  8835 raft_consensus.cc:2410] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:17:24.216692 13306 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.207293 13448 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.288201  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.232008 13508 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.224455 13514 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:24.297796  8882 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:24.214705 13446 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.275864 13511 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.282750 13430 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:24.323344  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50078.2us
I20260709 13:17:24.327818  8768 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:24.281172 13485 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:24.261523 13488 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:17:24.336748  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:24.337133  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.341943  8769 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:24.349830  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.355207  8763 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:24.367007  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.367904  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:24.338613 13430 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.334170 13511 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.373203  8763 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:24.333981 13504 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:24.322616 13484 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:17:24.382623 13448 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.388218  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.385903 13328 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:24.394869  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.400681  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:24.316123 13508 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:24.402722 13436 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:24.405292 13514 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.416563  8763 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:24.422500  9466 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.424067  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.432427  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.434408  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:24.437469 13336 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:24.440658 13336 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.443583 13426 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.394352 13504 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:24.445617 13504 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.446811 13508 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:24.447031 13314 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.447966  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:24.400660 13509 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:24.449648 13127 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.452176 13515 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:24.420672 13436 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.396880 13328 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:24.456054 13426 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:24.456893 13314 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.457784 13139 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:24.348167 13517 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:17:24.394037 13485 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:24.459002  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:24.460366 13222 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:24.462545 13015 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.448745 13509 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:24.469247  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 169621us
I20260709 13:17:24.473182  8769 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:24.473317  8761 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:24.438150 13493 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.431017 13522 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.468060  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:24.481734  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.487967  8761 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:24.482566  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.470844 13436 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.489961  8763 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:24.495488  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:24.487187 13485 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.501399  8764 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.502655 13446 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.502990  8769 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:24.504132  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:24.505620  8808 leader_election.cc:400] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
I20260709 13:17:24.505970  8808 leader_election.cc:403] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:24.506987  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.508363  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.500905 13509 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.475282 13222 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:24.518461  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:24.514125  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:24.517606  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:24.525576  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.528043  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.532155  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.529356 13508 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.534598 13535 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.529224 13139 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.537137 13139 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.537568 13139 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.520963 13410 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
I20260709 13:17:24.531627 13426 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:24.542076 13426 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.542516 13426 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.526309 13522 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:24.526098 13355 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:24.552029  8763 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 8.
W20260709 13:17:24.582343  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 284647us
I20260709 13:17:24.582882  8768 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:24.587019  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:24.590884  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 196064us
W20260709 13:17:24.592538  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60478.1us
I20260709 13:17:24.593163  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.593597  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.531832 13306 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 13:17:24.606225  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 173859us
I20260709 13:17:24.607064  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.608070  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.609555  8761 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:24.590778 13355 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.613224 13539 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:24.607121 13508 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:24.621784 13511 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.586351 13515 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:24.602048 13410 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:24.625345 13502 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:24.626103 13502 consensus_queue.cc:1243] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:24.596307 13446 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.630210 13436 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.634989 13534 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:24.635514 13534 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:24.635855 13534 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:24.645555 13535 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.645852 13436 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:24.651654  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64745.7us
I20260709 13:17:24.649046 13539 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:24.595335 13222 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.652705  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:24.653172 13222 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.654850  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:24.637579 13127 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:24.649369 13511 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.647483 13430 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.649251 13522 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:24.650763 13355 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:24.612385  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:24.656471  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57330us
I20260709 13:17:24.656213 13535 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:24.672894  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 60590.6us
I20260709 13:17:24.657992 13485 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.665761 13344 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:24.676148 13344 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:24.676846 13497 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:24.677429 13497 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:24.677260 13344 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.678308 13344 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.679566 13429 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:24.679956 13429 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:24.676030 13485 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:24.675807 13540 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:24.696992  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:24.698800  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.696784  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:24.700212  8841 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.696362  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.701891  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:24.702057  8836 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:24.645915 13328 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:24.727519  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.742472  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.733223  9460 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:24.748812  8842 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.742650  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.699851  8837 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:24.707481  8843 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:24.751065  8840 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:24.744010  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:24.782320 13533 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260709 13:17:24.784426 13355 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.695147 13485 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.680819 13429 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:24.790194 13429 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:24.790278  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 181194us
I20260709 13:17:24.734305  8841 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:24.793826  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.798729 13545 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:24.801288  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 69720.3us
W20260709 13:17:24.801625  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 57735.2us
I20260709 13:17:24.802647 13515 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:24.802830  8884 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.803194 13515 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:24.804919 13546 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.190s	user 0.003s	sys 0.000s
I20260709 13:17:24.805701 13519 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.806143 13508 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:24.798592 13139 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:24.809779 13537 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.226s	user 0.001s	sys 0.002s
I20260709 13:17:24.810000 13436 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:24.804150 13515 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.814359  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.816545  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:24.674563 13535 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.819110  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:24.833316  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.834185  8732 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.655s (SENT)
I20260709 13:17:24.834596  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:24.728053 13510 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:17:24.727083 13541 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:24.838987  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.840890  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.842336  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.838452  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:24.670186 13543 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.850006  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.851652  8835 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 15 index: 6. (term mismatch)
I20260709 13:17:24.702520 13502 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:24.720515 13430 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:24.868142  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.857736  8840 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:24.895149  8835 pending_rounds.cc:85] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 5
I20260709 13:17:24.853039  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:24.895637  8835 pending_rounds.cc:107] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 14.6
I20260709 13:17:24.896134  8835 raft_consensus.cc:2889] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:24.833985 13535 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.895722  8840 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:24.896853  8915 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:24.855326  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.898797  8841 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:24.900346  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47525.6us
I20260709 13:17:24.903445  8916 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:24.809801 13328 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.906414  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:24.909354  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 167004us
I20260709 13:17:24.916985  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.905938  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:24.917824  8911 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:24.918191  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.919621  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.921350  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:24.922115  8917 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.906802  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:24.926697  8842 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:24.927349  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:24.928115  8838 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.838191 13523 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.930749  8912 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:24.839954 13524 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:24.840376 13548 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:24.752204 13522 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.154s
I20260709 13:17:24.892359 13222 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.902593 13504 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:24.946481  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:24.893635 13127 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.891551 13517 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:24.904577 13306 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:24.902954 13508 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:24.957317  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 104672us
I20260709 13:17:24.766281 13532 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.184s
W20260709 13:17:24.961459  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 127282us
W20260709 13:17:24.966180  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68671.3us
I20260709 13:17:24.934382 13523 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.969887  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:24.905862 13426 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.946147 13504 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.977706  8910 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:24.696112 13539 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.923063 13502 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.678333 13497 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:24.895015 13543 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:24.972790 13508 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.967366  8662 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.939218 13509 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:17:24.992587  8807 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:24.971555 13524 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:24.978600 13523 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:24.983390 13504 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.006973  8909 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:24.965289 13409 consensus_queue.cc:1059] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 13:17:24.989094 13549 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:17:25.010430 13426 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:25.010600 13502 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:24.985954 13127 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.027402 13519 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.029125  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:25.030789  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:25.032644 13519 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:25.033859 13519 raft_consensus.cc:2764] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:17:25.034765 13519 raft_consensus.cc:2764] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:17:25.015370 13556 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:25.036681  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:25.038177 13502 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.038718 13502 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:25.039276 13502 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.042820 13485 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.045286 13485 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:25.052613  8838 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:25.000403 13436 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:25.058830  8732 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.842s (SENT)
I20260709 13:17:25.059413  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.061949 13511 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.062867 13557 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:25.063679 13557 consensus_queue.cc:1243] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:25.063531 13548 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:25.065498 13556 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:25.065963 13556 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.066743 13556 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.068003 13556 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:25.064898  8732 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.869s (SENT)
I20260709 13:17:24.995656 13508 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.071910  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.069789  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.101814 13314 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:25.104765  8732 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.967s (SENT)
I20260709 13:17:25.105479  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.106598 13314 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.118587  8917 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
W20260709 13:17:25.108757  8732 leader_election.cc:336] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.974s (SENT)
I20260709 13:17:25.119439  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.020649 13127 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:25.141353  8732 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.979s (SENT)
I20260709 13:17:25.150404  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:25.052551 13502 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.135125 13514 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.136986 13127 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:25.165771  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 263996us
W20260709 13:17:25.173873  8732 leader_election.cc:336] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.022s (SENT)
I20260709 13:17:25.140426 13429 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:25.175632  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 188491us
I20260709 13:17:25.174592  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:25.222533  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 231806us
W20260709 13:17:25.226323  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 154494us
I20260709 13:17:25.143905 13524 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.190028 13429 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.220777 13511 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:25.264775  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 90924us
W20260709 13:17:25.265905  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 96134.5us
W20260709 13:17:25.267077  8732 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.063s (SENT)
I20260709 13:17:25.259366  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:25.272500  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:25.280685 13277 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.283654 13277 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.281541 13430 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.285133 13430 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.286535 13277 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:25.288007 13430 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:25.222374 13565 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
W20260709 13:17:25.296490  8732 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.197s (SENT)
I20260709 13:17:25.298398  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.265064 13543 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.300915 13514 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:25.301051 13555 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:17:25.304637  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:25.304630  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 77224.9us
I20260709 13:17:25.306398  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.307776 13581 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:25.308183 13139 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.308977 13306 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:25.309626 13429 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:25.309794 13222 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.310441 13519 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:25.313141 13552 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:17:25.314330 13436 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.288995 13561 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:25.317426 13522 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.317526  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.318392 13543 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.318847 13355 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:25.319171 13563 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:17:25.319126 13509 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:25.320577 13534 consensus_meta.cc:287] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.684s	user 0.004s	sys 0.008s
I20260709 13:17:25.378407 13543 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.379335 13534 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.381011 13543 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.381753 13534 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:25.306216 13559 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.265239 13535 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.365814 13306 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:25.329691 13558 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:17:25.334942 13551 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:17:25.333909  8662 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 13, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 13 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:17:25.341181 13553 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.342s	user 0.002s	sys 0.000s
W20260709 13:17:25.342396  8663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 180) took 34517 ms (client timeout 15000 ms). Trace:
I20260709 13:17:25.385470 13561 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:25.397310  8663 rpcz_store.cc:269] 0709 13:16:50.825020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:50.825252 (+   232us) service_pool.cc:224] Handling call
0709 13:17:25.342275 (+34517023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:23.461697 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:23.462376 (+   679us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:23.462430 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:17:23.462448 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:23.463507 (+  1059us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:23.463609 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:23.463634 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:17:23.464575 (+   941us) tablet.cc:701] Row locks acquired
0709 13:17:23.464632 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:17:23.464794 (+   162us) write_op.cc:270] Start()
0709 13:17:23.518574 (+ 53780us) write_op.cc:276] Timestamp: P: 1783603043464727 usec, L: 0
0709 13:17:23.518614 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:17:23.519310 (+   696us) log.cc:844] Serialized 4003 byte log entry
0709 13:17:23.929912 (+410602us) op_driver.cc:464] REPLICATION: finished
0709 13:17:24.077427 (+147515us) write_op.cc:301] APPLY: starting
0709 13:17:24.077520 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:24.441108 (+363588us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:24.441263 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:24.458486 (+ 17223us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:24.458865 (+   379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:17:24.458935 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:24.459336 (+   401us) log.cc:844] Serialized 96 byte log entry
0709 13:17:24.461921 (+  2585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:24.462616 (+   695us) write_op.cc:454] Released schema lock
0709 13:17:24.462698 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:24.476196 (+ 13498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:24.477562 (+  1366us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":442618,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":147145,"apply.run_cpu_time_us":23328,"apply.run_wall_time_us":390872,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45867,"num_ops":10,"prepare.queue_time_us":252338,"prepare.run_cpu_time_us":31445,"prepare.run_wall_time_us":273122,"raft.queue_time_us":14568,"raft.run_cpu_time_us":20211,"raft.run_wall_time_us":36547,"replication_time_us":411108,"thread_start_us":429383,"threads_started":4,"wal-append.queue_time_us":305760}]]}
I20260709 13:17:25.400717 13306 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.402652 13306 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.339443 13523 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.404779 13523 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.405601  8835 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:25.406169 13535 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:25.359478  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53112.5us
I20260709 13:17:25.372226  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:25.376027  8841 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:25.369931 13502 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.378594 13518 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.375641 13409 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:25.332754 13127 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.321408 13508 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.386286  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:25.366902 13583 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.401990  8662 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.409729  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.441087 13583 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:25.440717  8662 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 11, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 11 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:25.442157  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:25.442411  8662 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.443602  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:25.445007  8662 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 13, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:25.374148 13522 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:25.446519 13580 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:25.447036 13580 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:25.447134 13522 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.445634  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:25.421844  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 125383us
W20260709 13:17:25.424095  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 106676us
I20260709 13:17:25.449668  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:25.449949  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.399667 13561 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.450769 13583 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:25.451138  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.451310 13583 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.451980 13429 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:25.452436  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.371608 13519 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.453058 13535 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.453209 13583 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:25.453539 13535 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:25.454051 13535 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.428304 13504 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.418567 13559 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:17:25.445688  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 74761.4us
W20260709 13:17:25.370708  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 99245.2us
I20260709 13:17:25.448839 13522 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.383850 13355 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:25.409687 13534 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:25.443619 13508 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.455817  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:25.455981  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:25.456573  8732 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.222s (SENT)
I20260709 13:17:25.457226  8662 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 12, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 12 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:25.472078  8909 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:17:25.472638  8909 pending_rounds.cc:85] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 11
I20260709 13:17:25.473008  8909 pending_rounds.cc:107] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:17:25.473374  8909 raft_consensus.cc:2889] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.472913  8662 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.473784  8909 pending_rounds.cc:107] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:17:25.452576 13429 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.448053 13580 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.459909 13448 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:25.487962  8843 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:25.467288  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.468063  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.454586 13519 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.472311  8840 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:25.474185  8909 raft_consensus.cc:2889] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.475582  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.460428  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.476894  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.490298 13429 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.476951  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.491619  8916 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.491688  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.477788 13566 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:25.493140 13519 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:25.493172 13566 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:25.493836 13519 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:25.494527 13566 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.494752 13519 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.478204 13565 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.496874 13591 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:25.497430 13591 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.498212  8910 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:25.460362 13514 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.480834 13534 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.481499 13584 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:25.482494  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.505062  8837 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:25.505363  8914 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:25.483911  8732 leader_election.cc:336] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.247s (SENT)
I20260709 13:17:25.461416  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:25.506175  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.459173 13436 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.490949  8844 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:25.495010 13518 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.479772 13355 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.515098  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:25.515885  8842 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:25.500813  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.501138  8840 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:25.502583  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:25.487638 13448 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.506322  8841 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.507560  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:25.525552  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:25.485934  8662 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 12, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 12 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:25.518134  8909 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:25.527693  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.527851  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.528478  8911 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 9: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.528376  8662 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 8, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 8 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:25.519673  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.530149  8843 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:25.531104  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.531416  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:25.532076  8843 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.502787  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.528436  8912 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.533723  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.521976  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.534747  8918 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.536530 13543 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.537057 13509 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:25.537544 13518 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:25.503768 13306 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.504966 13514 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:25.539717  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:25.539757  8662 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 8, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 8 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:25.542371 13559 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:25.543397 13568 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.544039  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:25.521277 13515 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.545177 13180 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:17:25.549047  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 65166.8us
I20260709 13:17:25.555577  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:25.547031 13591 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:25.555116  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:25.555579  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.521852 13511 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:25.565368  8662 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:25.544648 13572 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:17:25.528578 13580 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.590895 13314 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:17:25.563088 13556 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.573911 13548 raft_consensus.cc:2764] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:25.581768 13508 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:25.513403 13584 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.545286 13534 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.563712 13355 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:25.590466  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.535893 13448 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.597291  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.598840 13561 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.591588  8914 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:25.599566  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.632920  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:25.598851 13306 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.587631 13407 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:17:25.528934 13589 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:25.607182  8842 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:25.609910  8843 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:25.609535  8841 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:25.563463 13543 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.611536  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:25.640759  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 43547us
I20260709 13:17:25.636381  8844 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:25.636466  8840 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:25.584244 13436 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:25.639808  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:25.643297  8762 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:25.617933 13508 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.583526 13524 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:25.644593  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:25.656157  8768 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.646106  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:25.650077  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:25.653306  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:25.657052  8760 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.657099  8762 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.659312  8761 pending_rounds.cc:85] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 5
I20260709 13:17:25.659770  8761 pending_rounds.cc:107] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:25.660101  8761 raft_consensus.cc:2889] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.653870  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:25.662086  8769 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:25.654839  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:25.583431 13509 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.667057  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:25.667909  8766 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:25.663991  8764 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:25.665616 13572 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.677786  8916 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:25.679123  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.682999  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.635262 13306 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.644184 13497 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.685460  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.691473  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.685438  8767 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:25.692180  8914 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.689159  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:25.654243 13508 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.693943  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.694541  8909 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.695047  8911 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:25.694169  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.694235  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.695544  8844 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:25.645843 13180 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:25.700805  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.701354  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.701887  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.698701  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.721406  8767 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:25.721849  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44928.8us
I20260709 13:17:25.722641  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:25.723555  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:25.727188  8918 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.727574  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.727965  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:25.682999 13568 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.684968 13557 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:25.735169  8915 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:25.735153  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.691082 13410 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.724740  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:25.731058  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.731665  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.731940  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.728655  8766 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:25.733693  8768 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:25.731269  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.743991  8911 raft_consensus.cc:2410] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:17:25.697963 13573 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.675891 13519 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:17:25.691280 13493 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:17:25.756927  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.736413 13127 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.760003  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.734391 13557 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.753890 13485 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:25.747207 13429 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:25.763579  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.748184 13430 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:25.676291 13514 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.745589 13410 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:25.764660  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.772256  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:25.720811 13180 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:25.750150 13573 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.779971  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.785792  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:25.779536 13497 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:17:25.789438 13596 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:25.789460  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.790539  8918 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.792393  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.793035  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.791760  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.643674 13589 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.800587  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.805251  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.806003  8909 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.805841  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.786408 13407 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:25.779603 13559 raft_consensus.cc:2764] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:17:25.776260 13410 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.819555  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.820843  8914 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.833696  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.833963  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.834707  8911 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:25.833714  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.799307 13409 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.683115 13518 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.760005 13306 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.778692 13328 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:17:25.869450  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.876538  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:25.849138  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78787.9us
W20260709 13:17:25.858465 13597 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:17:25.799392 13139 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:17:25.808086 13598 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:17:25.871431  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.857290  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:25.878108  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 254474us
I20260709 13:17:25.896679  8914 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.880100  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:25.859578  8732 leader_election.cc:336] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.522s (SENT)
I20260709 13:17:25.883164  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.902166  8910 raft_consensus.cc:2410] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:17:25.837230 13565 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:25.810848 13127 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:25.782353 13573 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.807900 13591 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:25.891805  8912 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:25.804652 13222 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:17:25.893553  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.876075 13429 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.873628 13532 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:25.903730  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.983381  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.977255  8760 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:25.905498  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:25.931437  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.987221  8915 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 9: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:25.938766  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.881270 13430 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:25.988940  8910 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.991269  8911 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [11.8-13.9]
W20260709 13:17:25.992108  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 132580us
I20260709 13:17:25.900336  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:25.996717  8917 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.996042  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.997991  8912 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.007480  8807 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:26.010486  8913 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:25.898119 13015 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:26.027549  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.938889 13497 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.028491  8909 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:26.036523  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.031615  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:25.948458 13509 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:25.873258 13557 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:25.939692 13306 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.037392  8760 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:26.035332  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:25.840270 13407 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.041103  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.041323  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.051651  8912 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:25.947701 13328 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.042186  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:25.981303 13591 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:25.933441 13485 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:26.049271  8911 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:26.054554  8767 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:26.062179  8762 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:26.074858 13509 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.075549 13509 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:26.076491 13509 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:26.079622 13578 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:26.035761 13015 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:26.050128 13595 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:26.085390  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.085634  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.095464  8912 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.086228  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.090766  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.105314  8915 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.116436  8915 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:26.122833  8917 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:26.126291  8915 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [11.5-13.6]
I20260709 13:17:26.124050  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.071384 13591 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.132380  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.136482  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.137342  8911 raft_consensus.cc:2376] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11. Re-sending same reply.
I20260709 13:17:26.071648 13180 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:26.140288  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.141292  8917 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
W20260709 13:17:26.133821  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 102388us
I20260709 13:17:26.047524 13497 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.144655  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:26.119105 13618 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.153307  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.153491  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:26.133446 13557 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.120443 13588 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:26.083133 13328 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:26.169945 13612 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:26.089197 13429 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.158672 13622 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.233683  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.213104 13127 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:26.240078  8732 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.727s (SENT)
I20260709 13:17:26.239991 13127 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.127120 13430 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:26.243263  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.243922  8844 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:26.249264 13613 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.249913 13613 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.252179 13613 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.252744 13577 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:26.252921 13608 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.207641 13588 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:26.261549 13616 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.262265 13616 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:26.264159 13599 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
W20260709 13:17:26.264925 13600 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:17:26.271070  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.279137 13407 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:26.166409 13485 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.280086 13610 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.224026 13629 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.243147 13622 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:26.291870 13588 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.293424 13504 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.164479 13618 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.167315 13015 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.302733 13015 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:26.307442 13623 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:17:26.308046 13448 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.662s	user 0.005s	sys 0.004s
I20260709 13:17:26.289827 13622 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.309389  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.309648 13446 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:26.310115 13446 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:26.310297 13328 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:26.311028  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.311790  8762 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:26.311084 13446 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.312565 13446 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:26.329514  8732 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 3.338s (SENT)
W20260709 13:17:26.332012  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 324645us
W20260709 13:17:26.300202 13625 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:17:26.312834 13355 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.003s
I20260709 13:17:26.313165  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:26.355229  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.357129  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:26.357303  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:26.316291 13583 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.862s	user 0.005s	sys 0.005s
I20260709 13:17:26.359282  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.360044  8762 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:26.289564 13610 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:26.319149 13522 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.854s	user 0.007s	sys 0.002s
I20260709 13:17:26.298461 13567 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:17:26.321468  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.284981 13566 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.010s
I20260709 13:17:26.326174  8912 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:26.270613 13577 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:26.390616 13577 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.367746 13222 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:26.320775 13603 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.343s	user 0.002s	sys 0.000s
I20260709 13:17:26.288342 13629 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:26.396062 13629 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.362012  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:26.357950  8844 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:26.368136  8836 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:17:26.373914  8732 leader_election.cc:336] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.872s (SENT)
I20260709 13:17:26.400027  8836 pending_rounds.cc:85] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 7
I20260709 13:17:26.400312  8836 pending_rounds.cc:107] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:26.400588  8836 raft_consensus.cc:2889] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:26.350332 13535 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.896s	user 0.012s	sys 0.001s
I20260709 13:17:26.308599 13448 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.387344  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.387902 13606 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:26.389487 13637 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:17:26.400352  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.405529  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.375924  8910 raft_consensus.cc:2410] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:17:26.355262 13517 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.420956  8844 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:26.412352  8842 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:26.415225  8839 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:26.417086  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:26.418890  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45099us
W20260709 13:17:26.424376  8732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 3.549s (SENT) [suppressed 68 similar messages]
I20260709 13:17:26.425278  8911 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:26.429628 13634 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:17:26.377204 13511 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.415469 13580 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.823s	user 0.010s	sys 0.006s
W20260709 13:17:26.415959 13566 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.002s	sys 0.011s
I20260709 13:17:26.365931 13583 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.431691 13618 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:26.450350  8732 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.897s (SENT)
I20260709 13:17:26.450757  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.452026  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.450865  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.426949 13504 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.416787 13606 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:26.445534 13508 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.724s	user 0.003s	sys 0.008s
I20260709 13:17:26.432680 13497 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.437871 13222 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:26.457352  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 95347us
I20260709 13:17:26.464272  8835 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:17:26.465327 13616 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:26.465991 13222 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.468281 13566 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:26.473039 13561 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.830s	user 0.012s	sys 0.000s
I20260709 13:17:26.473559 13561 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:26.474053 13448 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.474745  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:26.468104 13328 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.482357 13328 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.482853 13328 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:26.496989 13620 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:17:26.501435 13608 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.506109 13624 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:26.506808 13624 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.507258 13624 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.508947  8911 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:26.419690 13535 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:26.518399  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 68077.7us
I20260709 13:17:26.445920 13511 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.440276 13517 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.527827  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:26.545962  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.531683  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.529023  8916 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.552678  9461 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:26.557546  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.558566  8911 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.463707 13508 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:26.526108 13515 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.939s	user 0.012s	sys 0.001s
I20260709 13:17:26.511448 13589 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:26.563467  8732 leader_election.cc:336] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.514s (SENT)
I20260709 13:17:26.531072 13608 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.566169  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.554560 13582 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.574226  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.575627  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:26.581790  8732 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.937s (SENT)
I20260709 13:17:26.497002 13591 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:26.585107  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.574571 13515 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.592592  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:26.605266 13410 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.736s	user 0.016s	sys 0.001s
I20260709 13:17:26.583031 13511 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.577198 13448 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:26.589600  8732 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.531s (SENT)
I20260709 13:17:26.625260  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:26.628242  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.557879 13606 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.609609  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.630271  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.630899  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.618832 13328 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.620496 13508 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.621479 13589 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.621546 13518 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:26.616545 13583 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:26.622323 13535 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:26.651089 13629 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.586186 13582 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.642172 13589 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.655364 13582 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.655678 13589 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:26.658869 13573 consensus_meta.cc:287] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.006s
W20260709 13:17:26.662236 13607 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.684s	user 0.000s	sys 0.003s
I20260709 13:17:26.631875 13511 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.628567 13517 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.638029  8911 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:26.667593 13647 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:17:26.667860  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:26.668501  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.667840 13624 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.669297  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.669822  8911 raft_consensus.cc:2376] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14. Re-sending same reply.
I20260709 13:17:26.670595  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.615001  8909 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:26.646834 13518 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.649461 13328 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.650064 13591 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.623260 13410 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.664567  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 538) took 1141 ms. Trace:
I20260709 13:17:26.660535 13573 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.666077  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2014) took 1028 ms. Trace:
W20260709 13:17:26.633558  8732 leader_election.cc:336] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.066s (SENT)
I20260709 13:17:26.674085  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.580572 13608 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.673925  8763 rpcz_store.cc:276] 0709 13:17:25.637646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.637786 (+   140us) service_pool.cc:224] Handling call
0709 13:17:25.638183 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.648713 (+ 10530us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.648755 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.666383 (+ 17628us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.835571 (+169188us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:25.835612 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.835684 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.661402 (+825718us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:26.665651 (+  4249us) raft_consensus.cc:1685] finished
0709 13:17:26.665684 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.665993 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3799,"raft.queue_time_us":111352,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5285,"spinlock_wait_cycles":143436544,"thread_start_us":106945,"threads_started":1,"wal-append.queue_time_us":243914}
I20260709 13:17:26.676844  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.677644  8911 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:26.673712  8835 rpcz_store.cc:276] 0709 13:17:25.523166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.538561 (+ 15395us) service_pool.cc:224] Handling call
0709 13:17:25.538890 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.469916 (+931026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.664143 (+194227us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b54001d9f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:26.664439 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127411584}
I20260709 13:17:26.666114 13629 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:26.682403  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58529.3us
I20260709 13:17:26.683017  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:26.684839  8732 leader_election.cc:336] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.572s (SENT)
I20260709 13:17:26.684178  8841 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.684381  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.685657  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.691133  8918 raft_consensus.cc:2368] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12.
I20260709 13:17:26.691636  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:26.693053  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:26.693773  9460 raft_consensus.cc:2368] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:26.679476 13448 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.695713  8734 leader_election.cc:400] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:26.696529  8734 leader_election.cc:403] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.697479  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:26.698167  8835 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.698624 13608 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.698838 13410 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.695000 13649 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:26.701167  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.701800  8909 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:26.701500 13649 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.697510  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.705303  8911 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.690125 13511 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.707670  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.708138 13518 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:26.696518 13622 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.711192 13622 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:26.713289 13636 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.459s	user 0.002s	sys 0.000s
I20260709 13:17:26.715471 13608 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.708287  8911 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:26.721071  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.721643  8911 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 8.
I20260709 13:17:26.722697  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.723423  8911 raft_consensus.cc:2376] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11. Re-sending same reply.
I20260709 13:17:26.724238  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.724779  8911 raft_consensus.cc:2376] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14. Re-sending same reply.
I20260709 13:17:26.725591  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.726030  8911 raft_consensus.cc:2376] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11. Re-sending same reply.
I20260709 13:17:26.728608  8909 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:26.729687  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.730378  8909 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.730464  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.731112  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.731465  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.731667  8909 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:26.732569  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:26.733369  8911 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:26.734157  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.734750  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.735481  8763 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:26.737800  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.734803  8911 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:26.739001  8835 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:26.738967  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.739780  8917 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:26.732577  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:26.744607  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.746305  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:26.746742  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:26.747084  9460 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:26.749889  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.755739  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.757858  8762 raft_consensus.cc:2393] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:26.695613 13624 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:26.762918  8917 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:26.766635  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.767992  8762 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:26.763382  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.768160  8917 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:26.764467  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.770315  8761 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:26.772127  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:26.773834  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.774212  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.759065 13328 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.779366 13328 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.789806  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.790091 13328 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.792311 13573 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:26.792501  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.794502 13608 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:26.776662 13649 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:26.799042  9431 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.781s (SENT)
I20260709 13:17:26.799603  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:26.799960 13643 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.328s	user 0.000s	sys 0.000s
I20260709 13:17:26.800472 13649 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:26.801918 13644 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.296s	user 0.002s	sys 0.000s
W20260709 13:17:26.803875  9431 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.836s (SENT)
I20260709 13:17:26.804265  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2016) took 1165 ms. Trace:
I20260709 13:17:26.804316  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.804700  8765 rpcz_store.cc:276] 0709 13:17:25.638345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.638465 (+   120us) service_pool.cc:224] Handling call
0709 13:17:25.653098 (+ 14633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.893925 (+240827us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.893969 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.933330 (+ 39361us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.418761 (+485431us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:26.418797 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.418869 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.801134 (+382265us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:26.803947 (+  2813us) raft_consensus.cc:1685] finished
0709 13:17:26.803967 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.804185 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114384,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":10898816,"thread_start_us":680843,"threads_started":2,"wal-append.queue_time_us":496162}
W20260709 13:17:26.806715  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.807403 13493 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:26.807715  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.875s (SENT)
I20260709 13:17:26.808153  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:26.808876 13493 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:26.810099  9431 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.877s (SENT)
I20260709 13:17:26.812222 13543 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.812849 13328 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.815512  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 2117) took 1084 ms. Trace:
I20260709 13:17:26.846813  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:26.884280  8916 rpcz_store.cc:276] 0709 13:17:25.731340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.731634 (+   294us) service_pool.cc:224] Handling call
0709 13:17:26.815286 (+1083652us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b5400293bd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:26.815425 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816580352}
I20260709 13:17:26.885089  8837 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:26.820405  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 2128) took 1030 ms. Trace:
I20260709 13:17:26.886083  8918 rpcz_store.cc:276] 0709 13:17:25.789893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.804976 (+ 15083us) service_pool.cc:224] Handling call
0709 13:17:26.820186 (+1015210us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54002ac6d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:26.820342 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827330944}
I20260709 13:17:26.886960 13564 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.876929 13605 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:26.824031  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:26.887852 13605 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:26.888129  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 64184.7us
I20260709 13:17:26.889382 13426 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.889771 13426 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.889067 13605 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.890105 13426 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.890591 13605 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.827368  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:26.827674  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.893831  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.832243 13535 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:26.894248  8914 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:26.837312  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:26.893378  9466 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:26.837900  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:26.897903  8735 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:26.840629  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2050) took 1369 ms. Trace:
I20260709 13:17:26.899778  8913 rpcz_store.cc:276] 0709 13:17:25.471637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.471890 (+   253us) service_pool.cc:224] Handling call
0709 13:17:25.480906 (+  9016us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.011011 (+530105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.840366 (+829355us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540026d754. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:26.840541 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217256320}
I20260709 13:17:26.841048 13584 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.901208 13314 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.901827 13314 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.902190 13314 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:26.902514  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.905296 13615 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:26.893985  8761 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.829381 13619 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:26.843202  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.910725 13619 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.910993  8768 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:26.912406  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.913264  8768 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:26.914376  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.915035  8768 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.853683 13493 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:17:26.857376 13606 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:26.859728  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:26.868779 13610 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:26.872722  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:26.872828  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.813709  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 444) took 1157 ms. Trace:
I20260709 13:17:26.926478  8769 rpcz_store.cc:276] 0709 13:17:25.655841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.692934 (+ 37093us) service_pool.cc:224] Handling call
0709 13:17:25.693207 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.806884 (+113677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.806916 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.806956 (+    40us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:25.806992 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.813472 (+1006480us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b5400339354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:26.813523 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.813651 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260989824}
I20260709 13:17:26.835502  8838 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:26.835844  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:26.929703  8842 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.837229  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:26.844553  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.848464  8840 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:26.843572  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.919935 13649 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:26.935535  8766 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.935598 13649 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:26.853531  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:26.936620  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 83175.1us
I20260709 13:17:26.869850  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:26.859014 13608 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.872696  8915 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:26.864576  8767 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:26.937881 13608 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.937270 13649 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.937565  8764 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.939388 13649 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:26.858896 13573 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:17:26.940578 13573 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:26.941040 13573 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:26.942159 13573 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:26.943722 13573 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.945093  8765 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:26.947229 13610 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:26.948012 13610 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:26.949143 13610 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:26.937412  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:26.953050 13624 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:26.866186  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:26.996556  8763 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:27.001478 13328 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:27.005590  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68267.4us
W20260709 13:17:27.007990  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.009586 13619 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:27.010187  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.010771  8915 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:26.860636  8732 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.781s (SENT)
W20260709 13:17:27.014492  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 153888us
I20260709 13:17:27.017743  8915 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:27.019200  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.019855  8915 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.027000 13588 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.027294  8840 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:27.027591 13588 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.029187  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:27.031200  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 123577us
I20260709 13:17:27.031607  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.030179 13588 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:27.035580  9431 leader_election.cc:336] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 2.166s (SENT)
I20260709 13:17:27.061729  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.062417  8761 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:27.036114 13493 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:27.037178  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.037902  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.063934  8767 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.038573  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.040666  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.042830  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.064517  8765 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.043517  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.065410  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:27.065721  8768 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:27.066283  8761 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:27.045811  8769 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:27.046562  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.046707  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.046954  8764 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:27.069084  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.047626  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.070340  8916 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:27.048251  8915 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:27.050346 13426 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:27.032243 13534 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.005s	sys 0.022s
W20260709 13:17:27.052451  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.078704  8916 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:27.071317  8762 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:27.051831  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.081166  8763 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:27.082953  8764 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:27.098274  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:27.083730  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.033388 13608 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.087613  8769 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:27.087625  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.095813  8767 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:27.065647 13624 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.121088  8844 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:27.115142  8761 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:27.115253  8762 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:27.136174  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:27.075182 13584 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.118911  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:27.120492  8763 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:17:27.115231  8767 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:27.083503 13534 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.109s	user 0.005s	sys 0.022s
I20260709 13:17:27.075649 13535 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.115978  8842 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:27.077584 13493 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.142760 13610 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:27.145248  8765 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
W20260709 13:17:27.177446  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58609.1us
I20260709 13:17:27.113180 13409 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:17:27.138197 13577 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.145074  8807 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:27.145169  8732 leader_election.cc:336] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.871s (SENT)
I20260709 13:17:27.200574  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.082641 13619 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 13:17:27.164091 13666 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:27.098788 13572 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:17:27.178217  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:27.184684  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.155547  8766 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:27.203365  8765 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:27.209544  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 70713.1us
I20260709 13:17:27.201962  8762 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:27.181618  8769 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.161072 13622 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.178155 13631 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:17:27.213136 13622 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.215320 13622 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:27.200466 13620 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:17:27.220382  9460 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:17:27.199644 13518 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.221510 13518 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.221851 13518 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.204200 13577 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:27.225301 13577 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:27.231319  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.167111 13543 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.237890 13543 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.238904  8769 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:27.240001  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:27.240831  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.241087  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:27.237438  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 92298.6us
W20260709 13:17:27.242563  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.242647  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.243494  8767 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:27.245199  8763 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: [12.7-14.8]
W20260709 13:17:27.246820  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101858us
I20260709 13:17:27.247229 13426 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:27.249926  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:27.250656 13588 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:27.169852 13584 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.202952 13610 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:27.253341  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75212.2us
I20260709 13:17:27.260367  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.253839 13508 raft_consensus.cc:2764] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:27.254978 13493 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.255288  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:27.240749  8762 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:27.237258 13615 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:27.257149  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.186843 13314 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:27.308905  9431 leader_election.cc:336] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.703s (SENT)
I20260709 13:17:27.315534  8761 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:27.262125  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:27.259435  8732 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.571s (SENT)
I20260709 13:17:27.264664  8844 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:27.266589  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.318001  8769 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.258411  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.273032  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:27.318902  8766 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.319476  9461 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:27.319769  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:27.325239  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 49624.6us
W20260709 13:17:27.327061  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67656.1us
I20260709 13:17:27.332346  8766 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:27.334942  8765 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:27.336374  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.339740  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.276575  9460 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:27.345532  8916 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:27.346048  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 83999.8us
I20260709 13:17:27.240679 13543 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:27.340519  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.348480  8662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 98) took 3481 ms. Trace:
I20260709 13:17:27.341572  8915 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:27.353567  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.354810  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.355598  8915 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:27.356323  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.341962  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.357623  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.359055  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.359800  8912 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:27.360428  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.267751 13572 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.350423  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.361841 13572 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.362713  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.363914  8916 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:27.364748 13572 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.364972  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.365361 13572 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:27.365849 13572 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:27.366048  8916 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:27.367012 13572 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.352638  8914 raft_consensus.cc:2410] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:17:27.268199 13567 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.268051 13127 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:27.394649  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.321089 13519 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.381850  8915 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:27.383299  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.383939  8917 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 17. Current term is 18. Ops: [14.12-17.14]
I20260709 13:17:27.402640  8918 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:27.386416  8912 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:17:27.403553  8912 pending_rounds.cc:85] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 11
I20260709 13:17:27.403872  8912 pending_rounds.cc:107] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:17:27.404167  8912 raft_consensus.cc:2889] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.399454  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.393689  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:27.313580 13429 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.380016  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.405678  8914 raft_consensus.cc:606] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:27.406088  8914 raft_consensus.cc:614] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.408061  8911 raft_consensus.cc:2410] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:17:27.338160 13504 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.408499  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.412526  8916 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:17:27.413708  8916 pending_rounds.cc:85] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 10
I20260709 13:17:27.414149  8916 pending_rounds.cc:107] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:17:27.414567  8916 raft_consensus.cc:2889] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:27.419427  8909 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:27.279280 13609 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.131s
I20260709 13:17:27.271665 13610 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.352624  8662 rpcz_store.cc:276] 0709 13:17:23.850503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.926820 (+ 76317us) service_pool.cc:224] Handling call
0709 13:17:27.327611 (+3400791us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:25.876496 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:25.968664 (+ 92168us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:25.968706 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:17:25.968727 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:25.969942 (+  1215us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:25.970026 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:25.970059 (+    33us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:17:25.971141 (+  1082us) tablet.cc:701] Row locks acquired
0709 13:17:25.971163 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:17:25.971342 (+   179us) write_op.cc:270] Start()
0709 13:17:25.971461 (+   119us) write_op.cc:276] Timestamp: P: 1783603045971273 usec, L: 0
0709 13:17:25.971484 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:17:26.071670 (+100186us) log.cc:844] Serialized 4833 byte log entry
0709 13:17:26.618388 (+546718us) op_driver.cc:464] REPLICATION: finished
0709 13:17:26.770106 (+151718us) write_op.cc:301] APPLY: starting
0709 13:17:26.777101 (+  6995us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:26.932516 (+155415us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:26.932657 (+   141us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:27.154210 (+221553us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:27.154454 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:17:27.154497 (+    43us) write_op.cc:312] APPLY: finished
0709 13:17:27.154796 (+   299us) log.cc:844] Serialized 112 byte log entry
0709 13:17:27.154993 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.155126 (+   133us) write_op.cc:454] Released schema lock
0709 13:17:27.155195 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:27.155629 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:27.155658 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":342055,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":135160,"apply.run_cpu_time_us":19992,"apply.run_wall_time_us":396885,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":164008,"prepare.run_cpu_time_us":29595,"prepare.run_wall_time_us":404772,"raft.queue_time_us":137084,"raft.run_cpu_time_us":30638,"raft.run_wall_time_us":76960,"replication_time_us":646739,"thread_start_us":375730,"threads_started":4,"wal-append.queue_time_us":183697}]]}
I20260709 13:17:27.435672 13573 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:27.436385 13573 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.438650 13573 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.275978 13629 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 13:17:27.446563 13660 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:27.385200 13605 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.447825 13584 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.415556 13429 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:27.401669 13666 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:27.454825  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:27.455948  8917 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:27.456534  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.462729  8915 raft_consensus.cc:2376] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15. Re-sending same reply.
I20260709 13:17:27.463855  8760 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:27.402910 13519 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:27.415441 13615 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.469199  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.470731  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.479511  8760 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:27.478844  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70434.5us
I20260709 13:17:27.481011  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.482066 13609 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:27.483865 13429 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.483973 13609 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.485124 13518 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.416930 13127 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:27.497476 13564 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.482822 13504 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.498019 13127 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.486990  8766 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:27.487628  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.500207  8760 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:27.478682 13519 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.400714 13567 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.496632  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:27.504518  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.483047  8769 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:27.474066  8913 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:27.509552  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.510659  8769 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.512313  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:27.513068  8766 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:27.506225 13504 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.513669 13314 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.514328 13609 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:27.514336  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.515407  8761 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:27.517100  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:27.511624  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.521130  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.526741  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.533269  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:27.534727  8760 raft_consensus.cc:2410] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:27.535589  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:27.548781  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.548534 13497 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:27.550076  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.551182  8761 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:27.551481 13619 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.553803  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.554003  9460 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:17:27.554566 13619 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.557189 13619 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:27.556478  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.564628 13619 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.566562 13567 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.506286 13485 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:27.573690  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 69272.4us
I20260709 13:17:27.574590  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.576802  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.597506  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:27.535982 13328 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:27.600265  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.601547  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.591004 13448 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:27.619199  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.619913  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.621598  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.628347  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.630473  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.631968  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.641439  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.611443 13564 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:27.672317  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 381444us
I20260709 13:17:27.617363 13615 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.677561  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.592801 13485 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.638296 13517 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.685617  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:27.637867 13605 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:27.643718 13601 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.707952  8840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:27.709964  8840 raft_consensus.cc:606] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:27.710418  8840 raft_consensus.cc:614] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.707983  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:27.704913  8769 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:27.642992 13608 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.734138  8844 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:27.641826 13611 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:27.619545 13619 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 13:17:27.725647  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48273.9us
I20260709 13:17:27.646024 13564 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:27.686757 13615 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.728199  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.686995 13409 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:27.737239  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.676548 13448 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:17:27.642696 13604 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:27.744833 13409 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.746121  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:27.749456 13667 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:17:27.749782 13508 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:27.750746  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:27.751173 13518 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.751623  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:27.751789 13518 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:27.748734 13409 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.753500 13409 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.753851 13409 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.754032 13410 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:27.754206 13409 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.754549 13410 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:27.755635 13410 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.674254 13511 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.759508  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.749125 13631 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:27.743482  8916 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:27.739629  8844 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.768784  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.737047 13584 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:27.772167  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:17:27.759979 13564 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.761088 13615 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:27.751613 13508 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:27.781127  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:27.740024 13611 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:27.743944 13605 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:27.771127 13609 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:27.732357 13577 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.759263 13629 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:27.785677 13588 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:27.770896 13567 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:17:27.831326  8843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.005s	sys 0.060s
W20260709 13:17:27.832034  8843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.006s	sys 0.060s
I20260709 13:17:27.815124  8844 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:27.795015 13611 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:27.835040  8807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.010s
I20260709 13:17:27.836581  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.791854 13584 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:27.788259 13508 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:27.808635 13519 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:27.835803  8807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.006s	sys 0.010s
I20260709 13:17:27.840030 13588 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.849490 13567 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.853576 13584 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.792421 13429 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
W20260709 13:17:27.855321 13676 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:27.806159 13511 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.792822 13641 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:17:27.861001  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:27.862910  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.874533  8844 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:27.806636 13678 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:27.835752 13504 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.872040  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.835996 13680 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:27.899935 13680 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:27.896138 13605 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.900924 13680 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.871541 13567 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.867472  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:27.905332 13677 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:17:27.875295  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.861939 13508 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.906554  8840 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:27.874926  8916 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:27.807035 13518 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:17:27.908811 13683 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:27.909380 13683 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.917929 13567 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.874006 13572 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:27.885406  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.890452 13577 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.894623 13519 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:27.895692 13485 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:27.874368 13511 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.928164  8839 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:27.880270 13429 consensus_queue.cc:1243] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:27.934772  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:27.934742  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 226833us
I20260709 13:17:27.940724  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.945457  8837 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:27.947252  8910 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.002s	sys 0.028s
W20260709 13:17:27.947726  8910 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.003s	sys 0.029s
W20260709 13:17:27.944012  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 301247us
I20260709 13:17:27.951124  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:27.952086  8843 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:27.953333  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:27.921644 13572 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:27.960863  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:27.990731 13610 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.025s
I20260709 13:17:27.947402 13222 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.948614 13577 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:28.031913  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76499.8us
I20260709 13:17:27.937167 13690 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:27.920789 13409 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:27.963249 13314 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:28.053591  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 106417us
I20260709 13:17:27.940411 13497 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 13:17:28.068846  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:27.926534 13508 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:27.963224 13517 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.092s
I20260709 13:17:28.084424  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:28.051484 13629 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:28.056106 13610 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.007s	sys 0.025s
I20260709 13:17:28.091835 13631 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:28.097421 13631 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.098835 13524 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:28.099848 13572 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.101274 13572 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.102746 13409 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.083387 13222 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.086917 13688 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:28.105332 13222 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.086588 13577 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:28.083974 13678 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:28.084136 13609 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:28.106630  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:28.089622 13690 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:28.107514  9461 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:28.107869 13577 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:28.109174 13690 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:28.111198  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:28.110697  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:28.104604 13511 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:28.125069  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 56314.1us
W20260709 13:17:28.130455  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46141.4us
W20260709 13:17:28.138026  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 255790us
I20260709 13:17:28.138324  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:28.128189 13314 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.151860  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:28.155839  8844 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:28.155315  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:28.163532  8914 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:28.166298  8844 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:28.152397 13535 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.171736  8844 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:28.153357 13485 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.153985 13696 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.178892  8844 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.181454  8912 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 4. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:28.181999  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:28.223819  8917 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:28.182796  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:28.225117  8915 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:28.184618 13601 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:28.212162 13611 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.197610  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:28.169049 13681 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.207083 13577 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:28.231637  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.164207 13314 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.213380  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.232981  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.233659  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:28.233939 13426 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:28.234148 13314 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.234414 13426 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:28.222107 13485 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:28.234854  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:28.217445  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.235289 13485 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.235357 13426 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.220949  8909 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:28.237422  8918 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:28.194555 13693 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:28.238408  9461 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.228160  8838 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:17:28.119978 13619 consensus_queue.cc:1175] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "773340b2958e4af5b2010b902b9e9c04" responder_term: 12 status { last_received { term: 11 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:28.236660 13426 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.233562  8917 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.235178  8911 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:28.245211  8911 pending_rounds.cc:85] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 7
I20260709 13:17:28.245527  8911 pending_rounds.cc:107] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:28.245800  8911 raft_consensus.cc:2889] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:28.246834  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.254022  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:28.255048 13601 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.230114  8844 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:28.230271 13508 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:28.231869 13681 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.279346 13681 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.279883 13601 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.280560 13601 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.286036  9460 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.256071  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:28.289620  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:28.294324  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:28.301597  8838 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:28.267278  9461 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:28.234755 13696 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.295915  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:28.225524  8837 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:28.305860 13611 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.307803  9466 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:28.309180  8839 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:28.310534 13564 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
W20260709 13:17:28.311344 13615 consensus_meta.cc:287] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:17:28.301743 13429 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:17:28.301389 13577 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:28.320026 13601 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:28.322521  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 190862us
I20260709 13:17:28.326086  8917 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
W20260709 13:17:28.367998  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 43632.4us
W20260709 13:17:28.366402  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 287153us
I20260709 13:17:28.373431  8735 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:28.374131  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:28.379688  8882 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:28.381539 13611 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:28.382862 13601 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:28.383482 13601 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:28.384619 13601 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.391129  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:28.338915 13704 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:28.394907  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:28.398335  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:28.366135 13577 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:28.423005  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:28.389447 13429 consensus_queue.cc:1243] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:28.431176  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:28.328197 13681 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.395177 13573 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.431645 13448 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.398931 13609 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.392742 13703 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:28.397231 13704 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.379776 13222 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:17:28.431706 13577 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.422544 13698 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:28.394512 13572 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:28.393658 13619 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:28.338572 13564 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.366950 13615 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.468047  8844 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:28.395119 13631 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:17:28.444403 13429 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:28.443028 13675 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:28.464223 13704 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.472131 13573 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:28.492507 13429 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.503376 13686 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:28.542879  8765 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:28.544170  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:28.545181  8762 raft_consensus.cc:2410] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 16 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:28.504985 13572 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:17:28.550891  8762 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:28.489315 13698 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.527335 13429 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:28.556291  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:28.557036  8769 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:28.563815  8768 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:28.555696  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:28.568845  8765 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:28.532114 13686 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:28.577536  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.585637  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.586261  8917 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.595513  8917 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:28.597246 13610 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:28.600229 13629 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:28.564363 13572 consensus_queue.cc:1243] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:28.605973  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:28.623221  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:28.628600  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:28.629091  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:28.634040  8909 raft_consensus.cc:2410] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:28.601142 13608 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:28.620149 13696 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.607134 13605 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:28.602152 13629 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:28.649750  8917 raft_consensus.cc:2410] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:17:28.682267  8917 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:28.683002  8917 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:28.683848  8917 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:28.701517  8917 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:28.715149  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:28.745003 13718 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:17:28.746244 13683 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.652766 13608 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.724160 13497 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:28.727332 13687 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.685611 13605 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:28.774168 13715 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:17:28.721230 13716 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:28.761400 13448 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:28.778934 13700 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:28.794669 13683 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:28.783164 13497 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:28.793671 13687 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.803864 13700 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.883849  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:28.819687 13534 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:28.907538 13728 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:17:28.913484 13734 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:17:28.900893 13683 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:28.914541 13726 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 13:17:28.916016 13720 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260709 13:17:28.917414 13727 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:17:28.918138 13683 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.918771 13534 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:28.809957 13448 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:28.921752 13534 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.922951 13448 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:28.837786 13714 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 13:17:28.837971 13698 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:28.923863 13534 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.925180  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 485) took 1585 ms. Trace:
I20260709 13:17:28.925606  8910 rpcz_store.cc:276] 0709 13:17:27.339541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.340392 (+   851us) service_pool.cc:224] Handling call
0709 13:17:27.345904 (+  5512us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:27.948200 (+602296us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:27.948246 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:27.989287 (+ 41041us) log.cc:844] Serialized 52 byte log entry
0709 13:17:28.328044 (+338757us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:28.328082 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.328143 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.924967 (+596824us) raft_consensus.cc:1685] finished
0709 13:17:28.924989 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.925122 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38705,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11266,"thread_start_us":809933,"threads_started":2,"wal-append.queue_time_us":422726}
I20260709 13:17:28.926030 13704 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.937522 13704 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.831043 13701 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:28.944608 13701 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.947363 13686 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.949306 13686 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:28.961002 13485 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.004s
I20260709 13:17:28.961550 13485 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:28.963920 13485 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:28.977551 13611 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:28.978267 13611 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:28.983821 13605 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:28.984979 13611 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:28.987229 13687 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:28.987852 13700 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.994957 13497 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:28.996711 13608 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.002055 13692 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:29.002614 13692 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:28.947727 13701 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.073392 13742 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:29.010224 13608 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:29.049005 13567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.011s	sys 0.024s
W20260709 13:17:29.089257 13567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.012s	sys 0.024s
W20260709 13:17:29.103335  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 366311us
W20260709 13:17:29.104614 13426 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:17:29.104270  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:29.112881 13429 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.537s	user 0.010s	sys 0.000s
I20260709 13:17:29.113649 13429 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.115871 13429 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:29.092844 13608 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.133782 13608 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:29.113200 13577 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.623s	user 0.004s	sys 0.008s
I20260709 13:17:29.134658 13577 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.144433 13577 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:29.147114  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.148635  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:29.148777  8840 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:17:29.149582  8840 pending_rounds.cc:85] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 6
I20260709 13:17:29.149849  8840 pending_rounds.cc:107] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:17:29.149959  8841 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:29.150092  8840 raft_consensus.cc:2889] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.150548 13754 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:29.150787  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.152401  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.153031 13611 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.153550 13611 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.155674 13611 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.155855 13681 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.156360  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.157598  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.160364 13524 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:29.160982 13524 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.161438 13754 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.161911 13754 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.162498 13448 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.163196 13524 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:29.163002 13448 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.163717 13524 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:29.164189 13524 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.165768 13448 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.150852  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:29.172744  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.189181  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.190153  8761 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:29.192178  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.193917  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.195679  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.196486  8766 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.128286 13629 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.170984  8765 pending_rounds.cc:85] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 5
I20260709 13:17:29.207079  8765 pending_rounds.cc:107] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:29.207473  8765 raft_consensus.cc:2889] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:29.207513  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46434.9us
I20260709 13:17:29.208244  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:29.106125 13700 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.217654  8766 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:29.219877  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:29.216863 13426 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:29.229352 13755 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:29.229581 13426 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:29.230207 13426 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:29.230273 13755 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:29.231385 13755 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.234071 13757 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:29.218925 13605 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:29.252744  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:29.256175  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:29.257201  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.257918  8837 raft_consensus.cc:2410] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 16 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 5.
I20260709 13:17:29.258692  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:29.260910  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.267765 13448 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:29.268328 13448 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:29.267884 13754 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.269300 13686 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:29.270406 13754 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:29.273118  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.269385  8766 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:29.278220 13426 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.265017 13577 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:29.293939  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:29.310277  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:29.290720 13577 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:29.312757  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:29.312798 13754 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:29.322119 13429 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:29.321813 13577 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.317901 13629 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:29.318889 13609 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.323168 13716 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:29.320524 13680 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:29.306531 13696 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:29.269322 13448 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.323426 13127 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:29.344921  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 97566.4us
I20260709 13:17:29.337615 13524 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.357702  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:29.342391 13716 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.360213  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.361055  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.362231  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.343339 13700 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:29.364157  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:29.375990  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.339612 13688 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:17:29.357637 13675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.013s	sys 0.000s
I20260709 13:17:29.345472 13567 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:17:29.389636  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.366171 13716 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.398938  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.399766  8915 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.368724 13524 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.367614 13429 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:29.385916 13629 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:29.405402  8918 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.361869 13687 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:29.358829 13557 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:29.357286 13754 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:29.411612  8916 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:29.387140 13700 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.351305 13680 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.354377 13127 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.385753 13771 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.431360 13771 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.433307 13429 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:29.433846 13429 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:29.434762 13429 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.436228 13429 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:29.392623 13675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.013s	sys 0.001s
I20260709 13:17:29.395535  8913 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:29.446095  8910 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:29.410400 13567 consensus_queue.cc:1243] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:17:29.420420  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51062.5us
I20260709 13:17:29.365778 13743 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:29.415722 13524 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.425320  8917 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [13.6-14.7]
I20260709 13:17:29.428838 13557 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:29.429355 13127 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:29.429759 13760 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:29.448637  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:29.458585  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.459015  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:29.463627  8916 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:29.446221 13687 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.472250  8913 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:29.418618 13629 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.446879 13675 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:29.478940 13773 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.479926 13524 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.460206 13557 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:29.481480 13557 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.483181 13557 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.483538 13692 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.485414 13716 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.487720 13716 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:29.462491 13567 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:29.488780 13567 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.479979 13771 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.493247 13629 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:29.493664  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.493898 13696 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.495671  8766 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:29.495411 13696 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.496410  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.497366  8769 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:29.497599  8763 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:29.498471 13696 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.498417  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.495453  8760 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:29.493873 13678 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.500582 13678 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:29.477465 13687 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.501612 13678 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.502764 13687 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:29.503364  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 316310us
I20260709 13:17:29.503656 13753 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:29.504101 13753 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:29.504971 13753 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.505805  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.506668  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.505824 13497 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:29.507452 13497 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.509503  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.511315 13680 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:29.511579  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.514050 13567 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:29.516386  9460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:29.516711  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:29.522450 13772 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:29.522423  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.522943  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.523578  8840 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:29.479604 13773 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.502941  9461 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54292 (request call id 649) took 1051 ms. Trace:
I20260709 13:17:29.502871 13678 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.528373  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.532361  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.533548  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.535274  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.541193  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.541224  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:29.546165  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.566103  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.575595  8735 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:29.576944  8763 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.537985  9461 rpcz_store.cc:276] 0709 13:17:28.451950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.452200 (+   250us) service_pool.cc:224] Handling call
0709 13:17:28.459037 (+  6837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.469186 (+ 10149us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:28.702166 (+232980us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.856406 (+154240us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.158490 (+302084us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b1800483a00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:29.285269 (+126779us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b1800483a00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:29.502357 (+217088us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b1800483a00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:17:29.502532 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.502608 (+    76us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:29.502653 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.502726 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.502858 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":387137,"prepare.queue_time_us":260676,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":8272,"raft.queue_time_us":723674,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":4966,"spinlock_wait_cycles":131729408,"thread_start_us":324952,"threads_started":2,"wal-append.queue_time_us":268714}
I20260709 13:17:29.577792  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.484715 13692 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.579953  8764 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.582557  8769 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: [12.7-15.8]
I20260709 13:17:29.564489  8912 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:29.587160  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.587419  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.589254  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.537374 13519 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:29.602654  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.597355  8761 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:29.613613  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.593247  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.609261  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:29.615300  8838 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:29.615499  8918 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:29.548465 13518 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:29.610477  8915 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:29.610739  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:29.610489  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:29.595177  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:29.617808  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.589963 13696 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:29.619894  8769 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:29.627573  8764 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:29.614163 13776 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.629096  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.636554  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.635422  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.636328  9463 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:29.638826  8764 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.642865  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:29.642710  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:29.647172  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.649729  8769 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:29.634614 13696 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.651137  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.652303  8769 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:29.651537  8763 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:29.654749  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.661434  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.616570 13519 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.633812 13518 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:29.674043  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 132925us
I20260709 13:17:29.676046  8734 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:29.640491 13608 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:29.651772 13681 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.651072 13696 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.681699  8763 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:29.684999  8769 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:29.694355  8764 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:29.698071 13588 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:29.700357  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:29.712023  8764 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:29.713461  8915 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:17:29.682560 13601 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.684814 13681 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:29.819682  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.639780 13675 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:29.814862  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:29.883730  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 168601us
W20260709 13:17:29.819121 13714 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:29.903033  8764 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:29.904227  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.910714  8915 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:29.850275  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 154034us
I20260709 13:17:29.810552 13577 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:17:29.850188 13769 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:29.906774  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:29.827773 13681 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:29.922405 13778 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260709 13:17:29.923828 13779 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:17:29.936275 13519 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:29.915418  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:29.917186  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:29.806710 13588 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.920518  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.940500 13742 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:29.943152  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.965308  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.945886 13752 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.947083 13754 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:29.912796 13793 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.949995 13564 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:29.908064 13773 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:29.964406 13429 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.528s	user 0.009s	sys 0.005s
W20260709 13:17:29.973112  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 66920.3us
I20260709 13:17:29.817215 13631 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:17:29.962816  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.965260  8836 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:29.968658  8918 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:29.978790  8916 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:17:29.915313  8764 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:29.974845  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:29.962888  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.982705  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.983390  8913 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:29.985334  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:29.986799  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:29.989749  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:29.990581  8841 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:29.991710  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:29.999583  8839 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:30.000257  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:30.000854  8843 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:29.972937 13700 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.007073  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.011008  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.042366 13497 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.041139 13700 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.046521  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.048259  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.049705 13518 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:30.051447  9463 pending_rounds.cc:85] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 13
I20260709 13:17:30.051780  9463 pending_rounds.cc:107] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:17:30.052059  9463 raft_consensus.cc:2889] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:30.010782  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.057723  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.062927  8912 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:30.063464  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:29.986491 13519 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:29.972352 13752 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.973565 13742 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:29.976109 13754 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.083981  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.011695 13629 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:30.009799 13577 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:30.093806  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:30.093925  8912 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:30.110865  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:30.112534  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.958367 13769 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:30.104045  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 174070us
I20260709 13:17:30.104421  8918 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:30.108560  8915 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:30.098363  8843 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:30.010313 13690 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:17:30.063529 13573 consensus_queue.cc:1059] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:17:30.100337 13519 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:30.155962  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.979468 13793 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.160111  9464 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:30.123450 13572 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.114396 13700 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:30.123829 13743 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:30.159206 13573 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.167955 13573 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.171154 13573 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.160353 13519 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.175597 13519 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.178207 13742 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.188058 13793 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.132486 13615 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.189997 13572 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.192920  9466 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
W20260709 13:17:30.193459  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.200883  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 229680us
I20260709 13:17:30.155233 13619 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:30.194893 13777 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.288s	user 0.000s	sys 0.001s
I20260709 13:17:30.131385 13577 consensus_queue.cc:1059] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:17:30.196367 13700 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:30.196209 13799 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:30.222060  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 235361us
I20260709 13:17:30.227316  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.228289  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.196758 13743 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:30.245805 13678 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.667s	user 0.010s	sys 0.004s
I20260709 13:17:30.246657 13588 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.254215  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:30.255440 13619 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.255944 13572 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.257490 13754 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.258852  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:30.265429  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:30.282047 13794 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:30.283766  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:30.268663 13742 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:30.280279 13790 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 13:17:30.270139 13700 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:30.271836 13799 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:30.312803  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 269330us
I20260709 13:17:30.315860  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:30.325460 13795 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:17:30.325649 13769 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.288563 13800 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:30.328452 13800 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.332495 13572 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:30.333302 13572 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.302182 13752 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.336489 13799 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.337874 13799 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:30.347666  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:30.314209 13678 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:30.317503 13588 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:30.353305  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.319562 13410 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:30.395421  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47852.5us
I20260709 13:17:30.350910 13716 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:30.404796  8909 pending_rounds.cc:85] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:17:30.405194  8909 pending_rounds.cc:107] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:17:30.405009  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.405612  8909 raft_consensus.cc:2889] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:30.332382 13801 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:30.410199  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.320305 13742 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.420674  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.423067  8911 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:30.352044 13629 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:17:30.425302  9461 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.352725 13519 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:30.417934 13518 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:30.437057  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.403354 13678 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:30.443626 13675 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:30.444432 13518 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:30.445122 13692 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.857s	user 0.012s	sys 0.002s
I20260709 13:17:30.420451 13410 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:30.466361 13681 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:30.429687 13696 consensus_meta.cc:287] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.730s	user 0.013s	sys 0.000s
I20260709 13:17:30.401520 13508 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:30.429587 13801 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:30.469599  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 116366us
I20260709 13:17:30.471580  8914 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:30.410760 13716 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.460850 13519 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:30.467775 13518 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:30.483566  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.473665 13801 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:30.477543 13799 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:30.477101 13519 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:30.479095 13410 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:17:30.468757 13811 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:17:30.481518 13814 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.476423 13588 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:30.474327 13696 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.495563  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:30.495705 13678 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.500289 13814 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.505309 13814 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.510124  8917 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:30.509152  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.515321 13519 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.516132  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.516604 13519 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.517033 13701 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:30.517716 13701 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:30.518996  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:30.519789 13629 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:30.520323 13629 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:30.520386 13675 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:30.521373 13629 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.521965 13801 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.523561 13801 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.496371 13572 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:30.526520 13681 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:30.528118 13806 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.175s	user 0.000s	sys 0.002s
I20260709 13:17:30.531013  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2072) took 1362 ms. Trace:
I20260709 13:17:30.531446  8768 rpcz_store.cc:276] 0709 13:17:29.168754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.168923 (+   169us) service_pool.cc:224] Handling call
0709 13:17:29.186096 (+ 17173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.209969 (+ 23873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.209999 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:29.210038 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:29.210067 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.530738 (+1320671us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5400199e54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:30.530789 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.530945 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54494080}
I20260709 13:17:30.533001 13683 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:30.494277 13743 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:30.544797 13809 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:17:30.547600  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.548336  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:30.549053  9461 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:30.546070  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:30.562322  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 87636us
I20260709 13:17:30.563513  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2076) took 1015 ms. Trace:
W20260709 13:17:30.563657  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.561390 13743 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.565810 13816 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.563931  8761 rpcz_store.cc:276] 0709 13:17:29.548307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.615964 (+ 67657us) service_pool.cc:224] Handling call
0709 13:17:29.616222 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.616547 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:29.638530 (+ 21983us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.549453 (+910923us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.559135 (+  9682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:30.559210 (+    75us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:30.563276 (+  4066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.563349 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.563461 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":849759,"prepare.queue_time_us":23723,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":894160,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":2124,"thread_start_us":39708,"threads_started":1,"wal-append.queue_time_us":257852}
I20260709 13:17:30.571201  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2061) took 1042 ms. Trace:
I20260709 13:17:30.571641  8760 rpcz_store.cc:276] 0709 13:17:29.528370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.528665 (+   295us) service_pool.cc:224] Handling call
0709 13:17:29.529141 (+   476us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:29.540387 (+ 11246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.540424 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:29.541248 (+   824us) log.cc:844] Serialized 52 byte log entry
0709 13:17:29.688715 (+147467us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:29.695013 (+  6298us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.541664 (+846651us) spinlock_profiling.cc:243] Waited 895 us on lock 0x7b18004074a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:17:30.541872 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.541947 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.565260 (+ 23313us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b240013e9f8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccebfb0 00007fce6f962488 00007fce6f962be8 00007fce6f93a398 00007fce6f93576a 00007fce6f934bb6
0709 13:17:30.570969 (+  5709us) raft_consensus.cc:1685] finished
0709 13:17:30.570988 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.571141 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197482,"prepare.queue_time_us":6122,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":874871,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":23301,"spinlock_wait_cycles":21904000,"thread_start_us":96035,"threads_started":1,"wal-append.queue_time_us":123105}
I20260709 13:17:30.495180 13799 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.578156  9461 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:30.578159  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.547654 13814 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:30.579623  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.581240  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:30.600548  8911 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:30.582098  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:30.585676  8917 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:30.606890  9461 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:30.609295  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.610460  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.566316 13743 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.607381 13681 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:30.573427 13700 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:30.630952  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.618534 13782 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:30.640237 13783 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.640647  9463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:30.648455 13818 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:17:30.652199 13819 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:17:30.608853 13814 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.685566  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:30.633922 13681 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:30.687307  8761 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.687461  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:30.694681  8760 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:30.696297  8764 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:30.697103  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.698880  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.702682 13776 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:30.703883 13773 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:30.705440  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 66759.8us
I20260709 13:17:30.639075 13716 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:30.691967  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:30.707495  8764 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:30.716020  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.721622  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.710784  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.689782  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:30.723592  8763 raft_consensus.cc:2393] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:30.700549  8732 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:30.704980 13714 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:17:30.733156  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.694890 13608 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.728194  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.737979  8764 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:30.706758 13824 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.708084 13785 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:30.747856  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.754369  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.755319  8844 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:30.757416  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:30.758303 13675 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:30.758476  9434 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:30.758728 13675 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.759089 13675 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.721115 13615 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:30.717732 13611 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:17:30.771174  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.762048 13793 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.771956  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.769050 13696 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.793951  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.682034 13782 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.684654 13783 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.806881  8763 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:30.750128 13608 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.844316  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2116) took 1429 ms. Trace:
I20260709 13:17:30.791754  8761 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:30.845971  8760 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:30.867928  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.868640  8766 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:30.869153  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 2084) took 1250 ms. Trace:
I20260709 13:17:30.862795  8914 rpcz_store.cc:276] 0709 13:17:29.414886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.415279 (+   393us) service_pool.cc:224] Handling call
0709 13:17:29.415557 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.474163 (+1058606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.843988 (+369825us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000384d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:30.844232 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2424114944}
I20260709 13:17:30.870303  8766 rpcz_store.cc:276] 0709 13:17:29.618334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.867635 (+1249301us) service_pool.cc:224] Handling call
0709 13:17:30.869094 (+  1459us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:30.795102 13821 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.869727  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:30.870519  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 166127us
I20260709 13:17:30.880056  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.880986  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.871695  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.884327  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.871687  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.886734  8766 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:30.872295  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.768287 13615 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.888729  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.877676  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:30.889560  8842 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:17:30.858189 13799 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:30.895143  8842 pending_rounds.cc:85] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 7
I20260709 13:17:30.897459  8842 pending_rounds.cc:107] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:17:30.763407 13785 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.897763  8842 raft_consensus.cc:2889] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:30.761142 13824 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:30.871816 13795 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:30.900548  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:30.776552 13681 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:30.869119 13743 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:30.914695  8760 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:17:30.917477  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.936508  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.967788  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.962472 13832 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:30.985648 13826 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:17:30.968111 13814 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:30.987829 13608 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:30.919100 13609 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.997326 13783 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:30.997547 13827 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:17:31.005828  8910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 2114) took 1616 ms (client timeout 1831 ms). Trace:
W20260709 13:17:31.006474  8910 rpcz_store.cc:269] 0709 13:17:29.389215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.389342 (+   127us) service_pool.cc:224] Handling call
0709 13:17:31.005499 (+1616157us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b54003ae154. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:31.005739 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115788160}
W20260709 13:17:31.025381  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155705us
I20260709 13:17:31.009799 13785 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.025882 13836 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.004506 13609 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:30.894042 13821 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:31.043716 13830 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:31.043176 13836 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.045672 13782 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.045900 13615 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.047395 13821 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.066779  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.067540  8839 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:31.049841 13609 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.069823 13799 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:31.054606 13824 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:31.053130 13833 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 13:17:31.070395 13799 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.061178 13769 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.082461  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:31.064095 13836 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.062651 13800 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.089946 13837 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.091478 13837 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.092366 13837 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.093375  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2062) took 1564 ms. Trace:
I20260709 13:17:31.093786  8762 rpcz_store.cc:276] 0709 13:17:29.528745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.530486 (+  1741us) service_pool.cc:224] Handling call
0709 13:17:29.530752 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.573352 (+ 42600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.573398 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.574345 (+   947us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.928112 (+353767us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4800360558. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:17:31.061329 (+1133217us) spinlock_profiling.cc:243] Waited 4.89 ms on lock 0x7b18000aa3e0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:17:31.085430 (+ 24101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:31.085473 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.085554 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.093108 (+  7554us) raft_consensus.cc:1685] finished
0709 13:17:31.093128 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.093309 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":681483,"raft.queue_time_us":42242,"raft.run_cpu_time_us":2602,"raft.run_wall_time_us":349137,"spinlock_wait_cycles":22643840,"thread_start_us":23895,"threads_started":1,"wal-append.queue_time_us":1516882}
W20260709 13:17:31.103338 13519 consensus_meta.cc:287] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.586s	user 0.002s	sys 0.009s
I20260709 13:17:31.109694  9464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 661) took 1046 ms. Trace:
I20260709 13:17:31.110206  9464 rpcz_store.cc:276] 0709 13:17:30.063022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.063163 (+   141us) service_pool.cc:224] Handling call
0709 13:17:31.109439 (+1046276us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b54004c7f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:31.109591 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220128512}
W20260709 13:17:31.089145 13518 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.602s	user 0.014s	sys 0.000s
I20260709 13:17:31.115418 13800 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.116358 13800 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.118883  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:31.121124 13222 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:31.121533  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.122445  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.123390 13619 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.121562 13222 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:31.124284 13222 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.090402 13769 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:31.131429  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.114022 13518 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.137765  8840 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.140015  9466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 660) took 1080 ms. Trace:
I20260709 13:17:31.140565  9466 rpcz_store.cc:276] 0709 13:17:30.059529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.061072 (+  1543us) service_pool.cc:224] Handling call
0709 13:17:31.139736 (+1078664us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b540057dad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:31.139899 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198561536}
I20260709 13:17:31.143584  8809 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.153230  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.156476 13127 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.156935 13127 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.157282 13127 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.150594 13524 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:31.166509 13426 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.160611 13524 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:31.168387 13524 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.170121 13524 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.169905 13127 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.172955 13127 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.176960 13680 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:31.177450 13680 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:31.178241 13680 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.179973 13798 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.180426 13798 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:31.181095 13769 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.181202 13798 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.182961 13798 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.146849 13799 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.191519 13448 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.182768 13800 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.203181  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:31.208936  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.209853  8836 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:31.214871 13753 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.218633 13518 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.203652 13675 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.219960  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:31.222847 13675 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:31.226249 13784 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 1.320s	user 0.004s	sys 0.000s
I20260709 13:17:31.228305  8835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2246) took 1707 ms. Trace:
I20260709 13:17:31.229698  9467 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:31.229730  8664 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 9 to 12, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:31.228700  8835 rpcz_store.cc:276] 0709 13:17:29.520803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.522561 (+  1758us) service_pool.cc:224] Handling call
0709 13:17:29.522946 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.523313 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.523340 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.523786 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.697738 (+173952us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:29.697796 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.697882 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.225658 (+1527776us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:31.228002 (+  2344us) raft_consensus.cc:1685] finished
0709 13:17:31.228023 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.228243 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":5286144,"thread_start_us":173540,"threads_started":1,"wal-append.queue_time_us":192063}
I20260709 13:17:31.235782  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 594) took 1001 ms. Trace:
I20260709 13:17:31.236725  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:31.237515  8836 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:31.232034  8664 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.236189  9468 rpcz_store.cc:276] 0709 13:17:30.219671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.220715 (+  1044us) service_pool.cc:224] Handling call
0709 13:17:31.117785 (+897070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.118090 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.118113 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.118165 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:31.118202 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.118275 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.220622 (+102347us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b54004c7f50. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:31.220740 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035136768}
I20260709 13:17:31.239917  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:31.252477 13222 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.256531  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:31.258927 13222 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.241163 13518 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.262430 13518 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.264588 13742 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.243708 13681 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.265333 13681 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.267743 13681 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.155898 13837 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.277160 13755 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.277776 13755 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.278726 13837 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.201674 13769 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.279646 13769 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.281045  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.282039 13769 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.284981  8765 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:31.285856 13800 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.286428 13800 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.291072 13518 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.292114  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.293320  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.293957  8835 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:31.295866  8918 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:31.297266  8768 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:31.297158  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.297819  8843 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:31.291162  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.299813  8841 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:31.303447  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.305927  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.306628  8836 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:31.307720 13687 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.288671 13800 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.309499 13755 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.309966  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.310113  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:31.310705  8913 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.310699  8841 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:31.317010  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:31.318266 13781 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 1.409s	user 0.000s	sys 0.003s
I20260709 13:17:31.325069  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.325394  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.325857  8835 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:31.326190  8768 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:31.330835  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.333381  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.335971  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.337057  8766 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:31.338670  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.339548  8762 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:31.328763  8664 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 7 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.345444 13837 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 4 to 9, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:31.349402 13800 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:31.351233 13688 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.351959  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.352834  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.353404 13688 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:31.353797 13688 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.354166 13688 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:31.354533  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.357178  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.358083  8760 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:31.353041  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:31.361156  8836 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.364143 13753 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:31.364637 13753 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.357259  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.365577  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.366273  8768 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:31.365008 13753 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.308341 13687 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.374140  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:31.392699  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:31.381980  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.382827  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.370957  8913 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:31.394105  8839 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:31.394505  8918 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:31.384481  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.392758  8764 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:31.376758  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.382433  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58862 (request call id 459) took 1727 ms. Trace:
I20260709 13:17:31.400264  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:31.401826 13761 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:31.402443 13761 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:31.404953  8765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 2054) took 1893 ms (client timeout 2014 ms). Trace:
W20260709 13:17:31.405388  8765 rpcz_store.cc:269] 0709 13:17:29.493257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.493396 (+   139us) service_pool.cc:224] Handling call
0709 13:17:31.385302 (+1891906us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b5400338954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:31.386536 (+  1234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4117351680}
I20260709 13:17:31.407232 13564 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.378736 13680 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.407761 13564 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.381213 13678 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:31.410007 13678 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.410102 13564 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.410511 13678 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:31.414135 13611 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:31.414565 13611 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:31.383679 13823 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.415514 13611 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.416625 13755 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.417272 13755 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.419165  8916 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:17:31.381945  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.420497  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.422910  8918 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:31.404711 13761 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.415721 13675 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:17:31.424796 13611 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.425977 13675 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:31.426196 13832 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.433531 13675 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:31.433806 13832 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.434173  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.434319 13832 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.429903 13687 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.434823  9467 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:31.426561 13805 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.437520  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.444823 13761 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.445613 13761 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.447750 13761 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.448874 13742 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.449311 13742 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.449397  8839 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:31.449741 13742 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.450874  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.451570  8843 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:31.437768 13805 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.460265  8840 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:31.434515 13675 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.439378 13700 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:31.443382  8664 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 5 to 13, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.459581  8913 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 4 to 9, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:17:31.457507  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57596.7us
I20260709 13:17:31.462075  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.466353  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.470329  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.475826  8836 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
W20260709 13:17:31.477278  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 234333us
I20260709 13:17:31.477504  9434 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:31.478228  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.461329 13805 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.482196  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.484138  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:31.485390  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:31.492384  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.472132 13573 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.471944 13485 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.397187  8769 rpcz_store.cc:276] 0709 13:17:29.654797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.881813 (+227016us) service_pool.cc:224] Handling call
0709 13:17:29.884405 (+  2592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.884615 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:29.907447 (+ 22832us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.720977 (+813530us) log.cc:844] Serialized 14 byte log entry
0709 13:17:30.721549 (+   572us) log.cc:844] Serialized 14 byte log entry
0709 13:17:31.381796 (+660247us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b18003fb680. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:17:31.381963 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:31.382018 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:31.382075 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.382142 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.382356 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1271120,"prepare.queue_time_us":494248,"prepare.run_cpu_time_us":156,"prepare.run_wall_time_us":11824,"raft.queue_time_us":1192971,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":16640,"spinlock_wait_cycles":14204928,"thread_start_us":281644,"threads_started":2,"wal-append.queue_time_us":253560}
I20260709 13:17:31.468178 13800 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:31.505081  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:31.489513 13752 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:31.475677 13755 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:31.494977 13675 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:31.513803  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43611.8us
I20260709 13:17:31.502310 13410 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.506177 13839 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.503579 13837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:39884 (request call id 10) took 1078 ms. Trace:
I20260709 13:17:31.519610  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.514410 13752 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.524623  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:31.522365  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.523644 13839 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.527602 13825 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:31.530920 13797 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.531179  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.531500 13797 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:31.531821  8841 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:31.532398 13797 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.533118  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:31.533962 13839 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.526871  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.540676 13698 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:31.541205 13698 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.541585 13698 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.516033 13410 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:31.542532 13410 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:31.543768  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 803503us
I20260709 13:17:31.544831  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:31.547233  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.547943  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.550683  8840 raft_consensus.cc:1240] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:31.551852  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:31.553040  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 59840.8us
I20260709 13:17:31.553500  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.556496  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.554455  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:31.525475 13557 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.540151 13752 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.560714  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.537725 13426 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.549918 13755 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:31.552930 13839 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.555107 13485 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.561947 13535 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.581558 13683 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:17:31.586637 13755 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:31.609634 13843 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:17:31.610064 13846 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:17:31.523175 13837 rpcz_store.cc:276] 0709 13:17:30.414335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.414486 (+   151us) service_pool.cc:224] Handling call
0709 13:17:30.447086 (+ 32600us) log.cc:844] Serialized 494 byte log entry
0709 13:17:31.487616 (+1040530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3385,"raft.queue_time_us":5892,"raft.run_cpu_time_us":1809,"raft.run_wall_time_us":40847,"spinlock_wait_cycles":2944,"thread_start_us":39050,"threads_started":1,"wal-append.queue_time_us":53682}
I20260709 13:17:31.639744 13678 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.622081 13755 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.663722 13805 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.674652 13678 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.652674 13832 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.683730 13832 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.705693 13753 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.708667 13753 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.714576 13805 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:31.746279 13742 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.751696 13698 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.752110 13755 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.487339  8664 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 10 to 12, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 12 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:31.792055  8664 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:31.798688  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 1.06141e+06us
I20260709 13:17:31.799294  8664 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 10 to 11, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 11 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:31.802408  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.803872  8664 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.806595  8664 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 2 to 8, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 8 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.809900  8664 catalog_manager.cc:5697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 6 to 11, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 11 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.814508  8664 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 10 to 11, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:31.818006  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2086) took 1131 ms. Trace:
I20260709 13:17:31.818140  8664 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:31.818673  8767 rpcz_store.cc:276] 0709 13:17:30.686062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.686222 (+   160us) service_pool.cc:224] Handling call
0709 13:17:30.721564 (+ 35342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.417234 (+695670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.417281 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:31.417905 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.558610 (+140705us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:31.558683 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.816829 (+258146us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54000bb8d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:31.817050 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.817170 (+   120us) raft_consensus.cc:1685] finished
0709 13:17:31.817199 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.817699 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":528541,"raft.queue_time_us":529339,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":383214336,"thread_start_us":140086,"threads_started":1,"wal-append.queue_time_us":219862}
I20260709 13:17:31.821502  8664 catalog_manager.cc:5697] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:31.577262  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.826040  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 249105us
W20260709 13:17:31.828089  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.851460  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 290677us
I20260709 13:17:31.855952  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:31.866184  8918 raft_consensus.cc:2393] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:31.876739  9467 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:31.877151 13497 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:31.878194 13429 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.878347 13497 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:31.882344 13497 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.883849 13508 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:31.884999 13508 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.889190 13508 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.889441 13429 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.891397 13426 consensus_queue.cc:1059] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:17:31.876741  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.898273  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:31.898785 13127 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:31.899712  8840 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:31.899804  8653 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3a106d574bc4cfeaa6e7b1240430c4b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260709 13:17:31.913185 13688 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.003s
I20260709 13:17:31.914319 13688 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:31.962572  8835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.037s
W20260709 13:17:31.963335  8835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.017s	sys 0.037s
W20260709 13:17:31.967252  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.973356 13557 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:31.974190 13557 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:31.977183  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 175864us
I20260709 13:17:31.844599  8664 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.980845 13764 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.982260 13764 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.982981 13771 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:31.983952 13771 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.983494  8664 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 7 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:31.985970 13764 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.988294 13764 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:31.989928 13608 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:31.990538 13764 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:31.991133 13608 consensus_queue.cc:1243] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 3b34c95a175945b88b17f07fbc650abf log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:17:31.991667 13764 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:31.992447  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:31.994029 13860 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 13:17:31.995319 13716 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.999328 13771 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:31.999650 13611 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:32.002998 13716 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.003947 13611 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:32.004370 13716 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.011832 13698 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.017730 13764 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.017618 13611 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.019394 13611 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.019233  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:32.024094  8664 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 5 to 11, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 11 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.025087 13535 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:32.027107 13535 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:31.748970 13752 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.034183  8909 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:32.037700 13410 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.040213 13410 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.041117 13755 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.042622 13688 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.044291  9467 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:32.047857 13799 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:32.051242  8840 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:32.002451 13742 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.025030 13716 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.054160 13793 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:32.057701  9432 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.814s (SENT)
I20260709 13:17:32.058561  9432 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.059677 13752 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.060176 13497 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.980294  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:32.061848  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 222008us
I20260709 13:17:32.059504 13716 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.073165 13429 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.976064 13557 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:32.088749  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 494413us
I20260709 13:17:32.093602  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:32.099848 13485 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.081154 13764 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:32.117427  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 137423us
I20260709 13:17:32.118003  9465 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:32.134652  8808 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.660s (SENT) [suppressed 15 similar messages]
I20260709 13:17:32.135098  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.136071  8843 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.136682  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.137845  8839 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.120848  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.138929  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.146138  8844 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:32.148295  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 292678us
W20260709 13:17:32.150535 13675 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.606s	user 0.015s	sys 0.000s
I20260709 13:17:32.150388 13864 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.145102  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.153767  9466 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:32.159459  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.160240  8841 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:17:32.161787  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.172412  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.174621  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.191869  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.194386  8844 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:32.196022 13557 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.196171  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.197575  8837 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:32.208702  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 74129.3us
W20260709 13:17:32.213325  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.220579  8843 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:32.221920  8839 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:32.227090 13866 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:32.230123  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101035us
I20260709 13:17:32.231261  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.233080 13764 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.215022  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.241889  9465 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:32.245543 13864 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.246023 13675 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:32.246349 13864 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:32.247604  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 161898us
I20260709 13:17:32.246729 13675 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.254133 13675 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.257048 13764 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.257871 13764 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.259923  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:32.261361  9468 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:32.263765  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:32.259552  8808 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.681s (SENT)
I20260709 13:17:32.265027 13799 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:32.265909 13799 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.266355 13799 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.260315 13764 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.260102 13864 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.278834  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:32.275264  8808 leader_election.cc:336] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.722s (SENT)
I20260709 13:17:32.282936  8734 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:32.284476 13761 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.295578 13761 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.297075 13761 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:32.298543 13761 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.297679  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:32.285383  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44302.9us
I20260709 13:17:32.241173  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:32.313346  8837 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:32.299419  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:32.324101  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 112385us
I20260709 13:17:32.328995 13127 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:32.337438 13557 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.337554 13867 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.338625 13557 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:32.340039 13557 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.343700 13799 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.351285  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.352330 13866 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.359448  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:32.360598 13752 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:32.360724  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:32.361433 13752 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:32.361814 13716 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:32.362529 13752 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.365175  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.379360  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:32.380089  9467 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:32.385257 13799 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.389587 13611 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:32.390074 13611 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.390388 13611 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:32.399979  8884 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:32.401925  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 88141.8us
I20260709 13:17:32.404201  8841 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:32.406127  8836 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:32.406443  9467 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:32.405855 13716 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:32.414808  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 70390.5us
I20260709 13:17:32.414126 13867 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:32.422015  8809 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:32.424574 13798 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:32.427002 13798 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:32.428154 13798 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:32.429302  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.433852 13761 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:32.439986  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.439826  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 165616us
I20260709 13:17:32.440243  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:32.440749  8808 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.724s (SENT)
I20260709 13:17:32.443449  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.441004 13761 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.415422 13716 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.443373  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.445318 13867 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:32.447919  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:32.448493 13429 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:32.448838 13742 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.453276 13742 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.454182 13867 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.457391  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:32.456590 13742 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.467352  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:32.470767  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:32.471609  8910 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16.
I20260709 13:17:32.473842  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.474098 13869 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.475476  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.475984 13869 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.476300 13752 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:32.476827 13752 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.459250 13866 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:32.457651 13764 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.476488 13869 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.461797 13429 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.477313 13752 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:32.487397  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 68649.8us
I20260709 13:17:32.488462  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.489880 13764 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:32.491741  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.494659 13764 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:32.483534 13429 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:32.483016 13869 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:32.512449  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.513120 13690 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:32.513377  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.519912  9465 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:32.524444  8734 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:32.538379 13764 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:32.538975 13764 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:32.542831  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.543084  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:32.547636  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:32.549055  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 108302us
I20260709 13:17:32.554345  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:32.555471 13608 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.554446 13761 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.556274 13764 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.558992 13761 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:32.559710 13761 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.543872 13690 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:32.585515  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:32.592187  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.556274 13608 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:17:32.577051 13675 raft_consensus.cc:2764] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:32.612169  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.629400  8767 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:17:32.629966  8767 pending_rounds.cc:85] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 7
I20260709 13:17:32.630465  8767 pending_rounds.cc:107] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:32.630782  8767 raft_consensus.cc:2889] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:32.631916  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:32.632829  8761 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:32.633270 13864 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:32.634769  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:32.634816  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 79046.9us
W20260709 13:17:32.641438  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.644095  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.644927  8841 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:32.644775 13761 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.630714  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:32.597363 13690 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.670116 13573 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.672165  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:32.655965 13497 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.659986 13799 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.656702 13761 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:32.640924 13864 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.682525  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.689888  8841 raft_consensus.cc:2368] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17.
I20260709 13:17:32.672729 13557 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.673030 13866 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.675351 13742 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.706887  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:32.708153  8808 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.925s (SENT)
I20260709 13:17:32.708055  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:32.713330 13567 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:32.713816 13869 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.714977  8835 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 16. Ops: []
I20260709 13:17:32.710618  8914 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:32.713816 13567 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.716593 13567 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.718649  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.711220 13866 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.721217  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.722062  8838 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:32.722847 13825 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.723081 13866 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.723358 13825 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.724479  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.725288  8841 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:32.725795 13825 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.725929 13742 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.717031  8836 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:32.717695  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.728283 13742 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.729379 13742 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.729928 13742 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:32.730636 13881 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:32.731181  8915 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:32.732002 13742 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.733071  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:32.716109 13869 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.733707  8913 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 18.
I20260709 13:17:32.734153 13869 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.734647 13869 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.736600 13869 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.733541  8914 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:32.738821 13883 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.683650 13535 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:17:32.741832  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.743202  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:32.742123 13878 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:17:32.670811 13573 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.739511 13883 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.683156 13675 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:17:32.759670  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.698508 13799 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.766940 13883 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:32.767556  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:32.709461 13557 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.776975  8917 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:32.757313 13535 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.781615  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.761582 13567 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:32.749639 13761 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.767597 13883 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.827378  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:32.836462  8842 raft_consensus.cc:2393] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:32.843004  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:32.844190  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 145320us
I20260709 13:17:32.849117  8910 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: [13.13-13.13]
W20260709 13:17:32.847064  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 141477us
I20260709 13:17:32.807446 13535 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.855770  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:32.857872  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:32.857841  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:32.858858  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:32.861083 13557 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.861856 13886 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:32.862268 13799 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.862524 13886 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:32.863123 13886 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.844530 13127 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.865159 13127 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.867394 13127 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.868350 13535 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:32.863081 13567 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:32.869393  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.871799  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.872555  8769 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.878451 13690 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:32.879704 13429 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.881893  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.882751  8761 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.887080  8769 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:32.837401 13883 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:32.893497  8909 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:17:32.895044  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.901314  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.908360  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:32.909471  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.932083  8761 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:32.941727  8767 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:32.943177  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.961795  8761 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 9: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:32.964133  8808 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.014s (SENT)
W20260709 13:17:32.964603  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60204.9us
I20260709 13:17:32.965883  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.939944 13752 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:32.973060  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 98248us
W20260709 13:17:33.014133  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44988.8us
W20260709 13:17:32.969874  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47250us
I20260709 13:17:32.960098 13864 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:33.022025 13535 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.022617 13890 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:33.025776  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:32.966694 13716 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:33.030589  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:32.978088  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.974197  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.034698  8918 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:32.977468  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.036671  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.037986  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:32.964485 13675 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:33.043298  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:33.047813 13897 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 13:17:33.052759  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 91143.2us
I20260709 13:17:33.053853  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:33.052605  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.062347  8917 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:33.066371  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.072145  8768 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:33.073968  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.073393  8769 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:17:33.075302  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.087736  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.046540 13675 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:33.066892 13761 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.075210 13688 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:33.073843 13429 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.104477  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.119791  8836 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:33.105268  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:33.106411  8843 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:17:33.121178  8843 pending_rounds.cc:85] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 8
I20260709 13:17:33.121531  8843 pending_rounds.cc:107] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:17:33.121830  8843 raft_consensus.cc:2889] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.118340  8841 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:33.112829  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.045775 13716 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.044116 13535 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:33.127640  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101930us
I20260709 13:17:33.124716  8763 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:33.100939 13742 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:33.120194 13611 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.001s
I20260709 13:17:33.102705 13895 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.130156  8765 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:33.103885 13675 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.142570  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.145067 13742 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.131294  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.071120 13690 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:33.113574 13889 raft_consensus.cc:2764] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:17:33.156766  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:33.118945 13883 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:33.159605 13892 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 13:17:33.165911  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.132607 13688 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.166563  8767 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:33.068209 13902 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:17:33.169026  8768 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:33.194363  8763 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.153038 13611 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.196107  8735 leader_election.cc:400] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17.
I20260709 13:17:33.196128  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.196619  8735 leader_election.cc:403] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.198501  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.198626  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.200026  8769 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:33.202876  8842 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:33.203564  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:33.204672  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 148913us
I20260709 13:17:33.209915  8761 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:33.221582  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.230173  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:33.257536  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 291703us
I20260709 13:17:33.259308  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:33.260540  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44032.2us
I20260709 13:17:33.212168 13895 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17.
I20260709 13:17:33.269276  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.269997  8910 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:33.271566  8769 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:33.274964  9468 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:33.216686 13497 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:17:33.274034 13127 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:33.277971 13688 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.230829 13742 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.279405 13567 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:33.291316  8763 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:33.297489  9466 raft_consensus.cc:2393] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:33.298722  8764 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:33.306259  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.303417  8807 leader_election.cc:400] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16.
I20260709 13:17:33.307649  8807 leader_election.cc:403] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:33.307832 13716 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:33.295367 13608 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:33.309425  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.312384  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.312680  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.313297  8769 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.325995  9467 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:33.300742 13127 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.328905  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.329118 13127 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.329659  8915 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:33.312274 13567 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:33.331003 13567 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.331626 13127 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.332460  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.333139  8918 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:33.333833  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.322839  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:33.340678  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.341178 13898 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:17:33.341414  8764 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:33.341087  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.342063  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.343384  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.343634  8918 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:33.345510  8916 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:33.342166  8915 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:33.347697  8761 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:33.348719  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.349205 13906 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16.
I20260709 13:17:33.349408  8761 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:33.349689  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.350344  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.350694  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.351418  8768 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.351864 13716 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.350893  8762 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:33.355580  8763 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:33.350368  8767 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:33.338526  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:33.345314  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:33.372136  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 112017us
I20260709 13:17:33.374173  8769 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:33.377566  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.367751  8911 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:33.379655  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:33.380903  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 45065us
I20260709 13:17:33.382396  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.383313  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.383963  8843 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:33.392205  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:33.393112  8917 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:33.378693 13761 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:33.394709  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46615.5us
I20260709 13:17:33.396479  8764 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:33.397958  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 98782.6us
I20260709 13:17:33.399857  8842 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:33.404245  8918 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:17:33.401850  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.394114 13742 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.410634 13557 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:33.396970 13761 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:33.425038  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.426707  8768 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:33.431569  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.409006 13611 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.407681 13907 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.439193  8760 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:33.441088 13716 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:33.441673 13716 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.426580 13557 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:33.442224 13557 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.443077 13716 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.437471 13907 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:33.433313 13895 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:33.446131 13907 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.446810 13895 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.447535 13907 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.435092 13426 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:33.437361  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.437177 13573 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.456408  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.407516 13906 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:33.468037  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.469514  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:33.472131  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 43676.9us
I20260709 13:17:33.420938 13911 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:33.473886  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.474951  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.457315 13611 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.478133  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:33.481922  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61572.5us
I20260709 13:17:33.482358  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.509543  8882 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:33.477186 13573 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:33.477845 13867 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:33.481407 13886 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.615s	user 0.006s	sys 0.007s
I20260709 13:17:33.477344 13426 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:33.521783 13867 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:33.525442 13867 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.478794 13688 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:33.477557 13761 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.511801 13869 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.505326 13883 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.521711 13866 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:33.523844 13886 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:33.534089  8808 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.811s (SENT)
I20260709 13:17:33.524678 13426 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:33.559341  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 103000us
W20260709 13:17:33.551156  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.559947  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:33.550037  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67805.3us
I20260709 13:17:33.572335  8764 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:33.574318  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:33.541563 13869 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:33.551611 13752 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.573666 13426 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.552112 13866 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:33.550834 13573 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.516994 13485 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:33.552243 13429 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:17:33.598433  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54604.7us
I20260709 13:17:33.586681 13869 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.597376 13866 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.606066 13895 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:33.606360 13914 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:17:33.605970 13928 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 13:17:33.607249 13915 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:17:33.609282 13927 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:33.609928 13886 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.611303 13799 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.612850 13929 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:33.601478 13883 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.620745 13913 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:17:33.621420 13917 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:17:33.622141 13573 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.623917 13426 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.604552 13864 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:33.593189 13675 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.620056 13798 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.629966 13928 consensus_queue.cc:1243] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:33.630123 13688 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.662182  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75758.3us
I20260709 13:17:33.663522 13929 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.680749  9465 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:33.668516 13864 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:33.686854  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.679320 13742 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:33.705384 13929 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.711447 13557 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.714526 13557 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.677359 13688 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.716943 13895 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.717708  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 183702us
I20260709 13:17:33.717602 13895 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.718153 13688 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.718828 13675 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.719951 13895 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:33.720438 13426 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.722625  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.716804 13825 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:33.661573 13883 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.726398  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:33.695538 13864 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:33.741232  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 181374us
W20260709 13:17:33.744652  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 140110us
I20260709 13:17:33.742660  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.727291 13825 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:33.732893 13798 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.749523  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:33.750496  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.750487  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.754581  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.758294  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.758963  8765 raft_consensus.cc:2376] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13. Re-sending same reply.
I20260709 13:17:33.759896 13937 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.760664 13485 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.763234 13429 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:33.764043 13429 consensus_queue.cc:1243] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:33.766842 13883 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.768316 13927 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.768229 13898 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:33.768886 13927 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:33.769413 13927 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.769037 13898 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.771821 13898 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.752722 13935 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:17:33.758040 13933 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:17:33.757479  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.768929  8764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:17:33.780123  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.783233  8764 raft_consensus.cc:606] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.783285  8765 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.783838  8764 raft_consensus.cc:614] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:33.750782 13716 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:33.745692 13895 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:33.752269 13798 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.724942 13936 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:17:33.752664 13557 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:33.791709 13938 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:17:33.809273 13936 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:33.809669 13936 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:33.791695  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.811743  8760 raft_consensus.cc:2368] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13.
I20260709 13:17:33.815181 13922 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:33.815629 13922 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:33.816039 13927 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.794713  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.827445  9466 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:33.796847 13567 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:33.785341 13867 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.798636  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.816527 13922 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.828260 13927 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.786221 13485 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:33.801069 13798 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:33.858778  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 81608.1us
I20260709 13:17:33.859489  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.846987  8768 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:33.807958 13895 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.810555 13936 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.818359 13869 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.821722 13866 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.822707 13127 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.793512 13535 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:33.824142 13894 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:33.824440 13716 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.824913 13761 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.825274 13939 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:33.826124  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68707.1us
I20260709 13:17:33.798884 13864 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.847939  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.844615  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.828790  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.847432  8766 raft_consensus.cc:1240] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: [11.8-13.9]
W20260709 13:17:33.830415  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.857517 13922 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.857867 13867 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:33.848093  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.895021  8767 raft_consensus.cc:2368] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:33.805871 13825 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.829777 13799 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:33.863199 13485 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:33.853102  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.847589  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.876820  8765 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
W20260709 13:17:33.879485  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.885818 13127 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:33.900399  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.901522  8767 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:33.901678  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 72985.8us
I20260709 13:17:33.882534  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.890048  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:33.896747 13932 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.897245  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:33.903251  8764 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:33.902365  8768 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.900012  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.905207  8765 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.907545 13716 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.907567  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.908847 13127 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:33.909399 13567 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:33.909782 13567 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.910164 13567 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.899138  8760 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:33.911721  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:33.917243  8842 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 10: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:33.918116  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.918820  8765 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:33.920248  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:33.917675  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.920786  9467 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:33.921254  8766 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.921983  8809 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:33.923429 13864 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:33.924278  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.925514  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.924430  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:33.926548  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.927637  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.928169  8767 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:33.929003 13485 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:33.929380 13929 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:33.929982 13485 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.933456 13426 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.933678 13933 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:33.934178  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.934249 13933 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:33.934994  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.935588  8764 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:33.936452  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.903203 13936 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.924333  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.941960  8769 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:33.943678  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.944430  8768 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:33.946843  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.898488 13799 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:33.948952  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.950747  8768 raft_consensus.cc:2376] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11. Re-sending same reply.
W20260709 13:17:33.950870  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.956615  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:33.957310  8843 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:33.957764  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:33.959473  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.957335  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:33.960796  8841 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:33.964251  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:33.950030  8839 pending_rounds.cc:85] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 6
I20260709 13:17:33.965898  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:33.966297  8760 raft_consensus.cc:2410] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:33.965900  8839 pending_rounds.cc:107] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:33.967254  8839 raft_consensus.cc:2889] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:33.973475  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.038676  8838 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.040629  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.041968  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.041922  8918 raft_consensus.cc:2368] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17.
W20260709 13:17:34.045274  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 84635.8us
I20260709 13:17:34.045976  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.047353  8837 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:34.049222  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.050992 13942 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:34.051491 13942 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.051894 13942 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.053642  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:34.054773  8915 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:34.050020  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 85849.3us
I20260709 13:17:34.058746  8843 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:34.061691  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.060247  8769 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:34.063261  8767 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.075150  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.081251  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.081661 13926 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:34.082316  8760 raft_consensus.cc:2368] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:34.083673  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.084532  8760 raft_consensus.cc:2368] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
I20260709 13:17:34.085395 13927 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:34.086764 13925 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:34.087136 13925 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:34.087946 13925 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:34.089207  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.090499  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.091269  8841 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:34.091434 13925 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.092041  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.094431  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:34.095041  8911 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.096745 13927 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:34.097265 13869 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:34.097648 13931 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:34.099406  8913 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.076802  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:34.128113  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:33.917111 13932 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.140283  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.141808  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:34.142613  8914 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:34.142215  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75730us
I20260709 13:17:34.152779  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.156550  8843 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 16. Ops: []
I20260709 13:17:34.158280  8838 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:34.173192  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.060243 13608 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:34.062424 13898 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:34.166527  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:34.181351  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.082319 13926 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.182893  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.191481  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.183647  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.196151  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.192507  8760 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:34.116701 13931 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:34.201014  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.201830  8765 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:17:34.203841  8768 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:34.203763  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.205018  8769 raft_consensus.cc:2376] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13. Re-sending same reply.
I20260709 13:17:34.209261  8913 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 10.
I20260709 13:17:34.224763  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:34.226712 13947 log.cc:927] Time spent T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:17:34.229039  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.195974 13926 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.230580  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.231849  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.234592 13932 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:34.236560  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:34.237334  9468 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 9.
I20260709 13:17:34.239042  8768 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:34.241103 13895 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:34.241386  8915 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.241685 13921 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:34.242236 13921 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:34.242426  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.220602  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.246057  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:34.250810  8766 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:34.253165  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.253579  8914 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:34.257863  8764 raft_consensus.cc:1217] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Deduplicated request from leader. Original: 5.4->[7.5-11.7]   Dedup: 7.5->[9.6-11.7]
I20260709 13:17:34.258423  8764 pending_rounds.cc:85] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 5
I20260709 13:17:34.258677  8764 pending_rounds.cc:107] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:34.258947  8764 raft_consensus.cc:2889] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.260654  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.264670  8766 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.264791  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.113097 13799 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:34.190747 13886 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:17:34.224803 13950 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:17:34.276738  8914 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:34.277038  9468 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.280524  8918 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 16. Ops: []
I20260709 13:17:34.286000  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.286296  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.196417 13898 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.243578 13911 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:34.262579 13932 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:34.261445 13866 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:34.208221 13608 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.313030  8766 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:34.314345  8766 pending_rounds.cc:85] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 7
I20260709 13:17:34.314972  8766 pending_rounds.cc:107] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:34.315559  8766 raft_consensus.cc:2889] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:34.319029  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:34.319911  8910 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:34.324553  8912 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:34.329944  8768 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:17:34.333397  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.341720  8915 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:17:34.301414 13932 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.308789 13799 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:34.354720  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.356660  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.358338  8767 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
W20260709 13:17:34.358583  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 233315us
I20260709 13:17:34.359429  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.367879  8767 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.358956  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.377398  8767 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:34.381042  8767 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:17:34.302134 13798 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:34.301659 13911 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:34.356113 13932 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.418846  8767 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:34.431675  8768 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:34.419409  8910 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:34.418044  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:34.375831 13944 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.443950  8761 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:34.450248  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:34.451296  8909 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.459013  8768 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.459597  8909 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:34.462210  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:34.465551 13567 consensus_meta.cc:287] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.555s	user 0.013s	sys 0.001s
I20260709 13:17:34.466214 13567 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.485356 13567 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:34.486078  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.488768 13883 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:34.493892  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.505947  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.379247 13894 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:34.510654  8766 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:34.518103  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.428535 13933 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:34.561264  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.567387  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.573545  8766 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.570135  8761 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [12.7-14.8]
I20260709 13:17:34.312058 13931 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.575428  8911 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:34.588685  8918 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.607179  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:34.613471  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:34.615134  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.703514 13867 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.703927 13911 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:34.704075 13867 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.704504 13867 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.709676 13608 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:34.711616 13951 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260709 13:17:34.712549 13497 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.712253 13926 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:34.612351 13886 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.116s
I20260709 13:17:34.617689  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:34.715665  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 108632us
I20260709 13:17:34.716387 13485 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:34.717063 13889 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.722395 13798 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:34.803893  8766 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
W20260709 13:17:34.808122  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 190520us
I20260709 13:17:34.812711 13557 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:34.813540 13557 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:34.812779 13925 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.721s	user 0.005s	sys 0.013s
I20260709 13:17:34.797520  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:34.528939 13944 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:34.819394 13567 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:34.820205  8840 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:34.821619 13944 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:34.532505 13896 consensus_queue.cc:1059] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 13:17:34.824954 13896 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:34.825496 13896 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:34.826725 13896 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.816488 13557 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:34.828611 13896 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:34.843153  8841 raft_consensus.cc:2368] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:34.534730 13894 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.845281  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.853595  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.856564  8761 raft_consensus.cc:1240] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:34.872056  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.873735  8762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2160) took 1004 ms. Trace:
I20260709 13:17:34.810894 13497 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.880312 13898 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:34.884284 13825 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:34.886274  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.904279  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:34.895090 13942 consensus_meta.cc:287] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.843s	user 0.009s	sys 0.001s
W20260709 13:17:34.896485 13955 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.311s	user 0.003s	sys 0.007s
I20260709 13:17:34.810451 13573 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:17:34.898049  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2157) took 1033 ms. Trace:
I20260709 13:17:34.907043  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.900017  8766 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:34.908847  8808 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.660s (SENT)
W20260709 13:17:34.905750  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.837541 13941 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:34.910211  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.900045  8762 rpcz_store.cc:276] 0709 13:17:33.869121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.869245 (+   124us) service_pool.cc:224] Handling call
0709 13:17:33.869585 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.869939 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.869972 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.870499 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.107120 (+236621us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:34.107163 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.107237 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.873508 (+766271us) raft_consensus.cc:1685] finished
0709 13:17:34.873525 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.873646 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1124,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2428,"thread_start_us":227409,"threads_started":1,"wal-append.queue_time_us":448704}
I20260709 13:17:34.907660  8763 rpcz_store.cc:276] 0709 13:17:33.864714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.864896 (+   182us) service_pool.cc:224] Handling call
0709 13:17:33.893605 (+ 28709us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:33.903503 (+  9898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.903533 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:33.938516 (+ 34983us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.265793 (+327277us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:34.298233 (+ 32440us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.307970 (+  9737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.308038 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.714127 (+406089us) raft_consensus.cc:1685] finished
0709 13:17:34.714160 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.897824 (+183664us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b54002003d0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:34.897980 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14536,"prepare.queue_time_us":32101,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":49262,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":205,"spinlock_wait_cycles":65146240,"thread_start_us":210681,"threads_started":1,"wal-append.queue_time_us":675229}
I20260709 13:17:34.929207  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.933334  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:34.935798  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:34.936203  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:34.837956 13889 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:34.937392  8766 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:34.906992 13798 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:34.955106  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.932896 13941 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:34.911058 13942 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:34.973440  8917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.011s	sys 0.028s
W20260709 13:17:34.974027  8917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.028s
I20260709 13:17:34.952821  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.952983  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:34.979117  8766 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:34.997988  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.999567  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:35.005998  8842 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:34.908540 13944 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:35.027458  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2189) took 1055 ms. Trace:
I20260709 13:17:35.025303  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:34.955411 13761 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.068s	user 0.008s	sys 0.003s
I20260709 13:17:35.018239  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:35.030735  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 121925us
I20260709 13:17:35.033687 13941 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.037786 13942 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:35.022490 13922 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.092s	user 0.005s	sys 0.007s
I20260709 13:17:35.045279  8765 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:35.048089  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:35.049010  8836 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.051926  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.052755  8762 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:35.027942  8917 rpcz_store.cc:276] 0709 13:17:33.966638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.966745 (+   107us) service_pool.cc:224] Handling call
0709 13:17:34.155247 (+188502us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b58001d1f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75a22 00007fce75b8ec09 00007fce74ce8ee0 00007fce74db20ab 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:17:34.155545 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.155809 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:34.416198 (+260389us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.003281 (+587083us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.021314 (+ 18033us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:35.021386 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:35.021445 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.021532 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.021695 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45787,"prepare.queue_time_us":371965,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":64930,"spinlock_wait_cycles":23644032,"thread_start_us":764098,"threads_started":2}
I20260709 13:17:35.033735 13895 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:35.060081  8766 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:35.060333  8808 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.587s (SENT)
I20260709 13:17:35.060853  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:35.000959 13798 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.066381  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:34.997587 13932 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.039618 13944 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.077350  8768 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:35.075194  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:35.080910  8766 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:17:35.077881  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.058876 13895 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:35.061275 13567 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:35.092242  8836 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:35.076378 13922 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:35.058380 13867 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.076772 13926 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.098845  8842 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:17:35.101056  8842 pending_rounds.cc:85] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 7
I20260709 13:17:35.101488  8842 pending_rounds.cc:107] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:17:35.101943  8842 raft_consensus.cc:2889] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.103229 13889 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.105728  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.106463  8762 raft_consensus.cc:2376] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14. Re-sending same reply.
I20260709 13:17:35.115700  8836 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:35.142649  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 52767.8us
I20260709 13:17:35.144359  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.145277  8762 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:35.144769  8808 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.843s (SENT)
W20260709 13:17:35.151582  8808 leader_election.cc:336] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.846s (SENT)
I20260709 13:17:35.152197  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:35.157385 13971 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:17:35.159986  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2140) took 1058 ms. Trace:
I20260709 13:17:35.160424  8767 rpcz_store.cc:276] 0709 13:17:34.101758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.425612 (+323854us) service_pool.cc:224] Handling call
0709 13:17:34.426262 (+   650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.426652 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.426695 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.441766 (+ 15071us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.973043 (+531277us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:34.973111 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.973311 (+   200us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.159778 (+186467us) raft_consensus.cc:1685] finished
0709 13:17:35.159799 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.159925 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":318665,"threads_started":1,"wal-append.queue_time_us":536347}
W20260709 13:17:35.163525  8735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.031s	sys 0.053s
W20260709 13:17:35.164047  8735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.032s	sys 0.053s
W20260709 13:17:35.164389  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 688368us
I20260709 13:17:35.167131  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2102) took 1286 ms. Trace:
I20260709 13:17:35.167659  8769 rpcz_store.cc:276] 0709 13:17:33.880851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.234262 (+353411us) service_pool.cc:224] Handling call
0709 13:17:34.234677 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:34.559028 (+324351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.559068 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:34.710263 (+151195us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.053123 (+342860us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:35.078678 (+ 25555us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.078996 (+   318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.079075 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.166841 (+ 87766us) raft_consensus.cc:1685] finished
0709 13:17:35.166871 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.167053 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30137,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":6309,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":9362,"thread_start_us":665360,"threads_started":2,"wal-append.queue_time_us":390078}
W20260709 13:17:35.170181 13968 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:35.175729 13798 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.142967 13889 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:35.176939 13889 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.180516 13889 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.141305 13895 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.182170 13895 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:35.186390 13944 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.186829 13932 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:35.150687 13894 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:35.189092  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2350) took 1248 ms. Trace:
I20260709 13:17:35.189237 13921 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.189491  8844 rpcz_store.cc:276] 0709 13:17:33.940402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.940522 (+   120us) service_pool.cc:224] Handling call
0709 13:17:33.940853 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.962354 (+ 21501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.962384 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.965615 (+  3231us) log.cc:844] Serialized 26 byte log entry
0709 13:17:34.260792 (+295177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:34.260833 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.263049 (+  2216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.188122 (+925073us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b24002a23a8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccebfb0 00007fce6f962488 00007fce6f962be8 00007fce6f93a398 00007fce6f93576a 00007fce6f934bb6
0709 13:17:35.188749 (+   627us) raft_consensus.cc:1685] finished
0709 13:17:35.188769 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.188995 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9728,"raft.queue_time_us":20967,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":72896,"spinlock_wait_cycles":144637312,"thread_start_us":210108,"threads_started":1,"wal-append.queue_time_us":325220}
I20260709 13:17:35.190814 13921 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.194871  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:35.110474 13567 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.196173  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:35.195192  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:35.197886  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.204614  9459 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:17:35.204813  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.205444  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.197718  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.206347  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:35.207216  8762 raft_consensus.cc:2393] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:35.207880 13497 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:35.208097  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.209336  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.211349  9465 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:17:35.211741  9465 pending_rounds.cc:85] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 12
I20260709 13:17:35.211992  9465 pending_rounds.cc:107] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:17:35.212205  9465 raft_consensus.cc:2889] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.212236  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2355) took 1096 ms. Trace:
I20260709 13:17:35.212689  8840 rpcz_store.cc:276] 0709 13:17:34.115663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.457693 (+342030us) service_pool.cc:224] Handling call
0709 13:17:34.458160 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.820561 (+362401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.212000 (+391439us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54002805d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:35.212182 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831830400}
I20260709 13:17:35.214743 13944 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.215209 13944 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.217202 13944 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.206422  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:35.220402  9467 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:35.227067  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.829s (SENT)
I20260709 13:17:35.229787  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2168) took 1355 ms. Trace:
W20260709 13:17:35.230010  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.234754  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 2289) took 1280 ms. Trace:
I20260709 13:17:35.235868  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:35.235379  8841 rpcz_store.cc:276] 0709 13:17:33.953435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.091780 (+138345us) service_pool.cc:224] Handling call
0709 13:17:35.224441 (+1132661us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b5400322b54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:35.233677 (+  9236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724809600}
I20260709 13:17:35.230391  8764 rpcz_store.cc:276] 0709 13:17:33.874062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.212206 (+338144us) service_pool.cc:224] Handling call
0709 13:17:34.257658 (+ 45452us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:34.307602 (+ 49944us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:34.846987 (+539385us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800422860. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce737923c7 00007fce6fda49a7 00007fce6fdb40bf 00007fce6fdb4038
0709 13:17:35.066609 (+219622us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.146091 (+ 79482us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:35.148615 (+  2524us) log.cc:844] Serialized 52 byte log entry
0709 13:17:35.148764 (+   149us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:35.220493 (+ 71729us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.220717 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.220801 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.229440 (+  8639us) raft_consensus.cc:1685] finished
0709 13:17:35.229471 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.229709 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82083,"prepare.queue_time_us":114764,"prepare.run_cpu_time_us":14220,"prepare.run_wall_time_us":30808,"raft.queue_time_us":22507,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":20630,"spinlock_wait_cycles":4583168,"thread_start_us":267960,"threads_started":2,"wal-append.queue_time_us":107086}
I20260709 13:17:35.239682 13886 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:17:35.260142 13886 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:35.260562 13886 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:35.261396 13886 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.262636 13886 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.265075 13889 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:35.270037 13608 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.270188 13497 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:35.274768 13608 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.275317 13497 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.239919 13927 consensus_queue.cc:1059] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:17:35.241986 13867 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:35.270397 13976 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:17:35.270159 13964 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.281451 13964 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.285548  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:35.286312  8762 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:35.307788  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:35.308529  9465 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 6.
I20260709 13:17:35.310907  8734 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:35.312001 13761 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:35.312258 13931 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.312388 13761 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:35.312848 13761 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:35.316932  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 89905us
I20260709 13:17:35.323737 13497 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.336635  9467 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:17:35.327392 13958 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.852s	user 0.006s	sys 0.016s
I20260709 13:17:35.356182  9468 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:35.359097  8913 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:35.361526 13886 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.362006  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:35.362139 13886 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.364696 13886 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.364807 13889 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:35.365165  8883 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:35.366178  8839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2349) took 1426 ms. Trace:
W20260709 13:17:35.366392  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.366873  9459 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:35.366627  8839 rpcz_store.cc:276] 0709 13:17:33.939819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.939929 (+   110us) service_pool.cc:224] Handling call
0709 13:17:33.949816 (+  9887us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.046028 (+ 96212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.046057 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.064041 (+ 17984us) log.cc:844] Serialized 52 byte log entry
0709 13:17:34.279234 (+215193us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:34.279290 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.279382 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.304308 (+1024926us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b24002a23a8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cb339c4 00007fce6cb31acb 00007fce6ccecdc9 00007fce6cceca55 00007fce6ccec09d 00007fce6f91e10e 00007fce6f93588c 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221
0709 13:17:35.360713 (+ 56405us) raft_consensus.cc:1685] finished
0709 13:17:35.360734 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.366118 (+  5384us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7384,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":38744,"spinlock_wait_cycles":129984256,"thread_start_us":211021,"threads_started":1,"wal-append.queue_time_us":295501}
I20260709 13:17:35.357791 13895 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.368774 13895 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.370914 13895 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.358182 13608 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:35.371743  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.380369  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2162) took 1509 ms. Trace:
I20260709 13:17:35.380908  8765 rpcz_store.cc:276] 0709 13:17:33.870478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.210863 (+340385us) service_pool.cc:224] Handling call
0709 13:17:34.211243 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:35.046652 (+835409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.380064 (+333412us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b540025b054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:35.380294 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917003520}
I20260709 13:17:35.396132  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 2241) took 1156 ms. Trace:
I20260709 13:17:35.397955  8883 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:35.396586  8918 rpcz_store.cc:276] 0709 13:17:34.239822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.297002 (+ 57180us) service_pool.cc:224] Handling call
0709 13:17:34.588426 (+291424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.613829 (+ 25403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.395880 (+782051us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54001d4550. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:35.396063 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637019392}
W20260709 13:17:35.403134  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 160209us
W20260709 13:17:35.407680  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.408627  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.409107  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.410648  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:35.411669  9467 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:35.401255 13752 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:35.401374 13932 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:35.419808  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.421397  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:35.406138 13608 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:35.428189 13608 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:35.429801  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.430459 13608 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.432466  9467 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:17:35.455430  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.467970  8761 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:35.473639  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:35.437105 13867 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:35.435421 13752 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:35.436069 13964 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.422026 13761 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.441776 13932 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:35.493110  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 57269.8us
W20260709 13:17:35.497705  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.437879 13557 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:35.436955 13941 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:35.478046 13931 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:35.510746  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2173) took 1633 ms. Trace:
I20260709 13:17:35.510340 13752 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.457741 13970 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:17:35.516644 13964 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:35.517812  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 705357us
I20260709 13:17:35.517649 13716 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:35.519464 13761 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:35.492233 13867 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:35.527947  8839 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:35.528681 13867 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.530798 13798 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.531558 13925 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.531339 13798 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.532109 13925 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.533653 13798 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.521047  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:35.534440  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 382873us
I20260709 13:17:35.534665 13925 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.535239 13925 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.536129 13927 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:35.536492 13927 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:35.537329 13932 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:35.537644  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 298993us
I20260709 13:17:35.511173  8760 rpcz_store.cc:276] 0709 13:17:33.877779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.228561 (+350782us) service_pool.cc:224] Handling call
0709 13:17:34.228842 (+   281us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.263891 (+ 35049us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.263926 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.270175 (+  6249us) log.cc:844] Serialized 52 byte log entry
0709 13:17:35.399980 (+1129805us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b1800415e40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:17:35.421124 (+ 21144us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:35.421169 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.421241 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.510446 (+ 89205us) raft_consensus.cc:1685] finished
0709 13:17:35.510467 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.510683 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259,"raft.queue_time_us":12232,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4272,"spinlock_wait_cycles":5895552,"thread_start_us":20953,"threads_started":1,"wal-append.queue_time_us":1203313}
I20260709 13:17:35.540494  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:35.546626  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:35.547245  8842 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.552314  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:35.553315  8839 raft_consensus.cc:2393] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 11: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:17:35.555668  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 82129.3us
I20260709 13:17:35.556002  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:35.558085  8840 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:35.568171  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:35.546865 13941 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.516043 13931 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:35.569733  8808 leader_election.cc:336] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.864s (SENT)
I20260709 13:17:35.573197  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:35.574472  8807 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:35.577050 13944 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:35.580853 13925 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.570676 13921 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:35.583889 13921 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.574790 13941 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.537340 13927 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.575011 13906 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:35.568358 13922 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:35.546670 13825 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:35.615657  8842 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:17:35.627288  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 57451.2us
W20260709 13:17:35.627638  9432 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.666s (SENT)
W20260709 13:17:35.637689  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61209.5us
I20260709 13:17:35.642014  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:35.644379  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:35.629452 13894 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:35.632773 13906 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.674172  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:35.677225  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:35.677857  8843 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:35.679602  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:35.676111  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 126734us
I20260709 13:17:35.652298 13927 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.647315 13922 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:35.697798  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 129767us
I20260709 13:17:35.654671 13906 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.734406  8843 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:35.652395 13944 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:35.697747  8735 leader_election.cc:400] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:35.759403  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:35.692893  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:35.679169 13992 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.687837 13894 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:35.759739  8735 leader_election.cc:403] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:35.692570 13535 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:35.770447  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 76688.9us
W20260709 13:17:35.734453  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.794716 13999 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:17:35.794971  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 225252us
I20260709 13:17:35.797451 13992 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:35.805621  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 112823us
W20260709 13:17:35.836686  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.839424  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:35.840565  8808 leader_election.cc:336] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.916s (SENT)
I20260709 13:17:35.760339 13970 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:35.881248  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:35.882102  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:35.882831  8918 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:35.841897 13883 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:35.842053 13869 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:35.886518 14000 log.cc:927] Time spent T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:17:35.886380 13883 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.886662 13869 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.889151  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:35.889254 13944 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:35.872689  8914 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:35.875677  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:35.848281  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:35.841389  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:35.893837  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:35.871510 13929 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:35.893201  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44987.4us
I20260709 13:17:35.900050  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:35.875747  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:35.888616 13883 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:35.902294  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.900803  8914 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.901111  8916 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:35.851039  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 117142us
I20260709 13:17:35.754693 13567 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:17:35.906988  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:35.845057 13761 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:35.871551 13964 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:17:35.924466  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.886525 13921 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:35.908275 13869 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:35.926402 13931 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:35.955251 13929 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:35.900173 13970 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:35.954198  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 54886.9us
I20260709 13:17:35.902359 13990 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:35.981241  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 140747us
W20260709 13:17:35.982266  8808 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 1.931s (SENT)
I20260709 13:17:35.934377 13608 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.956068  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.991298  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.941013  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:35.873036 13535 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:35.961772 13557 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:35.941210  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.003896  8918 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:35.974772  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:35.980203  8914 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:35.982967  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:35.951815 14001 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:17:35.945652 14005 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:17:35.958650  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 218165us
I20260709 13:17:36.016414  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:35.928058 13924 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.002713  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:35.953843 14020 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.980888 13990 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.991154 13921 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.018553  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:36.021723  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.017278 14019 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:36.034111  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.025950  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.017745 13869 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:35.971065 13922 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.042330  8732 leader_election.cc:400] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17.
I20260709 13:17:36.043167  8732 leader_election.cc:403] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:36.001106 13608 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.024005 13761 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.025693 13990 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:36.044631  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62409.2us
I20260709 13:17:36.022886 14002 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.050287  8841 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:36.051096  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.037765 14021 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.039837 13931 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.007364 13894 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.079325  8732 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.080740 13992 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.085109 13970 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.034296 13921 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.044216 13869 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.073719 13761 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17.
I20260709 13:17:36.039688 14019 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.107384 13931 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:36.119097  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 248962us
I20260709 13:17:36.066663 13929 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.126348  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:36.126794  8761 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:36.127048  8760 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.128307  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:36.129025  8762 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:36.129802  8769 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:36.130848  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.130980  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.131592  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.132207  8766 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.077091 14021 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.131494  8769 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:36.136458  8765 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:36.139405  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.140169  8764 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:36.141439  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.143239  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.144044 13761 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.151614  8760 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:36.174661 13970 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.191602  8766 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:17:36.198529  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55362.6us
I20260709 13:17:36.199769  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.200352  8917 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:36.202901  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:36.203735  8918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:36.199335  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.205286  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.148417 14018 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:36.205317  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.206846  8918 raft_consensus.cc:606] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.207080  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.206621  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.207428  8918 raft_consensus.cc:614] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:36.207842  8910 raft_consensus.cc:2368] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:36.148924 14017 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:36.208581  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.202142  8916 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:36.209865  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:36.211058  8913 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:36.212355  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.209683 13883 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.194574 13866 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:36.214347  8916 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:36.201467 13535 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:36.207403 13994 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.572s	user 0.000s	sys 0.011s
I20260709 13:17:36.227676  8910 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:36.228585  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.228986  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.226933  8911 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:36.230396  8916 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:36.233965 13869 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.234958 14012 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:36.237715 13995 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.498s	user 0.000s	sys 0.002s
I20260709 13:17:36.213958 13970 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.240825 13937 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:36.241340 13937 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:36.243327 14009 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:17:36.244935 13608 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.215677 13716 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:36.245802 13716 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.247928 13964 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
W20260709 13:17:36.248334  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.248258 13716 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.232174 13567 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:17:36.249960 13921 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:36.251363  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.276084  9432 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Timed out: RequestConsensusVote RPC to 127.7.122.65:33017 timed out after 2.509s (SENT)
I20260709 13:17:36.252436  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.277434  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.211805 13895 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.278342  8913 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
W20260709 13:17:36.281775  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53623.1us
I20260709 13:17:36.215865 13761 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:36.284811  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.285009 13761 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.282226  8917 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:36.285681 13761 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:36.287137 13894 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:36.286660 13761 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.288718 13761 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.289397  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.290210 13931 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:36.290867 13931 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.235616 14012 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:36.309978  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.315114  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 103944us
I20260709 13:17:36.251008 14019 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.212642 14018 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.226933 13866 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:36.323968  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47933.8us
I20260709 13:17:36.214927 14017 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.242231 13937 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.336849  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.342011  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.339619  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.346279  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.347043  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:36.347412  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.348053  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.348588  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.349197  8764 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:36.351572  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.340058  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.342603  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.283100 13906 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.352538  8764 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:36.355974  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:36.360502  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.364984  8909 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.370397  8884 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:36.371385 13567 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:36.371995 13567 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:36.373000 13567 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:36.374101  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.374792  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.375237  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.376089  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.379782  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.380110  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.380447  8844 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:36.380542  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:36.383374  8909 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:36.357821 14013 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:36.391142  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.392555  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.386669 13921 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:36.387154 13990 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.388278 13798 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:36.388851 13941 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.386938 13944 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.388792 13936 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:17:36.393079  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.393368  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.396251  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:36.396513  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.398133 13926 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:36.404558 13926 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:36.407471 13926 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:36.398348 13921 consensus_queue.cc:1243] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:36.404697 13944 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:36.409569 13944 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:36.410616 13944 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.411226  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.402983  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:36.413852  8918 raft_consensus.cc:2376] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13. Re-sending same reply.
I20260709 13:17:36.398720 13798 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.406150  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:36.380960 13937 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.402499  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.423257  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.418361  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.424535  8768 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:36.400465  8839 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:36.420634  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.420477  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:36.425026  8732 leader_election.cc:400] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:36.425915  8764 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:36.426507  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.428298  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.430015  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.434747 14041 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.435027  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.435309 14041 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:36.414705 14030 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:17:36.437397  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.438277  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.434481  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.395190 14013 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:36.441741  8761 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:36.439582  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.446578  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.451226  8768 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 7: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:36.447594  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:36.454489  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.449096  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.489277  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:36.490554  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71266.8us
I20260709 13:17:36.492035  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.429672 13895 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.436782 13922 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.500675  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:36.440994 13921 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:36.444495 13761 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.444195 14021 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:36.529322  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 494710us
I20260709 13:17:36.525997  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.445238 14041 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:36.536084  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101688us
I20260709 13:17:36.551607  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:36.537459  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 48288.9us
W20260709 13:17:36.542269  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.547610  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.556740  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.557331  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.456421 14013 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:36.553304  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.500705 13964 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.553910  8764 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
W20260709 13:17:36.559026  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67048.3us
I20260709 13:17:36.434480 14046 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 13:17:36.536944 14049 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:36.510110 13922 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.490278 13894 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:36.585738  8764 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:36.557967 14012 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.552160 13921 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:36.597530  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.565829 13889 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.577103 13895 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.568871 13557 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.541718 13535 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:36.572279 13964 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:36.556126 13992 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:17:36.584017 13922 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.574257  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:36.663530  8768 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:36.626164  8913 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:36.632967 14035 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:36.636345  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.639927 14029 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.645780 13485 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:36.646679 14033 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:17:36.666870  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.683956  8765 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:36.593096 13761 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:36.580837 14049 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:36.617843 13895 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:36.661782 13964 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:36.651072 13557 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:36.708357 14031 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:17:36.701526 13825 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:36.709450 13825 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.709968 14004 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:36.710716 14004 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.701759 13895 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.706952 13557 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.714504  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:36.715200  8837 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
W20260709 13:17:36.716257 14044 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.256s	user 0.000s	sys 0.003s
I20260709 13:17:36.691524 14029 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.695895 14049 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:36.729962 14034 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:17:36.734154 13990 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:36.695063 13866 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.738420 14017 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.705245 14018 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.744295 13825 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:36.704502 13906 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:36.747344 13927 consensus_meta.cc:287] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 1.007s	user 0.004s	sys 0.012s
I20260709 13:17:36.749358 14029 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.698441 13761 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:36.744637 14002 consensus_meta.cc:287] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.002s
W20260709 13:17:36.770457 14026 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.692s	user 0.004s	sys 0.000s
W20260709 13:17:36.776367  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 208467us
I20260709 13:17:36.768838 14002 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.800779  8768 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:36.786134 13761 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.804589  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:36.806874  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 451656us
W20260709 13:17:36.814046  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.817826  9432 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.834257  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.835300  8768 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
W20260709 13:17:36.837061  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 78190.7us
W20260709 13:17:36.843778  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.780220 13921 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.851989  8841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2298) took 1213 ms. Trace:
W20260709 13:17:36.856601  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.854899  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:36.856197  8841 rpcz_store.cc:276] 0709 13:17:35.638894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.640331 (+  1437us) service_pool.cc:224] Handling call
0709 13:17:35.640650 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.060317 (+419667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.851693 (+791376us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b5400280ad4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:36.851920 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941452672}
I20260709 13:17:36.817737 14017 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:36.861997  8768 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:36.864099  8843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.006s
W20260709 13:17:36.864610  8843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.004s	sys 0.006s
W20260709 13:17:36.862744  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 483425us
W20260709 13:17:36.867062  8766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.009s	sys 0.001s
W20260709 13:17:36.867473  8766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.001s
W20260709 13:17:36.851687 14020 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.008s	sys 0.013s
I20260709 13:17:36.869155  8766 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 13:17:36.824170 14033 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:17:36.855806 14004 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:36.859714 13761 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:36.881361  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 377648us
I20260709 13:17:36.862238 13889 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:36.870445 14020 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.008s	sys 0.013s
I20260709 13:17:36.887418  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.870226 13798 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:36.899770  8808 leader_election.cc:400] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 10. Current term is 11.
W20260709 13:17:36.904444  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.907793 13497 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:36.908474 13497 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.910708 14041 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:36.911659 14056 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:17:36.913529 14054 log.cc:927] Time spent T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:17:36.914723 14052 log.cc:927] Time spent T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:36.914078 13497 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:36.894734 13761 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.919031 13761 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:36.921458  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.925244  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.927297  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.928336  9466 raft_consensus.cc:2410] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:36.931951 14004 raft_consensus.cc:2764] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:17:36.901515 13926 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:36.934422  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.935413  8836 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:36.935889 13926 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:36.943117 14049 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.945142  8808 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:36.946691  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:36.946995 13926 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:36.949937  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.961846  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:36.971467  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 66789.8us
I20260709 13:17:36.973001  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.975888  9468 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:36.968559 14005 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:17:36.979228 13937 consensus_meta.cc:287] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.008s
I20260709 13:17:36.974736 13761 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.991343 14049 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:36.996450  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.997089  9467 raft_consensus.cc:1813] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Handling vote request from an unknown peer 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:36.997213  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:36.997619  9467 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:36.997298 13798 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:36.998934  9464 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:37.000368  9461 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:17:37.001282  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 99680.3us
I20260709 13:17:36.991683 14013 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:36.985246 13926 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.980260 13894 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:36.992594 14032 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.750s	user 0.000s	sys 0.002s
I20260709 13:17:36.985056 13557 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:36.995623 14004 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:37.002329  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:37.014334 14053 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.014734 13964 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.014933 14053 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.017225  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:37.018648  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 131326us
I20260709 13:17:37.021518  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.023818  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.028985  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.030691  8766 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
I20260709 13:17:37.031250  8764 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:37.014339 13557 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.034648  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:37.035367  9462 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:37.023319 13573 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.019945 14004 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:37.033773  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:37.033252 13798 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:37.039378 13986 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:17:37.020138 14002 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:17:37.048889  9461 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:37.053851 14063 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:37.054850 14053 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.055133 14063 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:37.055513 14063 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:37.058255 14019 raft_consensus.cc:3055] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:37.058728 14019 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:37.061264  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 59008.2us
I20260709 13:17:37.062042  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:37.056353 14063 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.069844 13866 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:37.070577 14063 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.071308 13567 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:37.071768 13567 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:37.072196 13567 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.077368 14068 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:37.077876 14068 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:37.078305 14068 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.078838  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:37.081127 13964 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:37.067926 13939 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:17:37.083021 13921 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:37.083336 14043 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.392s	user 0.002s	sys 0.000s
I20260709 13:17:37.083563 13921 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.089303 14013 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.092041 14045 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:37.092730 14045 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.095319  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:37.096338 13573 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.097097 14018 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:37.097599 14058 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:37.098292  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.098903  8767 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.097551 14018 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.100154 14018 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.102006  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:37.102921 13573 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.103289 13573 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:37.103696 13573 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.104310 13992 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:37.116529  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.119189  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.123315  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.123693  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.124615 13975 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.124307 13895 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.125134 13975 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.125536 13975 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.127352 13895 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.128078 13889 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:37.120499  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.129019  9466 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:37.059572 14019 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.130031 14019 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:37.133293  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.134598  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.136365 14045 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:37.119539  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 95799.7us
I20260709 13:17:37.137547  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:37.156984  9434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.839s (SENT) [suppressed 29 similar messages]
I20260709 13:17:37.154615 14019 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:37.155799  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.158308 13567 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.149389 13964 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.060263 13922 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.171332  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.172971  8914 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:37.174280  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.175231  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.176157  8915 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:37.176914  8917 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.179013  8916 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 7.
I20260709 13:17:37.180181  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.181527  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.181639  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.182410  8767 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:37.184029  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.184326  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:37.187948  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.191447  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.172430 13992 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.202066 13567 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.178311 14045 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:37.206125 13926 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.208252 14068 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.178303 13964 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.210975 13964 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.211526 14062 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.212035 14062 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:37.212442 14062 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.214788 14013 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:37.215360 14013 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:37.216466  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.193166  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.186566 13927 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:37.221232 14013 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.230023 14045 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:37.233174 14045 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:37.233595 14045 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:37.234778 14073 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:37.182997 14004 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.215772 13573 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.241333 13608 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:37.241771 13608 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:37.242266 13573 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.243055 13608 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.244254 13608 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.247643  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2185) took 1119 ms. Trace:
I20260709 13:17:37.248071  8761 rpcz_store.cc:276] 0709 13:17:36.127976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.135097 (+  7121us) service_pool.cc:224] Handling call
0709 13:17:36.135372 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.458792 (+323420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.247399 (+788607us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540025c454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:37.247581 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704134528}
I20260709 13:17:37.251153 13922 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.254052 14045 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.257010  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.264590 14021 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:17:37.265772 14021 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:37.266264 14021 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:37.266852  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.267499  8769 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.267488 14021 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:37.272976  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.278573  8836 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:37.279011  8836 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:37.279786  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.279704  8836 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.282078 14021 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.283407 14049 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:37.284368  8841 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:37.284665 13889 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:37.285054 13889 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:37.289037  8769 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:17:37.289965  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.222597  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.291404  8909 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:37.295132  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.296092  8837 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:37.290184  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:37.298126  8842 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.298658  8836 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.305537  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.309269  8842 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:37.311179 13937 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:37.312987  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.314893  8837 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:37.215832 13936 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:37.340775  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.219964  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:37.368021  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 148474us
I20260709 13:17:37.370970  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.371522  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.371937  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.372572  8761 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:37.377406  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.377990  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.379232  8766 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:37.380219  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.380774  8836 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:37.381285  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.381951  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.385936  8912 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.382212  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.315773 13895 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:17:37.386269  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.387131 13895 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:37.282423 14045 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.382990  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.372486  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.378661  8762 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:37.396747  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.396938  8914 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:37.397603  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.384737  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.398293  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:37.387789  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.396657  8764 raft_consensus.cc:2376] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16. Re-sending same reply.
I20260709 13:17:37.382604  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.371266  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:37.399875  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.390002  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.391268  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.391916  8918 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:37.392846  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.393348  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:37.394304  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.398341  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.225193 14068 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.411119 14041 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.411607  8913 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:37.411978  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.413743  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.414578  8760 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:37.415683  8760 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:17:37.400647  8764 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:37.416811  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.417682  8844 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:37.417817  8762 raft_consensus.cc:2393] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:37.418578  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.311648 13937 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:37.419629  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:37.419940 13937 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.366420 13883 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.367259 13936 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:37.424328 13936 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:37.425230  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:37.427389  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.311947 14046 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:37.433696  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 62510.9us
I20260709 13:17:37.409260  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.286019 13889 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.410876  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.434913  8767 raft_consensus.cc:2393] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:37.410797  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.435388  8763 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:37.435966  8914 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:37.411677 14068 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:37.437860  8840 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:37.441280  8766 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:37.442288  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.442839  8766 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.422336 13883 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.445937  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.447289  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:37.453438  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55231.4us
I20260709 13:17:37.451196  8761 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:37.454389  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.455507  8761 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:37.457819  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.454231  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:37.388068 13922 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.311942 14018 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.387538 13895 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:37.475980  8767 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:17:37.529863  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.450551 13937 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.484737  8769 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:37.485044  8914 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:37.470024 13761 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.491298  8766 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:37.529853  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:37.495949  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:37.460598 13927 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:37.542433  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:37.478427 13925 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:17:37.450840 14041 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.481130 13889 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:37.469806 14027 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.471712 13497 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.536070  8766 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:37.454537 13975 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.538959  8808 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:37.483196 13894 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.557632  8766 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: [11.12-14.13]
I20260709 13:17:37.562150  8836 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:37.565626  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:37.540179  8763 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:37.551653  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:37.568370  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.555696  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.529060 13798 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:37.559177  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.572539  8767 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:37.534936 13931 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.572392  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:37.534200  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76503.5us
I20260709 13:17:37.580190  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.407681  8909 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:37.554240 13497 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:37.593688  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.532804 14002 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:37.545352 14061 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:37.570189 13798 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.607161  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.576723 13906 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.549738 13926 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:17:37.619931  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.598889 13497 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.596975 13894 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.628151  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:37.569934 14041 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.607466 13970 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.550946 13761 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:37.636876  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 197419us
I20260709 13:17:37.629500  8915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:37.610176 14061 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:37.636169  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 57390.3us
I20260709 13:17:37.617966 13925 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.614701 13798 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:37.634027  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 240783us
I20260709 13:17:37.638548  8915 raft_consensus.cc:606] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:37.571791 14027 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.619817 14035 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:37.640784  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.627626 14029 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.650277  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:37.653259  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.656418  8912 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:37.604975 13895 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.642799 13925 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:37.689126  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 254609us
I20260709 13:17:37.641594 14061 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.691075 13925 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.691210  9434 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.633316 14055 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:37.638504 13931 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:17:37.689184 14035 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:37.645447 14017 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:17:37.713932  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.684960 13557 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:37.734027  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 107818us
I20260709 13:17:37.735191  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.686913  8916 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:37.667104 14029 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.715554 13932 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.696014 13883 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:37.744971  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:37.745558  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.748080  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.670284 13716 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:37.749483  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:37.790673  8837 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.724011 14035 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.731803 14018 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.668251 14068 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:37.750820  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.711712 13567 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:17:37.810649  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 119524us
W20260709 13:17:37.757088 14080 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 13:17:37.814152  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 69316.7us
I20260709 13:17:37.821480  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.823503  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:37.754042 14019 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:37.824708  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.826261  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75536us
I20260709 13:17:37.830569  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:37.696323 13990 consensus_queue.cc:1175] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bdb96be202c2447586477b2077b7d5bf" responder_term: 15 status { last_received { term: 15 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 15 index: 7 } }
I20260709 13:17:37.792397 13970 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.835171  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:37.835625  8766 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:37.750675 13992 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:17:37.821743 14021 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.868487  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:37.835918 14046 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:37.833406 14019 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:37.759709 13932 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.834291 13866 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.841432 13883 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.836313 14094 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.874961  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:37.836159 13573 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:17:37.879362  8837 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
W20260709 13:17:37.909260  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.913273  8808 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:37.870142 13975 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:37.841632 13557 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:17:37.952386  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 119725us
I20260709 13:17:37.901530 14019 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:37.909924 14083 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:17:37.901262 13970 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:37.956259  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.869490 13931 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:37.972239  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.969362  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.974989  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:37.952224 14004 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:37.984318  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:37.981788 13608 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.737s	user 0.013s	sys 0.000s
W20260709 13:17:37.989629 14086 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:17:37.986320 14012 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:37.990624 14062 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.000s
I20260709 13:17:37.997565 14062 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:37.999840 14062 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:38.000128  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 519849us
I20260709 13:17:38.002027 13992 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:37.982223 13939 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.009174  8838 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:38.010623 14082 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:17:37.990891 13970 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:38.021739 13970 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.023147 14045 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:38.022858 13798 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.022749 14046 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.023551 14045 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:38.024418 14045 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.025055  8836 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:38.021737 13497 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.974231 13866 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.042979 13992 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.043540 13992 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.045737 13992 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.970475 14100 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:17:38.047761 13936 consensus_meta.cc:287] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.623s	user 0.007s	sys 0.004s
I20260709 13:17:38.048188 13936 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.050292 13936 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.058801 14029 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:37.975699 14090 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:38.061234  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2203) took 1393 ms. Trace:
I20260709 13:17:38.061697  8768 rpcz_store.cc:276] 0709 13:17:36.667700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.865137 (+197437us) service_pool.cc:224] Handling call
0709 13:17:36.865728 (+   591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.871035 (+  5307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:36.871292 (+   257us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:36.872079 (+   787us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.031142 (+159063us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:37.038520 (+  7378us) log.cc:844] Serialized 14 byte log entry
0709 13:17:37.038718 (+   198us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.038785 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.057031 (+1018246us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b1800410da0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:38.060939 (+  3908us) raft_consensus.cc:1685] finished
0709 13:17:38.061044 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.061176 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8076,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":191,"raft.run_cpu_time_us":510,"raft.run_wall_time_us":13694,"spinlock_wait_cycles":11254656,"thread_start_us":116693,"threads_started":1,"wal-append.queue_time_us":151692}
I20260709 13:17:38.064007 13932 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:38.064402  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:38.065181  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:38.065524  8836 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.067343 14090 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:38.068310 14090 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:37.944923 14002 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:38.031150  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.032198 13497 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:38.033218 14027 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:38.034162 13761 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:38.034963 13798 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:38.035269 14093 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:17:38.035681 14091 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.339s	user 0.003s	sys 0.000s
I20260709 13:17:38.035976 14035 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.041249 13906 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:37.994778 13883 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:37.994495 14098 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:37.978437 13921 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.064801  8768 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:38.076594  8762 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.076179  8836 raft_consensus.cc:2468] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:38.100328  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:38.104192  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75259.9us
I20260709 13:17:38.117306  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.077739 14094 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.971577 14068 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.079068 14004 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:38.122390  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:38.095070 13937 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:38.129964  9434 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:38.127077  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.128780  9461 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:38.132126  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 141571us
I20260709 13:17:38.114240  8766 raft_consensus.cc:2955] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 4 to 9, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:38.089711 13924 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:38.139186  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.139444  8768 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:17:38.134436 13889 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.002s
I20260709 13:17:38.139051 14089 raft_consensus.cc:2804] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:38.124823 14062 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:38.130548 14094 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.135764 13937 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.176206 14089 raft_consensus.cc:697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:38.185870 14089 consensus_queue.cc:237] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.189136 14061 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.191751 14061 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.194072 13937 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:38.125835 14098 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.198377 14098 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.182331 14004 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.204160 14019 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.206768 14019 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:38.208338  8765 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:17:38.212117  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 92821us
I20260709 13:17:38.212921  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.219098  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.220484  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.223371 13921 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:38.223174  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.178859 13798 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:38.222318 13927 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.166949 13975 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:17:38.234010  8807 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:38.218087 13937 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:17:38.246796  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 119107us
I20260709 13:17:38.248996  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:38.253600  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.254328  8841 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:38.255132  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.255411  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.256270  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:38.258754  8841 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:38.234362 13921 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:38.242674 13927 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:38.266552 13927 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:38.221035 13926 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:38.268739 13927 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.275414 14094 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:38.279206 13925 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:17:38.279712 13925 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.284973  8912 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:38.285642  8916 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:38.285846  8914 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:38.286761  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:38.288266  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:38.286939 13567 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:38.290863 13567 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.299036  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:38.309475  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:38.314090  8912 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:38.314491  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.315112  8918 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:38.316897  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.318145  8840 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:38.319403  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.319919  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.320515  8912 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:38.321478  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.325178  8918 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:38.327543  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:38.329077  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:38.336268 14102 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:17:38.311595 13716 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:38.346854  8761 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:38.348023  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:38.378254  8762 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:38.378854  8769 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:38.381925  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:38.384917  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.330755 14059 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:38.386489  8769 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:38.387360  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.389963  8763 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.391251  8840 raft_consensus.cc:1240] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:38.392145  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.393144  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:38.398684 14004 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:38.400442 14061 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:38.405597  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.341784 13535 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:38.408231  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:38.412142  8763 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:38.412590  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.408340 13716 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:38.381474 13567 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:38.414882  8764 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:38.331503 13992 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:17:38.459425 13992 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:38.459977 13992 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:38.475502  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.478366  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.479331  8844 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:17:38.484944  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 113499us
I20260709 13:17:38.416814 13535 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.405264 14062 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:17:38.494779 13535 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.407274 14059 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.507975 14119 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:38.519891 13573 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:17:38.574404 14122 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.574942 14122 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.577453 14122 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.577975 13906 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.578362 13906 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:38.594107  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2425) took 1182 ms. Trace:
I20260709 13:17:38.569442 13925 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.594574  8838 rpcz_store.cc:276] 0709 13:17:37.411592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.413972 (+  2380us) service_pool.cc:224] Handling call
0709 13:17:37.414244 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.009704 (+595460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.593884 (+584180us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54001e5d54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:38.594054 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1367713664}
W20260709 13:17:38.599897 14118 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:17:38.601431 14117 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:17:38.601915 14124 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:38.573124 14119 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:38.607167  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.607492 14119 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.608944 14119 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.483218 13992 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.613981 13992 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:38.614480 13895 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:38.615728 13932 consensus_queue.cc:1175] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" responder_term: 17 status { last_received { term: 17 index: 7 } last_committed_idx: 6 last_received_current_leader { term: 17 index: 7 } }
W20260709 13:17:38.620329 14078 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.909s	user 0.010s	sys 0.008s
I20260709 13:17:38.594363 13716 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.626540 14127 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:38.629426 14128 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.629853 14128 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:38.630911 14128 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.584470 14084 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.639149 14084 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.641613 14084 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.644243 14059 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:38.645967  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:38.671664  9468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 641) took 1574 ms. Trace:
I20260709 13:17:38.673084  9468 rpcz_store.cc:276] 0709 13:17:37.094838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.095011 (+   173us) service_pool.cc:224] Handling call
0709 13:17:37.095399 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.095740 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.095768 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.115445 (+ 19677us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.471513 (+356068us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:37.471564 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.471636 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.619621 (+1147985us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:38.667348 (+ 47727us) raft_consensus.cc:1685] finished
0709 13:17:38.667369 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.669571 (+  2202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":378,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":63182080,"thread_start_us":311567,"threads_started":1,"wal-append.queue_time_us":487468}
I20260709 13:17:38.579270 13906 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:38.676661  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 334372us
W20260709 13:17:38.698112 14110 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.517s	user 0.002s	sys 0.002s
I20260709 13:17:38.709633  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2224) took 1134 ms. Trace:
I20260709 13:17:38.712131  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.710088  8767 rpcz_store.cc:276] 0709 13:17:37.575080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.577669 (+  2589us) service_pool.cc:224] Handling call
0709 13:17:37.614180 (+ 36511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.614672 (+   492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.614712 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.621635 (+  6923us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.875875 (+254240us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:38.113837 (+237962us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.709303 (+595466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.709383 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.709423 (+    40us) raft_consensus.cc:1685] finished
0709 13:17:38.709434 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.709575 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":595007,"prepare.queue_time_us":68550,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2066,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6021,"thread_start_us":397785,"threads_started":2,"wal-append.queue_time_us":406186}
I20260709 13:17:38.716802  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2167) took 1339 ms. Trace:
W20260709 13:17:38.717514  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.717310  8765 rpcz_store.cc:276] 0709 13:17:37.377340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.377471 (+   131us) service_pool.cc:224] Handling call
0709 13:17:38.207900 (+830429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.209190 (+  1290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.716592 (+507402us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54001a8950. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd998ad 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:38.716743 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909111168}
I20260709 13:17:38.718729  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.682648 13906 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:38.724001  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 581161us
I20260709 13:17:38.725700  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.726085  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.727270  8764 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:38.727983  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2233) took 1088 ms. Trace:
I20260709 13:17:38.728482  8766 rpcz_store.cc:276] 0709 13:17:37.639638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.842003 (+202365us) service_pool.cc:224] Handling call
0709 13:17:37.842503 (+   500us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:37.843166 (+   663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.843198 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:37.901903 (+ 58705us) log.cc:844] Serialized 520 byte log entry
0709 13:17:38.076016 (+174113us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:38.175170 (+ 99154us) log.cc:844] Serialized 14 byte log entry
0709 13:17:38.697417 (+522247us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:38.724184 (+ 26767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:38.724292 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.724346 (+    54us) raft_consensus.cc:1685] finished
0709 13:17:38.727720 (+  3374us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.727907 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":548699,"raft.queue_time_us":1370,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"spinlock_wait_cycles":5429504,"thread_start_us":123450,"threads_started":1,"wal-append.queue_time_us":230970}
I20260709 13:17:38.733553 14094 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:38.734078  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.734993 14094 raft_consensus.cc:3055] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.735450 14094 raft_consensus.cc:740] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:38.736212 13895 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.736881 13895 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.739751  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:38.741709 14062 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:38.742022  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.743744  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.746166 13894 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.745896 13535 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.746582 13894 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:38.747016 13894 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.748261 13535 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:38.750196 14132 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:38.751773 14027 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:38.752233 13964 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:38.754153  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.753798  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:38.761516  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.764518  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.780665  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.724299 14121 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.753080 13990 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:38.782842  8837 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:38.683161 14029 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:17:38.716238 13931 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:38.733655 13925 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:38.722994 13883 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:38.790599  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:33996 (request call id 13) took 1167 ms. Trace:
I20260709 13:17:38.795876  8915 rpcz_store.cc:276] 0709 13:17:37.617710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.617832 (+   122us) service_pool.cc:224] Handling call
0709 13:17:38.785041 (+1167209us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540014c920. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd17520 00007fce6fd94652 00007fce74d6260a 00007fce6e2e87d4 00007fce6e2e8762 00007fce6e2e8691 00007fce6e2e860c 00007fce6e2e78c2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:38.785456 (+   415us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268663552}
W20260709 13:17:38.791868  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 270176us
I20260709 13:17:38.762255 14135 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:38.797487 14135 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:38.736348 14094 consensus_queue.cc:260] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:38.784263 13964 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.783560 14062 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.760192 13608 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:17:38.787400 13976 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.804235 13976 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:38.804322 14098 consensus_queue.cc:1059] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:38.805465 13976 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.805946 13883 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.807123 13976 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.800645  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:38.809479 14062 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:38.803176 13608 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.799799 14135 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.810245 13608 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:38.810631 14135 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:38.795483 13931 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.813123 14123 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:38.813673 14123 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.814436 13931 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.791625 14121 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.815953 14123 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:38.789335 13990 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:38.820262  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109437us
I20260709 13:17:38.825115  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:38.854794  8842 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:38.791924 14084 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:17:38.801712 13895 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:38.863888  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.864836  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.864288 13716 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.868294 14108 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.877441  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.878149  8910 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:38.879339  8918 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:38.880273  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:38.880908  8765 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.883236  8915 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:38.879487 13716 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.884987  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:38.886222  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:38.881505  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:38.868824 14097 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.890018 14097 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.890393 14097 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.894196 14119 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:38.894646 14119 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.894994 14119 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.898729 14094 raft_consensus.cc:3060] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.901772 13716 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:38.873169 14055 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.938961  8912 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:38.907917 13535 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:38.951632  8765 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:38.912328 13761 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:38.928791 14035 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.005645 14114 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:39.009258  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 244836us
I20260709 13:17:39.012666  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:39.027338  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:39.028954  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 248344us
I20260709 13:17:39.035677  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:38.928339 14002 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:17:38.909814 13990 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.981364 14139 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.063781  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:39.065167  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.078843 14139 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.082445 14139 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:39.086637 14133 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:17:39.027143 14035 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:39.089980 14136 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
W20260709 13:17:39.092334 14138 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:17:39.094384 14061 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:39.094975 14061 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:39.096844 14079 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 1.372s	user 0.006s	sys 0.004s
I20260709 13:17:39.101500 13895 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.102325 13895 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.105535  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:39.117534  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 79982.8us
I20260709 13:17:38.969894 14115 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:17:39.036834 13970 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:38.982913 13761 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:38.983765 13535 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.056135 14098 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.056810 13798 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.059051 13924 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:17:39.141237 13798 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.143311 13894 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.146034 14041 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.147662 13895 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.148730  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.154349 13535 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:39.155359  8835 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:39.156050 14098 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.158277 14098 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.159040  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.159746  8839 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:39.159863 13990 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.161039 13485 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:39.161417 13485 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:39.162206 13485 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.163506 13485 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.141212 14084 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.203658 14084 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.205845  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.206511  8764 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:17:39.207438  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:39.186434  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.191032 13895 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.191664 13761 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.192349 14098 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.192790 13894 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:39.201337  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.229197  8762 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:39.202993 14090 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:39.197870  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:39.208624  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.209633 13895 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:39.221710  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 96880.4us
I20260709 13:17:39.222312  8766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94e939be989f4d59b1983955951ab90f"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:17:39.262328  8766 raft_consensus.cc:606] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:39.262703  8766 raft_consensus.cc:614] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:39.235287  8762 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:39.239320  8764 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:39.241539  8761 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:39.244899  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2184) took 1137 ms. Trace:
I20260709 13:17:39.249948  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.250608  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.250926  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.255498 13922 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.257643 13937 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.259364  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:39.223011 14021 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:39.272115  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.266844  8915 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:39.264070  8768 rpcz_store.cc:276] 0709 13:17:38.107213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.140263 (+ 33050us) service_pool.cc:224] Handling call
0709 13:17:38.140672 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.723723 (+583051us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:38.882377 (+158654us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.058270 (+175893us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.107855 (+ 49585us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.108053 (+   198us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:39.108168 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.108266 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.244659 (+136393us) raft_consensus.cc:1685] finished
0709 13:17:39.244679 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.244819 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":582296,"prepare.queue_time_us":137838,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":6134,"raft.queue_time_us":592077,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":46284,"thread_start_us":320254,"threads_started":2,"wal-append.queue_time_us":357961}
I20260709 13:17:39.277072  8836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 608) took 1150 ms. Trace:
I20260709 13:17:39.286470  8836 rpcz_store.cc:276] 0709 13:17:38.127188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.127948 (+   760us) service_pool.cc:224] Handling call
0709 13:17:38.128343 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:38.194890 (+ 66547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.194927 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:38.194978 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:38.195013 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.276825 (+1081812us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b54004114d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:39.276893 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.277020 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152535808}
I20260709 13:17:39.277920  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:39.271502  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:39.279770  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.293728  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.294510  8916 raft_consensus.cc:2393] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:39.293018  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:39.286587 14119 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:39.279618  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 239674us
I20260709 13:17:39.311987  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.312793  8914 raft_consensus.cc:2393] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:39.276686 13976 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.234652 14098 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.290323 13921 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.317951  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.262599 14090 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.284974 13937 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.283912 13922 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.322687 13970 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.324749  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:39.366310 13970 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.367648 14143 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:39.368103 14143 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.368467 14143 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.340508  8769 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:39.319851 13761 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:39.371170  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50432.9us
W20260709 13:17:39.321295  8664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 181) took 25213 ms (client timeout 15000 ms). Trace:
I20260709 13:17:39.374898 14128 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.381122  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:39.388782  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 110963us
I20260709 13:17:39.389979  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:39.298947 14021 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.382251 13761 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.326251 13608 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:39.415745  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.357254 14084 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.376224 14027 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:39.304638 14119 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.435312  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.448791  8836 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:39.398967 14123 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.439239  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.459124  8764 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:39.459528  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:39.382778 14134 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:39.412611 13936 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:39.463708  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.322374 13976 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.458108  8918 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:39.438120  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.413780 14115 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.468997  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.424420 13608 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.466499  8838 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:39.378221 14097 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:39.459028 14094 consensus_meta.cc:287] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.004s
I20260709 13:17:39.475813  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:39.483601  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:39.538712  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 230202us
I20260709 13:17:39.430397 14060 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:17:39.543612  8765 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:39.474900 13608 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:39.542629 13883 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:39.475873 14115 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.543036 13894 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.570468  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.572268  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:39.573175  8836 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.580272  8838 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:39.581213  8767 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:39.634958  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 143405us
I20260709 13:17:39.636503  8734 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:39.678334  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:39.681851 14150 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:17:39.683911  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2246) took 1326 ms. Trace:
I20260709 13:17:39.684353  8760 rpcz_store.cc:276] 0709 13:17:38.357804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.360817 (+  3013us) service_pool.cc:224] Handling call
0709 13:17:38.361275 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.733569 (+372294us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:38.915476 (+181907us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.320093 (+404617us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.369315 (+ 49222us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.369500 (+   185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:39.369548 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.369652 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.683676 (+314024us) raft_consensus.cc:1685] finished
0709 13:17:39.683702 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.683844 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":428635,"prepare.queue_time_us":179335,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":432328,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":177,"thread_start_us":474015,"threads_started":2,"wal-append.queue_time_us":510808}
I20260709 13:17:39.685827 14060 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:39.686365 14060 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:39.689354 14153 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 13:17:39.691138 14151 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:17:39.693481 13937 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.687301 14060 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.700932 14060 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:39.711942 13761 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.563378 13883 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:39.722355  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 85985us
I20260709 13:17:39.724123  8842 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:39.725164  8840 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:39.563732 14002 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.448313  8661 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 9 to 10, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 10 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:39.742040  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 338129us
I20260709 13:17:39.727099 13883 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:39.596529 13894 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.742889 14090 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:39.752717 14094 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.760759 13937 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.736507 14002 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.782910  8661 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 13 to 14, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 14 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:39.784935  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.789039  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:39.768209 13866 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.770394 13761 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.789778  8912 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.773854 14021 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:39.377894  8664 rpcz_store.cc:269] 0709 13:17:14.099827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.125938 (+ 26111us) service_pool.cc:224] Handling call
0709 13:17:14.664593 (+538655us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:39.313272 (+24648679us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:32.615667 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:32.625777 (+ 10110us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:32.625851 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:17:32.625911 (+    60us) tablet.cc:662] Decoding operations
0709 13:17:32.629724 (+  3813us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:32.629829 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:32.630334 (+   505us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:17:32.632533 (+  2199us) tablet.cc:701] Row locks acquired
0709 13:17:32.632641 (+   108us) write_op.cc:260] PREPARE: finished
0709 13:17:32.632831 (+   190us) write_op.cc:270] Start()
0709 13:17:32.649126 (+ 16295us) write_op.cc:276] Timestamp: P: 1783603052632758 usec, L: 0
0709 13:17:32.657193 (+  8067us) op_driver.cc:348] REPLICATION: starting
0709 13:17:32.743773 (+ 86580us) log.cc:844] Serialized 6305 byte log entry
0709 13:17:33.585578 (+841805us) op_driver.cc:464] REPLICATION: finished
0709 13:17:33.798687 (+213109us) write_op.cc:301] APPLY: starting
0709 13:17:33.798792 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:33.822200 (+ 23408us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:33.822325 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:34.877568 (+1055243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:34.877915 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:17:34.877980 (+    65us) write_op.cc:312] APPLY: finished
0709 13:17:34.878413 (+   433us) log.cc:844] Serialized 148 byte log entry
0709 13:17:35.092148 (+213735us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:35.101185 (+  9037us) write_op.cc:454] Released schema lock
0709 13:17:35.126629 (+ 25444us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:35.225301 (+ 98672us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:35.233896 (+  8595us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":584694,"reported_tablets":54,"spinlock_wait_cycles":5234944,"child_traces":[["op",{"apply.queue_time_us":209340,"apply.run_cpu_time_us":48293,"apply.run_wall_time_us":1348059,"cfile_cache_hit":66,"cfile_cache_hit_bytes":70911,"num_ops":16,"prepare.queue_time_us":177053,"prepare.run_cpu_time_us":23675,"prepare.run_wall_time_us":283195,"raft.queue_time_us":234694,"raft.run_cpu_time_us":16451,"raft.run_wall_time_us":213893,"replication_time_us":895604,"thread_start_us":642921,"threads_started":5,"wal-append.queue_time_us":474452,"wal-append.run_cpu_time_us":11333,"wal-append.run_wall_time_us":2572052}]]}
I20260709 13:17:39.788641 13937 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.794426 14090 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:39.789084 14155 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 13:17:39.806180  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 265375us
I20260709 13:17:39.810177 13937 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.813657  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:39.801086 14121 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.799490 14097 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.823201  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.830873  8912 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:39.787750 14160 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:39.835465  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.836259  8912 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 7.
I20260709 13:17:39.800410 13866 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.838408  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.800817 13761 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.848138  8836 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:39.848417  8837 raft_consensus.cc:2393] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:39.855310 14094 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.864168 14094 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.866533 14094 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:39.867121  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.869671  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.870636  8766 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:39.839232 14154 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.814989 14090 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.886415  8912 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:39.847499 14097 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.847865 14163 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.899876 14097 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.900410 14163 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.903697 14154 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:39.906139 14154 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.905661  8661 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 11 to 12, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 12 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:39.907205 14154 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:39.907593 14154 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.907943 14154 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:39.909370 14163 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:39.915337 14128 consensus_meta.cc:287] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.001s
I20260709 13:17:39.916851  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:39.917567 14115 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.919620 13866 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:39.920663 13894 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:39.948549  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 172774us
I20260709 13:17:39.956141  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:39.921850 14002 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.923941  8762 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:39.841197 14143 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.937301 14012 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:39.883169 13925 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:39.960696 13925 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:39.961840 13925 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.963177 13925 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.889521 14021 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.965229 14021 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.968150 14021 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:39.880851 13895 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.970139  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:39.970997  8762 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:39.949745 14115 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.972545 14115 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.975240 14115 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.952286 14121 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:39.976539 14121 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:39.979465 14121 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:39.982968  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:39.921291 14163 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:39.998291  8909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2251) took 1132 ms. Trace:
I20260709 13:17:39.998781  8909 rpcz_store.cc:276] 0709 13:17:38.865698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.865882 (+   184us) service_pool.cc:224] Handling call
0709 13:17:38.904496 (+ 38614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.921171 (+ 16675us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:38.970337 (+ 49166us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.147824 (+177487us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b1800422980. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:39.419977 (+272153us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.882182 (+462205us) spinlock_profiling.cc:243] Waited 6.42 ms on lock 0x7b2c00125038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:17:39.882661 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.882828 (+   167us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:39.882866 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.882940 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.998061 (+115121us) raft_consensus.cc:1685] finished
0709 13:17:39.998082 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.998228 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183164,"prepare.queue_time_us":19352,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":138958,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":14089,"spinlock_wait_cycles":86221952,"thread_start_us":227328,"threads_started":1,"wal-append.queue_time_us":425867}
I20260709 13:17:40.005439  8913 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:40.012266  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:39.999094 14171 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:40.016352  8909 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:40.017853  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 78622.4us
I20260709 13:17:40.020277  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.021224  8916 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:40.023176  8916 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:40.025727  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:39.941514 13608 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.030751  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:39.940759 14061 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:40.063241  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51074.7us
I20260709 13:17:40.022276 14171 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.015187 14176 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.015072 14060 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:40.013455 14021 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.005716 14163 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.060755 14121 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:40.149749 14165 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:40.026367 14135 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:17:40.141595 13941 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:40.141337 13535 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:40.151508 14090 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.151732 14160 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.010258 14172 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:17:40.141388  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 58651us
I20260709 13:17:40.163707  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.167584 14060 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.162670 14171 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:40.153831 14059 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.009943  8661 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.173944 13941 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:40.208945  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.211094  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.214749  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.177111 14061 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.201962 13535 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:40.168084 14021 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.264782 14060 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:40.174853 14121 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.167820 14176 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.221632 13941 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:40.305879  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.245707 13894 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:40.314625  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2259) took 1435 ms. Trace:
I20260709 13:17:40.289574 14045 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.222070 14059 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.292474 13798 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:40.322867  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 212678us
W20260709 13:17:40.325227  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 158407us
I20260709 13:17:40.210338 14160 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.229470 13883 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.339780  8836 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:40.320794  8917 rpcz_store.cc:276] 0709 13:17:38.879252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.880218 (+   966us) service_pool.cc:224] Handling call
0709 13:17:38.880515 (+   297us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.009399 (+128884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.009440 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.009992 (+   552us) log.cc:844] Serialized 52 byte log entry
0709 13:17:39.376011 (+366019us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:39.422491 (+ 46480us) log.cc:844] Serialized 14 byte log entry
0709 13:17:39.435750 (+ 13259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.295367 (+859617us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54000fbc54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.295414 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.295467 (+    53us) raft_consensus.cc:1685] finished
0709 13:17:40.314382 (+ 18915us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.314557 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134937,"prepare.queue_time_us":34733,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":83372,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":46448,"spinlock_wait_cycles":165818112,"thread_start_us":302811,"threads_started":1,"wal-append.queue_time_us":496116}
I20260709 13:17:40.348453  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.357205  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:40.359011  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.367710  9459 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:40.379302  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.375495  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.381409  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:40.334391 13894 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.399003  8766 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2267) took 1133 ms. Trace:
I20260709 13:17:40.399477  8766 rpcz_store.cc:276] 0709 13:17:39.265874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.871292 (+605418us) service_pool.cc:224] Handling call
0709 13:17:39.871644 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.903371 (+ 31727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.903408 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.903459 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:39.903504 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.398750 (+495246us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b540003d754. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.398795 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.398930 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72370432}
I20260709 13:17:40.401741  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2253) took 1535 ms. Trace:
I20260709 13:17:40.402148  8911 rpcz_store.cc:276] 0709 13:17:38.866333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.867833 (+  1500us) service_pool.cc:224] Handling call
0709 13:17:38.868191 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:38.908351 (+ 40160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:38.908397 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:38.927686 (+ 19289us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.220552 (+292866us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:39.220609 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.401346 (+1180737us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b54002936d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.401396 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.401445 (+    49us) raft_consensus.cc:1685] finished
0709 13:17:40.401459 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.401683 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66786,"raft.queue_time_us":25881,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5672,"spinlock_wait_cycles":27322624,"thread_start_us":213084,"threads_started":1,"wal-append.queue_time_us":442433}
I20260709 13:17:40.363893 13608 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.395568 14060 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:40.383091 13567 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:40.381927 14027 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.380880 13922 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:40.395669 13976 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:40.418601 14174 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.418987 14169 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:40.418851 14175 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
W20260709 13:17:40.419106 14179 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 13:17:40.408761 14121 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.421841 14163 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:40.425038 13567 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.446084  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.404775 14154 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:40.461040  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 95475.1us
I20260709 13:17:40.364713 13535 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.427052 14188 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:17:40.443289 13976 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.454231 13567 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.437155 14174 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.441150 14169 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.440029 14027 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.502884 14059 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:40.453420  8661 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:40.524085  8661 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:40.507985 13883 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.508927 14021 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:40.530207 14176 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.546463  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.546973 14021 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:40.547722  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2259) took 1284 ms. Trace:
W20260709 13:17:40.546491  8835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 2333) took 1441 ms (client timeout 1645 ms). Trace:
I20260709 13:17:40.548187  8767 rpcz_store.cc:276] 0709 13:17:39.263652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.581982 (+318330us) service_pool.cc:224] Handling call
0709 13:17:39.582265 (+   283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:39.830227 (+247962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.830257 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:39.830833 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 13:17:40.016677 (+185844us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:40.304802 (+288125us) log.cc:844] Serialized 14 byte log entry
0709 13:17:40.305139 (+   337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.305223 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:40.547499 (+242276us) raft_consensus.cc:1685] finished
0709 13:17:40.547520 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.547663 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62344,"prepare.queue_time_us":348532,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":7309,"raft.queue_time_us":139546,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":34803,"thread_start_us":519068,"threads_started":3,"wal-append.queue_time_us":329254}
W20260709 13:17:40.549901 14194 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
W20260709 13:17:40.550740  8835 rpcz_store.cc:269] 0709 13:17:39.105099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.105257 (+   158us) service_pool.cc:224] Handling call
0709 13:17:40.513877 (+1408620us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b540021c854. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:40.546438 (+ 32561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112468864}
I20260709 13:17:40.552038  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.549599  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:40.552724  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.553567 14021 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:40.554004 14021 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.554188 13894 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:40.554436 14021 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.554481  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.555282  8915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 2286) took 1267 ms. Trace:
I20260709 13:17:40.555601  8915 rpcz_store.cc:276] 0709 13:17:39.287577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.516271 (+1228694us) service_pool.cc:224] Handling call
0709 13:17:40.555226 (+ 38955us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:40.483873 13976 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.558400 13976 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:40.559207  8913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42824 (request call id 2254) took 1682 ms (client timeout 2153 ms). Trace:
I20260709 13:17:40.559746 14097 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.560441 14097 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.560837  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:40.560920 14097 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.563699  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.564327  8767 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:40.564378 14098 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.565724 13761 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:40.568130  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.570927  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35822 (request call id 550) took 1322 ms. Trace:
I20260709 13:17:40.571352  8918 rpcz_store.cc:276] 0709 13:17:39.248560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.271216 (+ 22656us) service_pool.cc:224] Handling call
0709 13:17:40.570765 (+1299549us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540031a954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:40.570866 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389848320}
I20260709 13:17:40.573868 13866 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:40.574306 13866 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:40.574666 13866 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.576149 14174 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.552644 14169 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.579651 14035 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.580502  8765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2194) took 1547 ms. Trace:
I20260709 13:17:40.580904  8765 rpcz_store.cc:276] 0709 13:17:39.032899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.233810 (+200911us) service_pool.cc:224] Handling call
0709 13:17:39.234175 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.547081 (+312906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.580254 (+1033173us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b54002bfa54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.580445 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710854528}
I20260709 13:17:40.582777 13970 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.583348 13924 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.583896 13924 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.591562 14021 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.593911 14021 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:40.595075 14168 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.655s	user 0.003s	sys 0.003s
I20260709 13:17:40.595960  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:40.596282  8843 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:40.596616  8761 raft_consensus.cc:2376] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14. Re-sending same reply.
W20260709 13:17:40.556672 14182 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.206s	user 0.005s	sys 0.000s
I20260709 13:17:40.597462  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36492 (request call id 612) took 1816 ms. Trace:
I20260709 13:17:40.597844  8843 rpcz_store.cc:276] 0709 13:17:38.781369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.783238 (+  1869us) service_pool.cc:224] Handling call
0709 13:17:38.792271 (+  9033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.596657 (+1804386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.597253 (+   596us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540021c354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.597402 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4147989760}
I20260709 13:17:40.599184 14097 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:40.599218  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:40.600040  8761 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.602396 13573 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:40.602844 13573 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:40.603708 13573 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.608724 14185 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:40.608911  8761 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:40.618412  9468 raft_consensus.cc:2368] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18.
I20260709 13:17:40.609673 14185 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:40.582806 14143 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.621978 14185 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.623739 14185 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.606346  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.625319  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:40.610387 14186 log.cc:927] Time spent T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.264s	user 0.002s	sys 0.000s
I20260709 13:17:40.612496  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.614596  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 2460) took 1047 ms. Trace:
I20260709 13:17:40.626681  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.627316  8765 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:40.629462  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.630605  8767 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:40.631445  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.633035 14098 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.633648 14098 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.634892  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.635120  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:40.635823 14098 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.636389 14098 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:40.636467 14143 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.614384 14171 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.619555  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.619810  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.599439  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2267) took 1122 ms. Trace:
I20260709 13:17:40.637993  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.703239  8912 rpcz_store.cc:276] 0709 13:17:39.476957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.925796 (+448839us) service_pool.cc:224] Handling call
0709 13:17:39.938372 (+ 12576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.980643 (+ 42271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.980689 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.980749 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:39.980804 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.599219 (+618415us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b5400292cd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.599267 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.599388 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96468736}
I20260709 13:17:40.704438  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.688587  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.705178  8764 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:40.705248  8837 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:40.626999  8844 rpcz_store.cc:276] 0709 13:17:39.567277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.567391 (+   114us) service_pool.cc:224] Handling call
0709 13:17:40.613994 (+1046603us) spinlock_profiling.cc:243] Waited 870 us on lock 0x7b5800132f98. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc75eee 0000000000375939 00007fce74ce91e0 00007fce74db20c4 00007fce74db2131 00007fce74d73fc0 00007fce74d5e929 00007fce74d5e3d2 00007fce6e2d5bd4
0709 13:17:40.614122 (+   128us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.614265 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:40.614285 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:40.614324 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:40.614380 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.614440 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.614538 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000256}
I20260709 13:17:40.706255 14143 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.674225  8883 leader_election.cc:400] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18.
I20260709 13:17:40.706849  8883 leader_election.cc:403] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:40.707612 14199 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:40.709970 14171 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.639707  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.711311  8763 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:40.712612  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.648761  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:40.676339  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.714198  8841 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:40.714493  9462 raft_consensus.cc:2393] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 8: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:17:40.714838  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.639048 13941 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.632726  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.716163 13925 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.718017 14154 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:40.559641  8913 rpcz_store.cc:269] 0709 13:17:38.876677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.876796 (+   119us) service_pool.cc:224] Handling call
0709 13:17:40.559001 (+1682205us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540041ffd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:40.559120 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2417150336}
W20260709 13:17:40.687536  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.723028  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.695758  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2266) took 1430 ms. Trace:
W20260709 13:17:40.727380  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 53359.5us
I20260709 13:17:40.730746  8767 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:40.735872  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:40.765456  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.812852  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:40.814011  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.814630  8841 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:40.812449  8764 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.810820  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.765729  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.811408  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.768332  8912 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:40.825448  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.828420  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.831956  8910 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:40.834335  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.828895  8913 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:40.787876  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.840131  8836 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:40.841104  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:40.811757  8760 rpcz_store.cc:276] 0709 13:17:39.265609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.720698 (+455089us) service_pool.cc:224] Handling call
0709 13:17:39.721462 (+   764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.790234 (+ 68772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.790263 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.790305 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:39.790337 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.695330 (+904993us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b540025b054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:40.695402 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.695680 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157700992}
I20260709 13:17:40.877604  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.829563  8839 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:40.706756 14143 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.695562 14169 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.844424  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.816669  8844 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:17:40.722011 14199 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18.
I20260709 13:17:40.722168 14121 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.853837  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:40.858894  8840 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:40.636822 14098 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.859550  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:40.808890 14002 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.861123  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.812280 13924 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:40.864377  8764 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:40.874985 14019 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.702075 14027 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.715583 13567 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.904830  8760 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:40.905265  8760 pending_rounds.cc:85] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 6
I20260709 13:17:40.905061  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:40.905575  8760 pending_rounds.cc:107] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:40.879913 14160 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.842718 14128 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.880290  8836 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.882547  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.811239 13925 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.889943  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:40.899665 14012 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.886373  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.894937  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:40.895663  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.895591  8842 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.891709  8807 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:40.852236 14185 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:17:40.674958 13573 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.902374  8764 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:40.903499  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.923630  8840 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:40.899765 14097 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.903883 14199 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.927695  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.925652  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.895028 14169 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.906569 13970 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.901455 14002 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.906365 13761 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.901580 14146 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.939026  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.905931  8760 raft_consensus.cc:2889] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.890548  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:40.913906  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.901212 13895 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.932999  8763 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:40.905886  8837 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.818596  8808 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:40.930980 13990 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:40.899801 14121 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.897384 14098 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.915318 14132 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.914722 14027 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.915541 14021 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.940687 14035 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.954599 14021 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.955350 14035 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.692456  8661 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 10 to 11, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:40.960812  8918 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:40.958252 14121 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.959739 14132 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.964428 14002 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.951289 13895 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.939440 13883 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.923350 14060 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:40.933010 13937 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:40.949216 13894 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:40.932888 14199 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.906258 14019 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.927361 14105 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:40.937577 13970 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.931341 14012 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.965428 14132 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:40.960186 14027 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.943323 13761 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.966945 13941 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:40.968156 13925 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.933293 14097 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:40.937438 14169 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:40.956801 14021 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:40.946570  8842 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:40.916733 14128 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.980263  8837 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:40.989871  8836 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:40.994271  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.028460  8843 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
W20260709 13:17:40.948268 14166 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.963s	user 0.012s	sys 0.010s
I20260709 13:17:41.014030  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.030432  8835 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:41.015553  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:41.016834  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 86813.6us
I20260709 13:17:41.031767  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:41.017059  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 107356us
I20260709 13:17:40.973919 14115 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.024955  8915 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:40.944958 14146 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.025743  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.953173 13990 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.034014  8917 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.034662  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.040273  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.035256  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:41.038947  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 220463us
I20260709 13:17:41.040910  8911 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:41.028116  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:41.038843 14166 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.012s	sys 0.010s
I20260709 13:17:41.043624  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:40.991413 13937 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:41.047636  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:40.980353 13883 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:40.988332 14060 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.110873  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.027290 14121 raft_consensus.cc:2764] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:40.992146 13894 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.125223  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.126863  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.128893  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:41.129495  8765 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.128750  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:40.994850 14105 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:41.143476  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101390us
I20260709 13:17:41.145337  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.147090  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.119364  8909 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 18.
I20260709 13:17:41.036060 13976 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:41.053081 13941 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:41.151333  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:41.152453  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.047638 14061 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:17:41.169695  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.158838  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.155526  8764 raft_consensus.cc:1275] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:41.159742  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.172403  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.172695  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:41.151396  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 100093us
I20260709 13:17:41.174129  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.175334  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.176245  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:41.176573  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.176812  8766 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:41.044560 14115 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.176070  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:41.141924 14185 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:41.184666  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.185966  8765 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:41.195019  8760 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:41.173126  8764 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:17:41.196229  8765 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:41.196537  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:41.108275  8911 raft_consensus.cc:2468] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 8.
I20260709 13:17:41.149452 14171 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:41.150262 14215 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.149267 14157 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.183404 13895 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:41.191139  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 149649us
I20260709 13:17:41.152978 13941 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.158318 13567 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.198144 14169 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:40.997057  8661 catalog_manager.cc:5697] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 4 to 12, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:41.211645  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:41.159384 13976 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:41.254200 14219 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:41.263243 14019 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.255514  8661 catalog_manager.cc:5697] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 9 to 10, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 10 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:41.265329 14012 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.264894  8661 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 10 to 11, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 11 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.227579 13941 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:41.230439 13867 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:41.231546 13895 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:41.283290  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.209367 13937 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:41.280587 14204 log.cc:927] Time spent T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:17:41.239907  8766 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 18.
I20260709 13:17:41.274215 13867 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.268217 14213 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.298645  8761 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.272692 14199 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.301370  8911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:41.302250  8917 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:17:41.300557  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 127955us
I20260709 13:17:41.304203  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.305842  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.306310  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.306595  8917 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:41.308317  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.309199  8917 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:41.222434 14215 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.312799  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.282080 13990 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.286401 13970 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.319865  8912 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:41.284472 14222 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:41.319623  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:41.319234  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 166842us
I20260709 13:17:41.288807 14128 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.300014 13867 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.335188  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.325153  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.329289 14060 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:41.339629 14218 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:41.339561  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.340534 14060 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:41.300067 13894 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.302590 14027 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.341012 14060 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.341308  8912 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:41.351303  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.337829  8917 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.342866  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:41.330276 14212 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:41.286653 13925 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:41.337368  8761 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:41.313791 13895 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:41.356593  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:41.361779 13866 consensus_meta.cc:287] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.787s	user 0.005s	sys 0.008s
I20260709 13:17:41.364012 13883 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.364099 13866 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.365315 14215 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:41.366407 14221 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:41.366494 13866 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.367522  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.368707 14222 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:41.354480 14060 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.369752 14222 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.369948 14098 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.377503 13895 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:41.377947  8769 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:41.376698 14171 consensus_queue.cc:1048] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:41.379066  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.380659 14171 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.385015  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.385258  9432 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.385928 14098 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.385713 14143 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.386253  9432 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.386406  9464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.386762  8762 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:41.385318 14059 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.387598  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.387531 14059 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.388492  9461 raft_consensus.cc:2410] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:41.389328 13976 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.389927 14059 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.391053 14157 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.391244 13761 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.391822 14157 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:41.361752 14229 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:41.388523  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.392838  8911 raft_consensus.cc:606] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:41.395077  8911 raft_consensus.cc:614] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:41.348438  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.396183  8916 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.397094  8909 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:41.397948  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.396624  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.401795  9466 raft_consensus.cc:1240] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:41.404611  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.311787 14213 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.410135 14098 consensus_queue.cc:1059] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:41.410521 14134 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:41.411180 14171 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:17:41.411612 14134 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:41.412099 14213 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.412469 14090 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:41.400800 14224 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.413028 14090 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:41.413347 14224 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.412571 14134 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.414034 14090 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.347703 14233 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.415288 14090 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.415693 14224 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.361780 14105 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.411204 14098 raft_consensus.cc:3055] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:41.416455 13573 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:41.416590 14098 raft_consensus.cc:740] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:41.417065 13573 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.417479 13573 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:41.417670 14098 consensus_queue.cc:260] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.418946 14098 raft_consensus.cc:3060] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:41.405470  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.424530  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:41.427451  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 251425us
I20260709 13:17:41.424947  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.429188  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:41.429309  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.429944  8836 raft_consensus.cc:2368] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
I20260709 13:17:41.423368  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.425661  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.431241  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.431665  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:41.431679  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.430891  8835 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:41.434031  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.434706  8840 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:41.421427  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:41.437579  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.437966  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.438738  8762 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:17:41.443150  8917 raft_consensus.cc:2410] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:41.452337  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.453320  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.453692  8917 raft_consensus.cc:2410] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:17:41.454223  8843 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:41.456256  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.499825  8916 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:41.528524  8884 leader_election.cc:400] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
I20260709 13:17:41.529318  8884 leader_election.cc:403] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:17:41.532132  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75949.7us
I20260709 13:17:41.534224  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:41.537073 13895 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.537503 13895 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.537657 14232 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.537940 13895 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.538123 14232 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.538549 14232 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.536589  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.546909 13883 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:41.547614 14232 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.549382  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:41.410053 14154 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:17:41.437148 14210 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.564595  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.566784  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.568168  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.568506  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.569842  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.570528  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.449958 14121 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:41.587443  8835 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:41.572055  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.556478 14132 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:41.459188 14185 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:41.573582 14215 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.576735  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.609335  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:41.577930  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 344893us
I20260709 13:17:41.521253 13925 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:41.574723  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.580363  8735 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:41.585433  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.588165  8837 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:41.459553 14224 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.589912  8838 raft_consensus.cc:2410] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:17:41.590830  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.595448  8840 raft_consensus.cc:2393] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:41.459386 14061 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:17:41.605947  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:41.575939  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.577994 14229 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:41.624025  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.588212 14210 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.587582 14121 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.617471  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.618381  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.619179  8884 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:41.622100  8836 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:41.617702 13925 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.586406 13883 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:41.627219  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.629088 14035 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.630508 13895 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.635891  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.636809  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.639519 13894 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.616223 14185 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:41.651788 14210 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.645664  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.646279  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 2281) took 1028 ms. Trace:
I20260709 13:17:41.649922  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:41.653787  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.625288  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:41.682756  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.656294  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.656484  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.402808  8661 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 2 to 8, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 8 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.623293 13761 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:41.658762  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.623411 14134 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:41.663477  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46826.3us
W20260709 13:17:41.665295  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.665539  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.659348 13925 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:41.643412  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:41.676549  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58238.5us
I20260709 13:17:41.677596  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.697775  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.653469 14121 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:41.681793  8769 rpcz_store.cc:276] 0709 13:17:40.617533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.617695 (+   162us) service_pool.cc:224] Handling call
0709 13:17:41.646081 (+1028386us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400379954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:41.646219 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523938176}
I20260709 13:17:41.683982  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.678809 14035 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.681412  8912 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:41.686728  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:41.742298  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55639.4us
I20260709 13:17:41.743382  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:41.664047 14241 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:41.688656  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.688716  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.655109 13970 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.608341 14132 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.693097  8909 raft_consensus.cc:2410] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:41.698035 13761 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:41.756204 13761 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.757107 14059 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.757514 14059 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:41.757874 14059 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.761304 13970 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.762284 14045 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:41.762850 14045 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.765080 14189 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:41.765717 14189 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:41.766652 14189 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.710721  8884 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:41.769706  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59090.3us
I20260709 13:17:41.771095 14021 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.771565 14021 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.677826 14222 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:17:41.774731  8836 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:41.712980 14211 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.713367 14185 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.775722 13895 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.677485 14060 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.679486 14111 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.781117 14111 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.781678 14111 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.677883 13883 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:41.781872 14060 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.782701 13883 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.784039  8917 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:41.669219 13941 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.786074  8914 raft_consensus.cc:2368] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19.
W20260709 13:17:41.792284  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47565.4us
I20260709 13:17:41.717183 14115 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.718190  8661 catalog_manager.cc:5697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 5 to 11, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 11 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:41.681007 14143 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.694927 14228 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.685774 14061 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:41.811717 14061 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:41.813052 14061 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.814356 14061 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.813651  8661 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 5 to 7, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 7 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:41.722035 14197 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.863s	user 0.007s	sys 0.000s
I20260709 13:17:41.690788 14224 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.725780 14146 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.729312  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.691049 14134 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.694275 14019 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.845834 14019 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:41.846930 14019 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.739326  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:41.849121  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109862us
I20260709 13:17:41.850627 14228 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.850883  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.851351 14228 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.747748  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.749289  8840 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:41.750559  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.857928  8915 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:41.858069  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.751320 14012 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:41.747987 14236 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:41.793249  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:41.811271  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 122635us
I20260709 13:17:41.771903 14021 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.831960  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.831597  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.861616  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:41.861897  8910 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:41.814594 13573 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.835264 14232 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.838981 13925 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.841091 14097 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.840978 13941 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:41.843536  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.843679 14121 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.845197 14134 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.863054  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:41.864061  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 70886.3us
I20260709 13:17:41.782858 14035 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:41.822222 14224 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.817833 14135 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:41.866770 14115 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:41.880393  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:41.883630  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.877219  8909 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:41.895439  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.870921 14002 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.889699  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:41.890900  8842 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:41.891371  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.872687 14060 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.881371 14045 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:41.872202 13895 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.905105  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.906061  8843 raft_consensus.cc:2410] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:41.897046  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:41.901248  8839 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:41.890635 14097 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:41.901429  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.904206  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.892303  8914 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:41.892117 14224 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.884897 14222 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:41.912062  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:41.912582  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:41.936443  8913 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:41.921904  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.923249  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.938097  8764 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:41.924275  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.924207  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.899102 14002 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:41.928165  8763 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:41.929467  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:41.902505 14230 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:41.908128  9462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.004s	sys 0.029s
I20260709 13:17:41.937546  8767 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:41.902997 13970 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:41.904902 13895 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.952414  8765 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:41.903028 14060 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:41.954205  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:41.961484  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:41.962200  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:41.952373  9462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.005s	sys 0.029s
I20260709 13:17:41.967744  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:41.979916  8765 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:41.974005  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:41.898679 14135 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:41.937543 14045 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:42.000756 14045 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.926293 13924 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.993232 13867 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.638s	user 0.012s	sys 0.004s
I20260709 13:17:41.970937 14213 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.949638 14214 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.966280 14002 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:41.963583 14098 consensus_meta.cc:287] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.544s	user 0.014s	sys 0.000s
I20260709 13:17:42.005769  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.006218  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:41.965991 14230 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:42.020772  8839 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:42.020829  8836 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:42.007529  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:41.941447 14097 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:41.973301 14132 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.017525 14232 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:41.984598 13895 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.949808 14231 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:41.972308 13485 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.016839  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:41.984768 14060 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:42.025429  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75244.9us
I20260709 13:17:42.001233 14045 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.998138 13970 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.046677  9462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54308 (request call id 660) took 1105 ms. Trace:
W20260709 13:17:42.074966  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58216.9us
I20260709 13:17:42.081740  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:42.023646 14230 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.085907  9434 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:42.087679  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.088500  8836 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:17:42.025537 14255 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:42.093150  9431 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:42.095602 14098 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:42.096514  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.058162 14160 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.098237  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.098785  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:42.099051  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.082506  9462 rpcz_store.cc:276] 0709 13:17:40.941337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.941479 (+   142us) service_pool.cc:224] Handling call
0709 13:17:40.941755 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.941946 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:40.944307 (+  2361us) log.cc:844] Serialized 14 byte log entry
0709 13:17:41.395336 (+451029us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b1800454900. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a 00007fce6fda4a2a
0709 13:17:42.046057 (+650721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.046145 (+    88us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:42.046222 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.046389 (+   167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.046592 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14535,"prepare.queue_time_us":1277,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":17498,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":2835200,"thread_start_us":635721,"threads_started":2,"wal-append.queue_time_us":1054322}
I20260709 13:17:42.129366  8764 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:42.120322  8767 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:42.097371  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.014834 13924 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:42.136262 14246 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:17:42.137214 14248 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:17:42.090070 13970 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.127888 14171 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:42.141089  8763 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:42.014487 13867 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.021252 14214 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.076295 14229 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
W20260709 13:17:42.150458  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57418.2us
I20260709 13:17:42.090301 14234 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:42.121218 14255 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.128063 14132 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:42.131992 14223 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:42.151235 14027 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:42.154662 13761 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.125746 14232 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:17:42.151561 13573 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.164255 14222 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:42.077332 14231 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.170451 14234 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.191267 14035 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.154863 14210 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.177076 14223 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:42.174782 14255 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.171078 14260 raft_consensus.cc:2804] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:42.208264 14135 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.208787 13867 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.209185 14260 raft_consensus.cc:697] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:42.210430 14260 consensus_queue.cc:237] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.213965 13970 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.198972 14132 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:42.215750 14132 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.217562 13924 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.218233 14231 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.172851 14097 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.197924 14234 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.226687 14210 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.199994 14228 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.183979 14027 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.194553 14222 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.231573 14027 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.231879 14222 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.233901 14214 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.235700 14134 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:42.237499 14247 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:17:42.238196 14059 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.240212 13925 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.240494 14059 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.242381 14134 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.242501 14230 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.257685 14230 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.256690 14021 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.259449 13895 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.242569 13922 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:42.375511 13922 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:42.377902 13922 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.379618  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.314683  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:17:42.144600  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46017.7us
I20260709 13:17:42.334641  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.142352  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.337745  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.339946  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.340268  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.341446  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.344602  8912 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:42.348338  8913 raft_consensus.cc:2368] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15.
I20260709 13:17:42.355466  8918 raft_consensus.cc:2368] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:42.359758  8769 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:42.372445  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.373924  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.374282 13883 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:42.383353 13895 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.384361  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:42.391681  8767 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:42.380823 13922 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:42.396322  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:42.269661 14060 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.408838 14021 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.271473 14121 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:42.269769 14090 consensus_meta.cc:287] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.854s	user 0.018s	sys 0.002s
I20260709 13:17:42.280642 14045 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.418892  9459 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:42.281767 14234 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.423110 14234 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.399830 13883 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.401860 13970 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:42.428539  8909 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.429493 13970 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.432382 13970 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.410116 14154 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.433714 14154 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.398573 13716 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:17:42.405372  8732 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.515s (SENT) [suppressed 3 similar messages]
I20260709 13:17:42.277832 14255 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.271829 14224 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.266093 14223 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.393364  8768 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:42.398339  8763 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:42.441329 14223 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.266340 14111 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.419773  8837 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:42.429769 14060 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.442054 14255 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.446097  8916 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16.
I20260709 13:17:42.390615  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.405382  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:42.428537  8765 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:42.444705 14111 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.380447 14002 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.463274 14224 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.493669  8760 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 12: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:42.494552 13761 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.494607  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:42.508829 14275 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:42.513270  9461 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:17:42.513821  9461 pending_rounds.cc:85] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Aborting all ops after (but not including) 10
I20260709 13:17:42.513605  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:42.514252  9461 pending_rounds.cc:107] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:17:42.514724  9461 raft_consensus.cc:2889] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:42.516501 14045 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.504739 14154 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.521768 13970 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:42.525017 13970 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.527712 13970 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.528381 13573 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:42.520355 13883 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.539611 14045 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:42.540551 14045 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:42.541347  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47126.7us
I20260709 13:17:42.542428  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:42.548447 14045 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.548748 14134 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:42.550403 14134 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:42.551756 14134 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 17.7, Last appended by leader: 7, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:42.507061  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 101727us
I20260709 13:17:42.565196  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:42.567203 14045 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:42.566411  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:42.568483  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.567761 14045 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:42.569178  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.569482 14045 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.570138  8843 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:42.576134  8840 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:42.579366  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44511.6us
I20260709 13:17:42.585345 13761 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.586174 13761 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.593758 14157 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:42.602991  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.603928  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.604769  8836 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.609499  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.610291  8838 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.582324 13970 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:42.611104 13883 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:42.611469 13883 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:42.613816  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.618688  8844 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.620991  8837 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:42.625615 14160 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:42.625514  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.626825  8843 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.627449 13970 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:42.626291 14160 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:42.628543 13970 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.639998  8913 raft_consensus.cc:1240] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:42.640173  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.640666  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.641037  8918 raft_consensus.cc:2368] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:42.642285  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:42.643239  8912 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:42.632824 14160 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.645008 14160 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.651736  8761 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:42.645295  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.655455 14090 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:42.670374  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:42.671618  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.672665  8837 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:42.673777 13883 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.675468 13883 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.676620  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.677577  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:42.679209  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.672550  8916 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:42.682649  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.683686  8912 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 18: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:42.694741  8838 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:42.696027  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.699270  8836 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:42.702387  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.698858  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:42.705605  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:42.706408  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.706624  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.706990  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.707289  8918 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:42.707705  8915 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.710012  8836 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:42.713780  8916 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:42.717483  8912 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 12: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:42.716550 14045 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.733661  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.736611  8915 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:42.727197 13761 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.737349  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.740760  8840 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.744360  8761 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:42.750576  8913 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:42.752609  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:42.743659 14002 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:42.754513  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.755198  8836 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:42.754902  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:42.759963  8768 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:17:42.762384  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.764721  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.763751  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:42.764302  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.765635  8915 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:42.765627  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:42.756817 13970 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.756604 14275 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:17:42.768113 13866 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:42.771880  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.776705  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:42.772964  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.775390 14045 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.772619 13573 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:42.789726  8844 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:42.788555 13573 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:42.792779 13573 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.794354 13573 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.805713  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.805140  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.807124  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.808030  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.808888  8761 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:42.818418  8844 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:42.820052  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:42.821774  8761 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:42.821900  8768 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:42.824335  9466 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:42.824280  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.825309  8840 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:42.829660  8763 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.830066  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:42.828047 13485 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:17:42.831969 14045 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.831717 14134 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:42.832537  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.832505 13485 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:42.844259 13485 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:42.845512 13485 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.847209 13485 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.847445  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.848453  8766 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:42.850263  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.852342  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.854077  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.856437  8765 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:17:42.856560 13866 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.840189 14279 log.cc:927] Time spent T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:17:42.843019  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.832516 14045 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:42.862598 14045 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.864420  8766 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:42.857379 13866 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.862636  8765 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:42.865113  8769 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:42.866832 14282 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:17:42.872097  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:42.873443  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.876686  8765 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:42.880110  8769 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:42.882047  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.884142  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.885025  8768 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:42.891150 14270 consensus_queue.cc:1059] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:42.873443  8843 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:42.892709 14284 raft_consensus.cc:3055] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:42.897527 14284 raft_consensus.cc:740] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:42.897429 13866 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:42.898756 14284 consensus_queue.cc:260] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:42.899857 14284 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.899785  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:42.900681  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.901436  8765 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:42.909440  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.912846  8844 raft_consensus.cc:1240] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:42.913342  8769 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.893376  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:42.917722  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 79365.7us
I20260709 13:17:42.919100 14211 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:42.919835 14211 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:42.921103 14211 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.916729  8762 raft_consensus.cc:2410] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:17:42.924448 14275 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.925189 14275 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.927706 14275 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.928386 14275 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.928994 14275 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:42.938144  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.911638  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:42.925792  8884 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:42.949954  8763 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:42.957952  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:42.960767  8768 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:42.963296  8840 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:42.963891  8765 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:42.972456  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:42.975140  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50783.8us
I20260709 13:17:42.949483 14275 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:42.985811  8884 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:42.988704  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:42.990072 14275 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:42.991175  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:42.994328 14060 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.994989 14060 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:42.996009 14060 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:42.997110  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 85607.1us
I20260709 13:17:42.997028 13535 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:17:42.998148 13716 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.998355  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:42.999403 13922 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.981643 13867 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.962896 14280 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:43.007089  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.008657  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:43.011216  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.000619  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:43.022926  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:43.025043  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:43.026093  8765 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:43.027441  8768 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:43.021775 13922 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:43.028023  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.028415 13922 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:43.029075 13922 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.046609 13970 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:43.020582 13867 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:43.047389 13922 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.065295 13922 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:43.066654  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:43.090528  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 90004.3us
W20260709 13:17:43.099756  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 88637.4us
W20260709 13:17:43.118443  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 129884us
I20260709 13:17:43.130590  8840 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:43.138139  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:43.139384  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:43.166227  8769 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:43.163527  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.122035 13867 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.173019  8844 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:43.182659  8835 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 13:17:43.175673 13970 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:43.174582 14275 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:43.166399 14270 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
W20260709 13:17:43.193509  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:43.193894  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.193944 14275 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:43.196890  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 212510us
W20260709 13:17:43.201968  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76679.9us
I20260709 13:17:43.226217  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.214120 13922 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:17:43.251844  8807 leader_election.cc:400] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15.
I20260709 13:17:43.252398  8807 leader_election.cc:403] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.237497 13970 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:43.241370 14111 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:43.263927 13922 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15.
W20260709 13:17:43.273166  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 59151.5us
W20260709 13:17:43.277081  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58210.5us
I20260709 13:17:43.278215  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:43.290781  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 64600.5us
I20260709 13:17:43.296547 14280 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:43.297135 14280 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:43.297400 14292 log.cc:927] Time spent T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.072s	user 0.001s	sys 0.001s
I20260709 13:17:43.298267 14280 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.299741 14280 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.291286 13970 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:17:43.315737 14290 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.115s	user 0.001s	sys 0.001s
I20260709 13:17:43.305171 14294 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:17:43.328347 14002 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:43.330451  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52423.9us
I20260709 13:17:43.334067  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:43.336925  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.320255 13883 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:43.347911 13485 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.500s	user 0.014s	sys 0.002s
I20260709 13:17:43.343277  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.350453 14211 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:43.352588 14166 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:43.353181 14166 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:43.354562 14166 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.356433 14166 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.356990 13922 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:43.357447 14211 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.341435 13866 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:43.362849 14211 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:43.363063 13866 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:43.363993 13866 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.364647  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:43.365324 13866 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.366015  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:43.373868 13970 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:43.375833  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.376504 14111 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.377265  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:43.380517  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.349349 13883 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.386871 13485 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.392426 13970 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.398700  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:43.395180 13883 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:43.403828  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:43.392654 14303 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:43.408135 14297 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:17:43.408710  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:43.418769 14300 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.090s	user 0.004s	sys 0.000s
I20260709 13:17:43.424691 14002 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:43.425374 14002 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:43.425406  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.426270 14002 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.427451  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.431247 13573 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:43.440282  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:43.440680 13970 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.441450 13970 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.444005  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.446722  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.448446  8915 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
W20260709 13:17:43.449880 14301 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:43.423405  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:43.458891 13867 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:43.459708 14211 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:43.458796  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:43.461259  8913 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:43.461799  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.467321  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:43.468175 14002 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.468595 14303 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:43.468674 14002 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.476305  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:43.481779 14002 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:43.482249  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:43.482182  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:43.485805 13761 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:43.486306 13761 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.486697 13761 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.482308 13970 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.493544 14303 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:43.500564  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 73247.9us
W20260709 13:17:43.503295  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 56639.4us
I20260709 13:17:43.489269 14275 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:43.506098  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.496769 13883 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:43.522385  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:43.527870 14307 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:17:43.505836 13970 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:17:43.542338  9465 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:43.543485 14134 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.550240  8913 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
W20260709 13:17:43.551281  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 63345.7us
I20260709 13:17:43.520279 14275 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:43.544034 14002 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:17:43.495679 14303 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.562489  8838 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:43.564702  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.551932 13883 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:43.573722  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67788.3us
I20260709 13:17:43.574705  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.576217  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:43.576742  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.577771 13883 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.577559 13761 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.578508 13883 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.564428  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.560878 14275 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:43.585772  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:43.593058  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53675us
I20260709 13:17:43.593132 14021 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:17:43.607879  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:43.607995  8917 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:43.637221 13761 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:43.637831  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.638126 13761 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:43.638705 13883 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:43.639362  8732 leader_election.cc:400] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19.
I20260709 13:17:43.638578 13761 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.639930  8732 leader_election.cc:403] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:43.640241  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:43.640506 14313 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.643620 13883 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19.
W20260709 13:17:43.609967  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45851.4us
I20260709 13:17:43.648515  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:43.627041  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:43.647608  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:43.650077  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:43.655944  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.640211 13761 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.661522 14313 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:43.661130 14291 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:43.668936  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:43.681041  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:43.683108  8843 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:43.666851 13970 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:43.686570 13970 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:43.656666 14002 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:43.656900 13922 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:43.705971  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79044.6us
I20260709 13:17:43.654855 13883 consensus_queue.cc:1059] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:17:43.687273 13970 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.670591 14313 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:43.680624 14275 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.695222 13922 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.737703 14319 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:43.738261 14319 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:43.739142 14319 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.740779  8912 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:43.724579 13970 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.741551 14211 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:43.743716 13970 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:43.743248  8662 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.747378 14275 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:43.695086 13485 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:43.724973 14060 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:17:43.723546 14313 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:43.731367 13922 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:43.758298  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:43.758829  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89232.9us
I20260709 13:17:43.767581  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.768508 14134 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.770084  8662 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.771751  8662 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:43.773481  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:43.782181  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.791332  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:43.796196  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.807579 13970 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.809079  8662 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 15, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:43.762616 14045 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.824671  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:43.827492  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:43.795112 14319 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:43.812847 14166 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.812557 14134 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:43.844357  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:43.845158  8761 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 19 index: 8. (index mismatch)
I20260709 13:17:43.845094  8769 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:43.848320  8909 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:17:43.848776  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:43.850277  8768 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:43.857957  8767 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:43.859738  8764 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:43.861266  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:43.862185  8760 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:43.863694  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:43.864954 14262 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.846139 13970 raft_consensus.cc:2764] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:17:43.865612 14262 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.868222 14262 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:43.864686  8766 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:43.849315  8765 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:43.877388  8913 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:17:43.880759  8916 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:43.840127 14002 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:43.847792 14166 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.895539 14323 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:43.897022 13922 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.836094 14045 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.905871 13761 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.889315  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:43.917693  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:43.925271 14045 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:43.925992  8843 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:43.870795 14311 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:17:43.929080  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:43.934723  8836 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:43.928650 13761 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:43.937950  8769 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:43.928247 14313 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.896384 14323 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:43.941316  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 138173us
I20260709 13:17:43.942442  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:43.945509  8843 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:43.948380  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:43.952427 14327 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:43.959573 14327 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:43.953529 14002 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:43.933763 13970 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:43.969082 13970 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:43.974980 13970 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:43.968700 14311 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.976693 14311 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:43.978945 14311 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:43.982327  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.989672  8769 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:17:43.989723  8844 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:44.026283  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43781.5us
I20260709 13:17:43.997818 14329 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:44.012833 14323 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.035418 14166 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:43.986855 14270 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
W20260709 13:17:44.040299  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52552.7us
I20260709 13:17:44.043910  8842 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:44.025372 13883 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
W20260709 13:17:44.049890  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.053499  8732 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16.
I20260709 13:17:44.054023  8732 leader_election.cc:403] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:44.059090  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 95916.9us
W20260709 13:17:44.060222  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82181.5us
I20260709 13:17:44.067245  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.056808 14166 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.068004  8844 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:44.076049  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:44.021728 14327 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.098680  8844 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:44.077657 13883 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16.
W20260709 13:17:44.108659  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 63287.1us
I20260709 13:17:44.121867 14327 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.117403  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.079229 14166 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:44.160643  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 132885us
I20260709 13:17:44.161883  8732 leader_election.cc:400] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:44.162268  8732 leader_election.cc:403] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:44.164469  8762 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:44.164902  8762 pending_rounds.cc:85] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 7
I20260709 13:17:44.165138  8762 pending_rounds.cc:107] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:44.165359  8762 raft_consensus.cc:2889] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.144605 14313 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.118872 14111 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:44.184175 14270 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:44.188268 14319 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:44.188576 14270 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.189131 14270 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.200742 14270 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.202907 14166 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.205966  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:44.206576  8844 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.214389  8844 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:44.216148  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.217392 14339 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:44.217964 14339 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:44.218847 14339 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:44.221766  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 76810.6us
I20260709 13:17:44.222997  8732 leader_election.cc:400] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:44.223771 14270 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:44.224264  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:44.237090  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.265434  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.267510  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 180836us
I20260709 13:17:44.269769 14319 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:44.296765  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:44.299567  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75428.4us
W20260709 13:17:44.323318  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.296007 14334 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:44.334632  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:44.343358  8769 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:44.345259 14350 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.350507 14350 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.324662 14060 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.353339 14060 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.353718  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.354607  8767 raft_consensus.cc:2410] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:17:44.355628 14060 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:44.363602  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:44.355958 14343 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:17:44.368278  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 99148.5us
I20260709 13:17:44.368927 14334 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:44.369154 13883 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:44.376400 13883 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.378857 13883 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.379645 13883 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:44.384425  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 87758.2us
W20260709 13:17:44.370146  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47292.2us
I20260709 13:17:44.311508 14319 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.387533 14322 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:44.387989 14322 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:44.388571 14319 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:44.389308  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.388934 14322 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.389707  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.390136 14322 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.390576 14334 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.393784 14334 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:44.394733  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.395447  8844 raft_consensus.cc:2368] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:44.374428  8842 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:17:44.403204  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:44.404829 14111 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:44.405349 14111 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:44.405058 14275 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:44.405777 14111 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.383937 14060 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.383751 14262 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:17:44.412937  8842 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:17:44.408427 14060 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.415880 14060 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:44.417200  8662 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 11 to 13, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 13 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.403051 14346 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:44.404855  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:44.424014  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.358314 14350 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.430930  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:44.432173  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:44.433164  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:44.435896  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:44.430848 14262 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:17:44.435112 13866 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:17:44.431445 14060 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:44.438344 13867 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.443543 13867 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.439057 13970 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.445796 13867 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:44.446400 13867 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:44.447185 13970 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.432617 14211 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:44.448987 14342 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:44.449934 14351 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:44.450639 14060 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:44.451107 14060 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.453009 13922 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.459789  8915 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:44.460969  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.461695  8912 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:44.463665  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:44.464288  8910 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.447185 13867 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:44.465317 13867 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:44.466320  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:44.466902  8842 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:44.468078  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.459661  8909 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:44.469362  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:44.440474  8662 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:44.441393 14134 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.481355  8735 leader_election.cc:400] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:44.481761  8735 leader_election.cc:403] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:44.489005  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53215.2us
I20260709 13:17:44.490319  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:44.490962  8661 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 222) took 28001 ms (client timeout 15000 ms). Trace:
I20260709 13:17:44.492396  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.496099 14060 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.505594  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.505471  8842 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:17:44.508467 14352 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:44.508998 14352 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.509351 14352 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:44.480635 14351 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:44.524748  8914 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:44.525172 14060 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:44.519971 14331 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.352s	user 0.005s	sys 0.000s
I20260709 13:17:44.520615 14350 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:44.529718 14358 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.532016 14351 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:44.483711 13761 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:44.442090 14275 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:17:44.535775  8910 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:44.535775  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:44.543689  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 53448.3us
I20260709 13:17:44.544557  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:44.529418 14111 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:44.552223  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.555464  8913 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:44.575664  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 127897us
I20260709 13:17:44.534521 13867 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.575470 14270 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.576886 14322 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.591487  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.592780 14350 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:44.575273 14351 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.593389 14350 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:44.594276 14350 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.593053 14327 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:44.599113 14342 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:44.599685 14342 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:44.602270 13970 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:44.576402 13761 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:44.581851 14275 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.605486  8843 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:44.609645  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:44.603822 13867 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.621650 13761 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:44.641795  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.671345  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.672087  8843 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
W20260709 13:17:44.681344  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 71783.4us
I20260709 13:17:44.588514 13485 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:17:44.686143  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:44.695724 14262 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:44.583142 14344 consensus_queue.cc:1175] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3b34c95a175945b88b17f07fbc650abf" responder_term: 14 status { last_received { term: 14 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 14 index: 11 } }
I20260709 13:17:44.618402 14275 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.704737  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:44.491495  8661 rpcz_store.cc:269] 0709 13:17:16.411859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.416219 (+  4360us) service_pool.cc:224] Handling call
0709 13:17:44.412760 (+27996541us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:42.585551 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:42.586486 (+   935us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:42.586561 (+    75us) write_op.cc:435] Acquired schema lock
0709 13:17:42.586602 (+    41us) tablet.cc:662] Decoding operations
0709 13:17:42.587928 (+  1326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:42.588014 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:42.588053 (+    39us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:42.622750 (+ 34697us) tablet.cc:701] Row locks acquired
0709 13:17:42.622809 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:17:42.623040 (+   231us) write_op.cc:270] Start()
0709 13:17:42.623235 (+   195us) write_op.cc:276] Timestamp: P: 1783603062622961 usec, L: 0
0709 13:17:42.623291 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:17:42.624427 (+  1136us) log.cc:844] Serialized 5159 byte log entry
0709 13:17:43.036209 (+411782us) op_driver.cc:464] REPLICATION: finished
0709 13:17:43.225678 (+189469us) write_op.cc:301] APPLY: starting
0709 13:17:43.235492 (+  9814us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:43.395330 (+159838us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:43.398789 (+  3459us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:43.511129 (+112340us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:43.511528 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:17:43.511598 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:43.512053 (+   455us) log.cc:844] Serialized 121 byte log entry
0709 13:17:43.512262 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.512419 (+   157us) write_op.cc:454] Released schema lock
0709 13:17:43.512489 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:43.520552 (+  8063us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:43.520588 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3536,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":183494,"apply.run_cpu_time_us":23000,"apply.run_wall_time_us":298865,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":215782,"prepare.run_cpu_time_us":20342,"prepare.run_wall_time_us":161504,"raft.queue_time_us":175396,"raft.run_cpu_time_us":27313,"raft.run_wall_time_us":147567,"replication_time_us":412596,"thread_start_us":408045,"threads_started":4,"wal-append.queue_time_us":143817}]]}
I20260709 13:17:44.705896 14275 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:44.683817 14294 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:44.707299 14322 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:44.707887 14322 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.710023 14322 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.711827  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.712044  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.712507  8843 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:44.715101  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.716069 14322 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:44.717842 14358 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14.
I20260709 13:17:44.716528 14322 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:44.719740 14322 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.718796  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.724529  8765 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:44.602924 13970 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.725704 14339 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:44.727093 13937 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:17:44.729036  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.733989  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.734565  8768 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:44.737035 14045 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:44.739542  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.746372 13970 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.607466 14270 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.749019 14270 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.750103  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.753377  9466 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:44.754984 14342 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.755626 14002 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:17:44.760406  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 74327.9us
I20260709 13:17:44.763623 14111 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:44.765422  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.766955  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.772531  8768 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:44.773531  8764 raft_consensus.cc:1275] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:17:44.774847  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.775508  8766 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:44.776336  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:44.777514  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.775056  8764 pending_rounds.cc:85] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 8
I20260709 13:17:44.778987  8764 pending_rounds.cc:107] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:17:44.779277  8764 raft_consensus.cc:2889] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.780148  8843 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:17:44.781628  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.783898  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.785177  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.787163 14342 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:44.774670 14358 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:44.786931  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.788127  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:44.789465 14319 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.789988 14319 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.791405  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.792079  8761 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:44.788101 14358 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:44.798655 14358 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:44.805826  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:44.806581 14352 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.809401 14352 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.810693  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.788329  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.811501  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:44.827369  8835 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:44.827940  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:44.829663 13970 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:44.806102 14319 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:44.811569  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:44.765424 13761 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:44.841817  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.845708  8761 raft_consensus.cc:2410] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:44.854496  8913 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:44.859292  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.862287  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.863811  8910 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:44.864765  8766 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:44.865907  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.868367  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.884065  8768 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:44.869943  8913 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
I20260709 13:17:44.869987  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:44.861392  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.872551  8761 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:44.872782  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.873176  8835 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:17:44.899351  8761 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:44.887821  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:44.885609  8917 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:44.906023  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.907876  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.910853  8766 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:44.912578  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.913436  8761 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:44.913795  8766 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:44.914657  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.915233  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.916564  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:44.919442  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.909943 14327 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:44.915934  8916 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:44.867533 14270 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:17:44.911152 14352 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:44.921495  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:44.924894  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.870862 14332 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:17:44.920197  8761 raft_consensus.cc:2376] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15. Re-sending same reply.
I20260709 13:17:44.911798 14045 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:44.951615  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:44.922401 14327 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:44.952461  8761 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:44.927717  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:44.955158  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.955380  8835 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:44.956159  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.956982  8768 raft_consensus.cc:2368] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
I20260709 13:17:44.965492  8766 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:44.951257 14333 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:44.949369 14352 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:44.969477  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:44.972173  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.973059  8768 raft_consensus.cc:2376] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18. Re-sending same reply.
I20260709 13:17:44.972191  8760 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:44.959244 14327 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.971474  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:44.976739  8914 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:44.988742  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:44.989920  8766 raft_consensus.cc:2376] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16. Re-sending same reply.
I20260709 13:17:44.990273  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:44.954464 14002 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:44.993203  8917 raft_consensus.cc:2410] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:17:44.995922 14352 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:44.979044 14333 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:45.013842 14333 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.018209  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:45.019222  8916 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:45.020278  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:45.021342  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:45.022209  8912 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:45.022794  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:45.022254  8909 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 14.
I20260709 13:17:45.023478  8916 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:17:45.026153  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:45.026777  8761 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:17:45.030819  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48560.8us
I20260709 13:17:45.041153  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:45.043797  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:45.046439  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:45.047300  8914 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:17:45.063372  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:45.064322  8761 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.066242  8766 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:17:45.023773 13970 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:45.075537  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:45.076586  8766 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:45.102918  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:45.062100  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 119585us
I20260709 13:17:45.065934 14262 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.124146  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:45.125010 14270 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.125535 14270 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.125917 14270 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.126003 14329 consensus_queue.cc:1048] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:45.137305  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.156145 14270 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:45.160607 14313 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:45.161820  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:45.166630 14371 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:45.176352 14327 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.183467  8836 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:45.184207  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 48499.6us
W20260709 13:17:45.186347  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 82032.3us
I20260709 13:17:45.192123  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.197788  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:45.152496 14339 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.144608 14334 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:45.085736 13970 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.101430 14322 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.209550  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.211210  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.142526 14045 consensus_queue.cc:1059] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:17:45.142390 14262 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.205442 14351 raft_consensus.cc:2764] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:17:45.232118  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70414.3us
I20260709 13:17:45.233148  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.234642  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.237376 14361 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:45.223953 14021 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:45.216971 14353 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:45.244469 13970 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.249900 14327 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.250639 14327 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:45.251171 14327 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.253958 14322 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.255756  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:45.256263 14270 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.259166 14262 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:45.214222 14334 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.264024 14334 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.264405  8844 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:45.267189 13937 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:45.273114 13937 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:45.274078 13937 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.269295 14002 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:45.249786  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.272795  8761 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:45.285486  8762 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:45.276022  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:45.279112  8843 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:45.278560  8735 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:45.275354 13937 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.299490  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:45.240682 14351 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:45.331673  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 81956.2us
I20260709 13:17:45.332569  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.299749 14319 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:45.299602 14334 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:45.338570  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 175242us
I20260709 13:17:45.301927 14322 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:45.368119 14334 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.371769 14334 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.367229 14351 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.374037 14351 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.376441 14351 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.378659  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:45.379276  8765 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.380285  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:45.328120 14380 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:45.383170  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:45.384727  8844 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:45.339383 14361 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.385877  8836 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:45.327543 13970 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:45.395124 14393 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:45.396106 14393 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:45.396720 14393 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.397740 14386 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.398808 14386 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:45.395149  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 184043us
I20260709 13:17:45.404565  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.377213 14327 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:45.384166 14322 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:45.415409  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.429044  8761 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 13:17:45.432657  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 240099us
I20260709 13:17:45.425321  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:45.426244  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 209711us
I20260709 13:17:45.439394  8765 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:45.440526  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:45.411366 14380 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:45.449268  9432 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:45.445809  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:45.462625  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:45.426863 14351 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:45.446692 14361 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:45.446910 14319 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.469672  8882 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:45.424417 14327 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:17:45.474483 14351 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:45.507215 14132 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:17:45.508436 14345 raft_consensus.cc:2804] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:45.509043 14345 raft_consensus.cc:697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 15 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:45.510321 14386 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:45.509927 14345 consensus_queue.cc:237] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:45.514398 14332 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:45.514967 14332 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:45.515818 14332 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.471254 14361 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.521286 14361 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.475196 14319 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.525478 14339 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:45.525818 14319 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.525679 14313 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:45.527597 14322 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.527706 14313 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:45.530840  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61268.1us
W20260709 13:17:45.531042  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68554.1us
I20260709 13:17:45.531531  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:45.533391 14359 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:45.533787 14359 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.534096 14359 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.534365 14364 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:45.534889 14364 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:45.535735 14364 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.537070 14275 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.473658 14060 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:45.537474 14275 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.537810 14060 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.537961 14275 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.538306 14060 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:45.541508 14387 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:45.541937 14387 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:45.542791 14387 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.544225 14387 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:45.471266 14380 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:17:45.458905 14045 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:17:45.546054  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:45.530440 14313 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:45.559062  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 175188us
I20260709 13:17:45.561573  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:45.564731  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 149375us
I20260709 13:17:45.565546  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.555169 14332 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:45.575738  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.576509  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:45.557042 14355 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:45.549361 14166 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 13:17:45.592801  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 143628us
I20260709 13:17:45.597100  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:45.571656 14313 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:45.576627 14380 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:45.576804 14111 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.591754 14358 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:45.603173  8837 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
W20260709 13:17:45.671162  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 103788us
I20260709 13:17:45.604560 14386 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:45.690663  8839 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:45.664116 14045 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:45.603075 14313 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:45.707041  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 141548us
I20260709 13:17:45.708101  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:45.688176 14386 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:45.730015 14333 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:45.730542 14333 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:45.730971 14333 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.737881  8808 leader_election.cc:400] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
I20260709 13:17:45.738415  8808 leader_election.cc:403] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:45.741302 13937 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14.
I20260709 13:17:45.741704 14404 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:17:45.742875  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.744076 13937 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:45.664880 14111 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.665414 14358 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.763038  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:45.744612 13937 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:45.773639  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.746393 14045 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:45.828658  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 222133us
W20260709 13:17:45.829547  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 66609.4us
I20260709 13:17:45.830443  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:45.831096  8914 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.832592  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:45.835363  8808 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:45.807682  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 227770us
I20260709 13:17:45.837106 14401 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:45.840780  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:45.841555  8764 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:45.845342 14407 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:45.846117  8914 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:45.848039 14401 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:45.847868 14333 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:45.849035 14401 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.849785 13937 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.847926  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:45.853811  8765 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:45.868803  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:45.869091  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:45.870012  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:45.881347  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46107.1us
I20260709 13:17:45.904978  8764 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
W20260709 13:17:45.923130  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 91671.9us
I20260709 13:17:45.879709 14275 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:45.969440  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45328.5us
W20260709 13:17:45.976451  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 97410.1us
I20260709 13:17:45.988020 14361 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.873293 14386 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:45.993393 14111 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.010259  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:46.023402  8760 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:46.023999  8760 pending_rounds.cc:85] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 8
I20260709 13:17:46.024286  8760 pending_rounds.cc:107] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:46.024612  8760 raft_consensus.cc:2889] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:46.034662  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64790.9us
W20260709 13:17:46.035705  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.038116 14411 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:46.039721 14361 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.017132 14359 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:45.930811 14045 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:46.061823  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 55054.2us
W20260709 13:17:46.066673  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47325us
I20260709 13:17:46.067574  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:46.032612 14358 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.071305 14410 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:46.071496 14409 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.259s	user 0.002s	sys 0.002s
I20260709 13:17:46.072098 14410 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:46.073065 14410 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.074043 14275 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.074751  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:46.075695 14415 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:17:46.078660  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:46.078891 14405 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
W20260709 13:17:46.081208  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45707.4us
I20260709 13:17:46.081705 14425 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:46.082830 14425 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:46.082906  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:46.083290 14425 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:46.083730  8764 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:46.084017  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:46.084360 14358 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.084723  8917 raft_consensus.cc:3060] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.085325  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.086771  8884 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:46.088565  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.090031  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:46.090378  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:46.090991  8915 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:46.091439  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.091822  8916 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:46.092774  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.035074 14407 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.094264  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.094555 14407 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.095323 14329 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:46.090077  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.095791 14329 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:46.076617  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.083947  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.094872  8916 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:46.092633  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.101438  8911 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:46.101670  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:46.100827  8918 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:46.100685  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.084605  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:46.099038  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.113458  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:46.115716  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.125190  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.068054 14359 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.156129  8915 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:17:46.157151  8916 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:17:46.134181 14334 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:46.145869  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:46.160807  8760 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.147101  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:46.099327 14358 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:46.096822 14407 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:46.114966 14387 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.570s	user 0.012s	sys 0.003s
I20260709 13:17:46.151630 13866 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.098235 14414 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:46.113593 14319 consensus_meta.cc:287] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
I20260709 13:17:46.032331 14060 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.136001 14361 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:46.083741 14425 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:46.110752 14275 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.115783 14333 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.177348  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.178021  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.190009  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.183883  8911 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 13:17:46.185910  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 105623us
W20260709 13:17:46.170835 14332 consensus_meta.cc:287] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.003s
I20260709 13:17:46.181324 14393 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.190281  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.192649  8910 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:17:46.184218 14334 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:46.197105  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72107.4us
I20260709 13:17:46.097631 14329 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.186967 14414 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:46.198514  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:46.198879  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44810.4us
I20260709 13:17:46.182614 13866 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.183871 14319 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.207170  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.201550 14333 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:46.216250  8917 raft_consensus.cc:2468] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:46.206802 14334 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:46.201303 14361 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:17:46.206528 14332 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:46.224308 14329 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:46.225244 14358 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:46.249464  8760 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:46.251906 14435 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:46.255079 14432 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:17:46.282125  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 63233.6us
I20260709 13:17:46.252594 14334 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.241809 14414 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.267059 14435 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.293407 14060 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:46.311861  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 156853us
I20260709 13:17:46.292255 14439 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:46.295826 14428 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:17:46.293908 14443 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:46.314131  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.292373 14334 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:46.377867  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 92140.1us
I20260709 13:17:46.316733 14438 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.378906  8882 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:46.386189 13761 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.386885 13761 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:46.389655 14441 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:46.394054  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:46.394809 14322 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.394888  8760 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:46.395467 14322 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.397898 14322 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.386070  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:46.324528 14319 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.410759 14435 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.382591 13866 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.318387 14439 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.384022 14294 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:46.428815  8882 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:46.424130 14334 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:46.441097 14426 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260709 13:17:46.424623 14384 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.442013 14384 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.444438 14384 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.446179 14351 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.449385  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:46.450295 14275 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.450744 14275 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.454437  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:46.458705 14412 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.652s	user 0.002s	sys 0.000s
I20260709 13:17:46.408591 13761 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.432511 14439 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.462177 14275 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.463255 14313 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.384274 14438 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.466349 14438 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.466924 14275 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.468529 14332 consensus_queue.cc:1059] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:46.469714 14332 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:46.470412 14332 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:46.471953 14332 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.473698 14332 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:46.377535 14443 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.480376 14443 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:46.484714 14417 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.676s	user 0.003s	sys 0.002s
I20260709 13:17:46.485167 13937 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.485935 13937 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:46.494571 14392 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.765s	user 0.000s	sys 0.005s
W20260709 13:17:46.496176  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67484.6us
I20260709 13:17:46.497447 14111 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.497982 14111 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.498368 14111 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:46.499529  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.501974 13866 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:46.502657 13866 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.508813  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.509250  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.509727  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:46.510145  8844 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:46.509528  8836 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:46.525501  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:46.504740  8768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2387) took 1467 ms. Trace:
I20260709 13:17:46.526423  8760 raft_consensus.cc:2393] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:46.526999  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.527612  8836 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:46.527499  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:46.534713  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.535497  8836 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:46.526643  8768 rpcz_store.cc:276] 0709 13:17:45.037193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.063445 (+ 26252us) service_pool.cc:224] Handling call
0709 13:17:45.063782 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.064222 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.064255 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.083760 (+ 19505us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.164916 (+ 81156us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4800360558. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:17:45.417045 (+252129us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:45.417089 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.417159 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.493589 (+1076430us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:46.504411 (+ 10822us) raft_consensus.cc:1685] finished
0709 13:17:46.504443 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.504627 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":1959,"raft.run_wall_time_us":99203,"spinlock_wait_cycles":268514432,"thread_start_us":263973,"threads_started":1,"wal-append.queue_time_us":591326}
I20260709 13:17:46.539902  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:46.544400  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:46.545096  8837 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.545639  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.546054  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.546253  8836 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:17:46.546729  8844 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:46.484333 14425 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.534123 14313 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.547648  9466 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:46.548174 14313 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.551295 13866 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.552145  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.552408 14313 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.553447  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:46.554118 13761 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.554558 14334 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.556043  8735 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:46.556634 14435 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:46.556916 14423 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.520s	user 0.001s	sys 0.000s
I20260709 13:17:46.558068 14294 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:46.559258 14425 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.559396  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:46.589346  8761 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:46.559881 14386 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.560245  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:46.578006  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.581589  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:46.505573 13937 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.585922  8837 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:46.591260  9459 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:46.583288 13761 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:46.600732  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44776.4us
I20260709 13:17:46.607779  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:46.597882 14345 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.007s	sys 0.019s
I20260709 13:17:46.570899 14111 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.593616 14387 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:46.616719 14345 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.008s	sys 0.019s
I20260709 13:17:46.597488 14388 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:46.597198 13866 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:46.683202  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 75567.3us
I20260709 13:17:46.578949 14334 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.683996  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.603286 14435 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:46.685573  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 56449.8us
I20260709 13:17:46.689108 13761 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.693141  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.610175 14431 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.696082  8918 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:46.697518  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.698959  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.699779 13761 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.700304 13761 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.700742 13761 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.706792 14384 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:46.702039 14443 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.708277 14443 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.708796 14443 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:46.710686 14416 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.900s	user 0.002s	sys 0.000s
I20260709 13:17:46.721227 14358 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:46.721884 14358 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:46.691349 13866 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.702463 14350 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.730471 14350 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:46.730993 14350 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.690701 14351 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:46.741426 14351 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.741854 14351 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:46.696280 14388 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.694389 14294 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.705880 14431 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.746771 14334 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.683723 14387 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.749562 14387 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.751123 14111 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.614566 14313 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:17:46.754077 14435 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:46.754711 14435 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.755195 14435 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:46.757802 14431 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.765151  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:46.774725 14351 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.790997 14351 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.792251 14334 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:46.793222 14334 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:46.788399 14443 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.794909 14350 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.797159 14350 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.805508 14443 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.835757 14358 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.841926 14358 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.816210  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:46.847499  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.849774 14454 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:46.850419 14454 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.851346 14454 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:46.857026  8662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 99) took 15783 ms (client timeout 15000 ms). Trace:
W20260709 13:17:46.857683  8662 rpcz_store.cc:269] 0709 13:17:31.073238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.075148 (+  1910us) service_pool.cc:224] Handling call
0709 13:17:46.856929 (+15781781us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:44.920778 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:45.054319 (+133541us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:45.056805 (+  2486us) write_op.cc:435] Acquired schema lock
0709 13:17:45.060016 (+  3211us) tablet.cc:662] Decoding operations
0709 13:17:45.236683 (+176667us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:45.240879 (+  4196us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:45.243286 (+  2407us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:17:45.274473 (+ 31187us) tablet.cc:701] Row locks acquired
0709 13:17:45.274503 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:17:45.274707 (+   204us) write_op.cc:270] Start()
0709 13:17:45.274855 (+   148us) write_op.cc:276] Timestamp: P: 1783603065274646 usec, L: 0
0709 13:17:45.274885 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:17:45.338961 (+ 64076us) log.cc:844] Serialized 2434 byte log entry
0709 13:17:46.031838 (+692877us) op_driver.cc:464] REPLICATION: finished
0709 13:17:46.255930 (+224092us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6cc900ac 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce737d0ef0
0709 13:17:46.440683 (+184753us) write_op.cc:301] APPLY: starting
0709 13:17:46.440774 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:46.447399 (+  6625us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:46.447423 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:46.458123 (+ 10700us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:46.458490 (+   367us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:17:46.458541 (+    51us) write_op.cc:312] APPLY: finished
0709 13:17:46.458909 (+   368us) log.cc:844] Serialized 65 byte log entry
0709 13:17:46.459080 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.459187 (+   107us) write_op.cc:454] Released schema lock
0709 13:17:46.459226 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:46.459671 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:46.459698 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":772763,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":404305,"apply.run_cpu_time_us":10284,"apply.run_wall_time_us":19156,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":371694,"prepare.run_cpu_time_us":43098,"prepare.run_wall_time_us":637931,"raft.queue_time_us":79115,"raft.run_cpu_time_us":8364,"raft.run_wall_time_us":455004,"replication_time_us":730635,"spinlock_wait_cycles":56992640,"thread_start_us":600295,"threads_started":4,"wal-append.queue_time_us":456435}]]}
I20260709 13:17:46.862322  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:46.865846 14386 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:46.866793 14386 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:46.867151 14386 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:46.868316  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:46.869045  9466 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.874370 14339 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:46.874974 14339 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:46.875229  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 168868us
I20260709 13:17:46.876367  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.877444 14443 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:46.878103 14443 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:46.878187 14339 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.878527 14388 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:46.879006 14443 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.886708 13866 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.888149 14045 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:46.888760 14045 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.889761 13761 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.892686 14334 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:46.893373  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:46.895161  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:46.898371  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.899062  8837 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:46.903347  9466 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:46.909945  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.910135  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.913079  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:46.924993 13761 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.930672  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:46.945669  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:46.946592  8844 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:46.948557  8839 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:46.953359  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:46.915046 13866 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:17:46.911960 14414 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.048s	sys 0.035s
I20260709 13:17:46.957937 13761 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:46.961210 13761 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.961221  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:46.961726 13761 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:46.962067  8839 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.961767  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:46.955479  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:46.963394  8841 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.962788  8767 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:17:46.904706 14435 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:46.960274 14414 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.049s	sys 0.036s
I20260709 13:17:46.969348 13866 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:46.975214  8844 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:17:46.975986  8835 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:46.979346  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:46.968268  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:46.988452 13761 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:46.983547 14427 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.985244  8735 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:46.986213 14350 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:47.010574 13761 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:47.013343 13761 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:47.003983 14427 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:47.017844 13761 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.018651  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:47.040454  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.041783  8844 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:47.076371  8844 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:47.077489  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.034739 14427 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.113655  8841 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:17:47.120959  8840 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:47.123173  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:47.125386 14443 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:47.126155 14443 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:47.128731  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:47.130050  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:47.130205  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:47.130993  8841 raft_consensus.cc:2410] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:47.131939  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.127691 14443 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:47.136334  8882 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.089s	sys 0.127s
W20260709 13:17:47.144238  8882 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.089s	sys 0.127s
I20260709 13:17:47.070624 14333 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.069692 14358 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:47.137884  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:47.146564  8837 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:47.172587  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.173367  8765 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:47.177073  8839 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:47.178124  8843 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:47.083513 13937 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.184192  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:47.021349 13866 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.189129 14313 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.202358  8768 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:47.203215  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:47.204783 14456 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 13:17:47.208112  8766 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:47.210539  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.194453  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:47.182144 14415 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:17:47.176129 14332 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.181715 14358 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:47.164348 14333 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.223887 14414 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.241498 14350 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:47.222697 14472 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.283720  9466 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:47.233541 14313 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:47.277808 14455 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:17:47.246279 14435 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:47.287446  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.223186 14351 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:17:47.218508 13937 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.303392  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.304461  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:47.305147  8760 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.295850 14350 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:47.316929  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:47.318392  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.320626 14350 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.316718  8913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 2334) took 1477 ms. Trace:
W20260709 13:17:47.322683 14458 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:17:47.271026 14332 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.322191  8913 rpcz_store.cc:276] 0709 13:17:45.829806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.829946 (+   140us) service_pool.cc:224] Handling call
0709 13:17:45.830341 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.834324 (+  3983us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.834351 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.455461 (+621110us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b2c00125038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:17:46.455902 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:17:46.595951 (+140049us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:46.595985 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.596067 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.291977 (+695910us) raft_consensus.cc:1685] finished
0709 13:17:47.292020 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.307512 (+ 15492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":323,"raft.queue_time_us":75224,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":141,"spinlock_wait_cycles":41909120,"thread_start_us":139650,"threads_started":1,"wal-append.queue_time_us":492660}
I20260709 13:17:47.321192  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.333035  8760 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
W20260709 13:17:47.324177 14471 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:47.375645  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.377729  8760 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:47.288481 14414 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.422462 14414 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.379359  8769 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:47.402484 14386 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.425521 14386 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:47.403549 14473 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.403237 14358 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.406163  8912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 2353) took 1315 ms. Trace:
I20260709 13:17:47.406405 14313 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.407438 14333 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.407780 14332 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.410049 13937 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:47.410099 14454 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.558s	user 0.011s	sys 0.000s
I20260709 13:17:47.418310  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:47.427346 14473 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.435858  9465 raft_consensus.cc:2410] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:17:47.440640  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.442759  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.443893  8913 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:17:47.444314  8913 pending_rounds.cc:85] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 8
I20260709 13:17:47.444563  8913 pending_rounds.cc:107] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:17:47.444875  8913 raft_consensus.cc:2889] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:47.428121  8912 rpcz_store.cc:276] 0709 13:17:46.090909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.096915 (+  6006us) service_pool.cc:224] Handling call
0709 13:17:46.097302 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.097744 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:46.097787 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:46.827640 (+729853us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b2c00125038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:17:46.828217 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.034780 (+206563us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:47.074090 (+ 39310us) log.cc:844] Serialized 14 byte log entry
0709 13:17:47.074303 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.074373 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.405891 (+331518us) raft_consensus.cc:1685] finished
0709 13:17:47.405983 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.406105 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38164,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":78,"raft.queue_time_us":22984,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":78870,"spinlock_wait_cycles":82292992,"thread_start_us":206141,"threads_started":1,"wal-append.queue_time_us":346997}
I20260709 13:17:47.446771  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.447773  8909 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:47.448016  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.454257  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.292378 14472 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.456002  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:47.433956 14475 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:47.458525  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:47.467186  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.469942  8917 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.471220  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.471562  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.492480  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.494167  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:47.466463 14463 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:17:47.496829  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.497396  8910 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:47.497684  8839 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:47.502853  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.438115 14454 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.505131  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.506074  8839 raft_consensus.cc:2410] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 17 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 13:17:47.507750  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.509050  8762 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:47.491184 14332 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:47.516336  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.521303  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.523083 14454 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:47.428695 14477 consensus_queue.cc:1175] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3b34c95a175945b88b17f07fbc650abf" responder_term: 18 status { last_received { term: 17 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:47.540424  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.501560 14333 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:47.547112  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.541579 13937 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:47.551831  8918 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:47.556391  8917 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
W20260709 13:17:47.558192  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 58031.6us
I20260709 13:17:47.561892  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.563521  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.566730  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:47.567006  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.567217  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.569653  8761 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:47.576287  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.580780  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.582410  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.582690  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.582451  8839 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:47.584633  8910 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:47.587426  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:47.587996  8918 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:47.544005 14332 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.593466 14045 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.551106 14333 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.610023  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:47.607440 14486 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.614730 14486 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.611312 14350 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:47.616220 14459 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.608s	user 0.001s	sys 0.003s
I20260709 13:17:47.617707  8916 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:47.618113  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.618700  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:47.619897 14486 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.620621  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:47.629078 14454 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:47.643364 14481 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:17:47.651705  8843 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:47.657529 14319 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.658306 14482 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:47.658269 14319 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.658926 14482 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.657670 14473 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.567811 13937 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:47.665154  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49352.3us
I20260709 13:17:47.673678  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:47.673913 14480 log.cc:927] Time spent T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:17:47.680706  8882 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:47.661208 14334 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.686542  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:47.688228 14427 consensus_meta.cc:287] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.002s
I20260709 13:17:47.674912 14350 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.692123 14355 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:47.683157 14060 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:47.708490  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.689013 14482 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:47.692348 13866 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:17:47.699430 14484 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.716282 14472 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.713488 14355 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:47.714618 14060 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:47.794286  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 63949.7us
I20260709 13:17:47.688684 14334 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.710790 14427 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.755067 14473 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.755995 14482 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.733136 14319 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.797199  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:47.766214 14487 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:17:47.807590  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:47.793386 14355 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.716019 14350 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.796198 14060 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.797791 14132 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.798209 14339 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:47.801908 14481 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:47.814360  9461 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:47.828990  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.815384  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 204593us
I20260709 13:17:47.823110  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:47.833811  8764 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
W20260709 13:17:47.838586  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 150502us
W20260709 13:17:47.838482  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 148486us
I20260709 13:17:47.840399  8841 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:47.803663 14473 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.813277 14472 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.847705  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:47.851974  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:47.831794 14461 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.811908 14482 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.869206  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:47.866874  8884 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:47.881381  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:47.838428 14333 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.865625 14344 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:47.884497 14473 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:47.885979 14491 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:47.889066 14294 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:47.891920 14389 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:47.892475 14389 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:47.892880 14389 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.893211 14427 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:47.894599 14489 log.cc:927] Time spent T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:17:47.837637 14339 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.899190 14339 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.852582 14332 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.903774  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:47.853935 14375 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.865630 14461 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:47.930770 14461 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.931668 14457 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.932242 14457 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.835387 14132 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:47.947142  8767 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:47.947978  8760 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:17:47.957998  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:47.958251  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:47.958526  9466 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:17:47.906334  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57603.5us
W20260709 13:17:47.909776 14492 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:47.912621 14500 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:47.877884 14477 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.906389 14445 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:47.916317 14490 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:17:47.922113 14350 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.852062 14351 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:47.852468 14358 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:47.924029 14334 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.866017 13866 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:47.925235  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:47.926761 13937 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.865798 14384 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:17:47.966823  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:47.969174  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 119289us
W20260709 13:17:47.970297  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66595.3us
I20260709 13:17:47.988245  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:47.968945  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:47.975173 14508 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:47.977660  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:47.878225 14388 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:17:47.985026 14358 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:47.971290 14494 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:48.006089 14358 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:47.992103 13866 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:47.993126 14384 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.009259  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:48.009959  9459 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:17:47.977135 14477 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:48.011204  8734 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:47.989151 14351 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.013638 14483 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.014058 14483 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:48.014408 14483 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:48.015002 14351 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:47.973344 14375 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:47.976259 14435 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.017956 14388 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:48.018436 14388 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:48.019340 14388 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.020463 14388 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:48.021198  8884 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:48.023195 14344 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.994011  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.025233 14045 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.026055  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.018446 14435 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.027853  8836 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:48.028046 14435 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.030175  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.030786  8838 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:17:48.031313  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.031916  8842 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:48.032809 14358 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.032763 14045 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:48.033344 14358 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.034478  8839 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:48.035650 14358 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.036125  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:48.049823  8918 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:48.049391  8761 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:48.062749  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.064592  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:48.045894  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.036780  9459 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:48.071465  8915 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 19.
I20260709 13:17:48.046372  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.075155  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:48.076455  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:48.001572 14457 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:48.071034  9465 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
W20260709 13:17:48.003957  9434 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.569s (SENT) [suppressed 15 similar messages]
I20260709 13:17:48.114513  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:48.001890 14451 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:48.118734  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:48.107632  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64323.2us
I20260709 13:17:48.120690  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:48.085618  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:48.081295  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.081297  8844 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:48.072507  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:48.123611  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.081727  8760 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:48.078780  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:48.012701 14477 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:48.038935 14478 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.637s	user 0.001s	sys 0.002s
I20260709 13:17:48.036599 14132 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:48.037918 14431 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:48.047472 14482 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:48.049139 14351 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.146853  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.147485  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:48.142272 14132 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:48.142773 14443 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.143893 14446 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:48.146166  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.146402  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:48.036902  8665 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.157814  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.153086  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.115226 14045 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:48.064185 14386 consensus_queue.cc:1059] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:17:48.131455 14358 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:48.041536 14413 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:17:48.177994  8732 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.162930  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.166834  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.151185  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.024667 14461 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.138161 14211 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:48.175944  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:48.012502 14389 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.048286 14355 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.139833 14457 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:48.138768 14431 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:48.174206 14386 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:48.179713  8836 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 18.
I20260709 13:17:48.180661  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.174547  8764 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:48.307717  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.169919 14045 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.137633 14294 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:48.340092 14506 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.192s
I20260709 13:17:48.153132 14334 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:17:48.343073  8918 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:48.368350  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 364392us
I20260709 13:17:48.194804 14435 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.197134 14211 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.178188 14358 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:48.376691  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.345036 14386 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:48.354336 14507 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.389161  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.307181 14457 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.160674 14351 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.162914 14443 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:48.415671  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 235103us
I20260709 13:17:48.146792 14494 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.216s
I20260709 13:17:48.343581 14389 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:48.398463 14211 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:48.435129  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:48.420264 14060 consensus_meta.cc:287] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.001s
I20260709 13:17:48.377187 13937 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:48.442144  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 107904us
I20260709 13:17:48.367421 14045 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.420982 14358 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:48.463307  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.451228  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.197078 14511 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.247s
I20260709 13:17:48.428721 14477 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:48.471130 14319 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.471199 14506 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.439153 14507 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.435194 14457 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:48.479632 14351 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.479404 14386 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:48.480880 14111 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:48.441244 14350 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.509075  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.397629 14427 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:17:48.519973  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.354679 14431 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.522032  8913 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:48.462286 14060 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.576033  8915 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:48.587604  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 135775us
I20260709 13:17:48.581746  8913 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:48.584546  8918 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:48.514564 14111 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:48.465132 13937 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.512538 14477 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.613359  8917 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:48.593555 14431 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.614195 14111 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.624284 14509 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:48.624436 14211 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.624264 14111 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.599988 14384 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.600612 14486 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.610800 14375 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.592875 14388 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:17:48.645484 14355 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:48.661278 14387 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:48.703903 14493 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.704071 14387 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:48.707243 14387 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:48.709220  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49015.1us
I20260709 13:17:48.709543 14388 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:48.709954  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:48.711292 14388 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:48.711676 14388 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.712029 14388 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.713405 14045 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:48.715692 14045 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:48.715878 14509 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:48.718871  8835 raft_consensus.cc:2368] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 16. Current term is 17.
I20260709 13:17:48.704510 14493 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:48.662047 14483 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.002s
I20260709 13:17:48.723590  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:48.725837  8762 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:48.727780  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 276627us
I20260709 13:17:48.729362  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:48.736515  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:48.728367  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.742939  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.745298  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:48.738946  9431 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:48.744540  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.747855 14518 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.751806 14524 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:48.752345 14524 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.752085 14518 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.752735 14524 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:48.754422 14518 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.755004 14525 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:48.758697 14513 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:48.760144 14507 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.760929 14507 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:48.758630 14485 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:48.677449 14472 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.655885 14384 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.772891  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.773586  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.748382  8732 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.774183  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:48.704732 14211 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:48.722229 14461 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.716442 14509 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:48.766882  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:48.775214  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.775481  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:48.791779  9459 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.777467  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.750327  9465 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:48.658587 14375 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.781018  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.780068  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.767977  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.733650 14454 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.716591 14358 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.797184  8914 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:48.797559  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:48.763501 14414 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:48.699637 14486 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.838464 14454 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.801589 14493 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.779474  8915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:48.845979 14443 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.855358 14526 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.898286 14132 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:48.898739 14132 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:48.899618 14132 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.855646 14358 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.858258  8665 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 1 to 4, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 4 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:48.742260 14511 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:17:48.773016 14507 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:48.863025  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 61648.3us
I20260709 13:17:48.864357 14509 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:48.799388  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:48.776132 14313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.025s	sys 0.069s
I20260709 13:17:48.883971  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:48.885854  8915 raft_consensus.cc:606] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:48.887759  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:48.769609 14485 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:48.889190 14414 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.890875 14454 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.892453 14493 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:48.896586 14477 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:48.785910 14518 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:48.741061 14483 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:48.911286  8762 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
W20260709 13:17:48.913723  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 114441us
I20260709 13:17:48.918907  9459 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:48.922314  8769 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.922782  8915 raft_consensus.cc:614] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:48.925573  8910 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:48.779999 14472 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:48.933650  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:48.922119 14313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.026s	sys 0.069s
I20260709 13:17:48.926141 14358 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:49.002135  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:48.922472 14045 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.023739  8767 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:17:48.981465 14060 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:49.033119  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.034435  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.027634  8665 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 6 to 9, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 9 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:49.030151  9434 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.006s
W20260709 13:17:49.035220  9434 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.013s	sys 0.006s
W20260709 13:17:49.035524  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 615611us
I20260709 13:17:49.037762  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.003684 14477 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.046403  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.047057  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.046996  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.050522  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:49.034245 14517 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:17:49.058961  8809 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:49.064505  8769 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:48.996670 14493 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.027073 14045 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.035794 14358 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:49.115272  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 80897.4us
W20260709 13:17:49.121690  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 353758us
I20260709 13:17:49.033893 14534 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.116973  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.127796  8837 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:49.127503 14534 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.121845  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.115272  8839 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:49.128789  8839 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.128927  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:49.130303  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:49.131699  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:49.133378  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66552.8us
I20260709 13:17:49.134156  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:49.135195 14505 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:49.135347 14111 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:49.135809 14505 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.135684 14524 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.136253  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:49.054428 14414 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.137233 14414 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.125628  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:49.137641 14520 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:49.138087 14060 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:49.138593 14461 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.054344 14443 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.139909  8807 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.140295 14375 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.140653 14461 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.116088 14339 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:49.145380 14339 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:49.146303 14339 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:49.123061  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 64328.1us
I20260709 13:17:49.190860  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:49.005609 14526 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 13:17:49.195360  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 73653.6us
I20260709 13:17:49.118821 14350 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.208118  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:49.199038 14457 consensus_meta.cc:287] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.677s	user 0.014s	sys 0.001s
I20260709 13:17:49.215047  9459 raft_consensus.cc:1240] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:49.197742 14518 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.194777 14418 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:49.120638 14477 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:49.239729  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48975.6us
I20260709 13:17:49.242435  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.242584  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:49.244462  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.247123  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.249668  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:49.249990  8769 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:49.251616  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.253216  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.254020  8769 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:49.255026  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.258033  8769 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:49.265816  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.266907  8761 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:49.040052 14485 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.269804  8842 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2466) took 1168 ms. Trace:
W20260709 13:17:49.238195  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45337.2us
I20260709 13:17:49.216180 14358 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:49.274437  8761 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:49.270218  8842 rpcz_store.cc:276] 0709 13:17:48.080853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.096765 (+ 15912us) service_pool.cc:224] Handling call
0709 13:17:48.097275 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.113594 (+ 16319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.113625 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.114089 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.313010 (+198921us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:48.313072 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.313171 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.248809 (+935638us) raft_consensus.cc:1685] finished
0709 13:17:49.248830 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.248979 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5740,"raft.queue_time_us":136,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":8477,"thread_start_us":149766,"threads_started":1,"wal-append.queue_time_us":617370}
I20260709 13:17:49.277927  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:49.136737 14505 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.263382 14344 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.282176  8917 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:49.280309  8915 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:49.246552 13866 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:49.248164 14443 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.264178 14413 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.247366 14511 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:49.295603  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 152118us
I20260709 13:17:49.296845  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.263923 14523 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.274430 14486 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.274060 14527 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:49.303838  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.302170  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.221910 14457 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.277282 14484 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.309880  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:49.264183 14418 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:49.303973 14388 consensus_meta.cc:287] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.592s	user 0.013s	sys 0.000s
I20260709 13:17:49.313304  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:49.320616  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.323581  8918 raft_consensus.cc:2393] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:49.273892 14536 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:17:49.339244  8912 raft_consensus.cc:2368] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
I20260709 13:17:49.339309  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:49.339999  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 125464us
I20260709 13:17:49.343113  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:49.302568 14443 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.321403 14472 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.320817 14486 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.301972 14413 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.335896 14524 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:49.350468  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 82493.4us
I20260709 13:17:49.357684  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60048 (request call id 2456) took 1279 ms. Trace:
I20260709 13:17:49.359793  8767 rpcz_store.cc:276] 0709 13:17:48.071956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.072154 (+   198us) service_pool.cc:224] Handling call
0709 13:17:49.350687 (+1278533us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400199454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:49.350829 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070856448}
I20260709 13:17:49.341790 14375 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:49.364142  8761 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:49.369982  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.305980 14523 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.305823 14511 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:49.351642 14531 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:17:49.332157 14388 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.377494  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.383731  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.382793  8917 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:49.385932  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:49.308709 14527 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.342885 14533 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 13:17:49.377588 14539 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:17:49.338915 14535 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
W20260709 13:17:49.378319 14537 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:49.365195 14375 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.498535  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.411130  8913 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:49.412082  8765 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:49.500263  8915 raft_consensus.cc:606] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:49.500777  8915 raft_consensus.cc:614] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:49.375157 14451 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.373821 14546 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:49.382239 14524 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.400579 14493 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.492524  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:49.494365 14443 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.495075  8761 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:49.502408  8764 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.503278  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.504674  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2471) took 1019 ms. Trace:
I20260709 13:17:49.505488  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.532814  8766 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.483186 14535 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:49.510744  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.383606 14536 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:17:49.544915  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:49.545828  8760 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:17:49.511953  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 151148us
I20260709 13:17:49.531904  8843 rpcz_store.cc:276] 0709 13:17:48.484820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.488844 (+  4024us) service_pool.cc:224] Handling call
0709 13:17:48.490054 (+  1210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.490377 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:48.490403 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.490795 (+   392us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.875315 (+384520us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:48.875379 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.875470 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.504442 (+628972us) raft_consensus.cc:1685] finished
0709 13:17:49.504464 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.504597 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":733,"raft.run_cpu_time_us":41,"raft.run_wall_time_us":42,"spinlock_wait_cycles":15744,"thread_start_us":384012,"threads_started":1,"wal-append.queue_time_us":566499}
I20260709 13:17:49.399190 14547 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.148s
I20260709 13:17:49.502542 14375 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:49.507093 14546 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.560138 14523 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:49.563798 14541 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 13:17:49.564625 14132 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:49.565335 14544 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:49.564664  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:49.566509  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:49.567245  9466 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 20: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:49.555622  8763 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.558041 14527 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.559136 14457 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:49.539086 14533 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:49.534690 14477 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.538550 14535 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.615594  8760 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 20.
I20260709 13:17:49.511513 14451 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.620642 13937 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.621095 14451 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.621743  8767 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:49.623652 13866 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:49.610858 14533 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.609151 14410 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:49.630708 14410 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:49.631841 14543 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 13:17:49.628644 14533 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.638772  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:49.616186  8766 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
W20260709 13:17:49.649004  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.649572  8732 leader_election.cc:400] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
W20260709 13:17:49.649925  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.632679 14384 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.642486 14418 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:49.662782  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:49.673164  8915 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 20: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:49.660722 14535 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.674388 14535 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.677763 14511 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:49.651868 14523 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.678881  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:49.697640 14388 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:49.643998 14508 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.037s	sys 0.050s
W20260709 13:17:49.666556 14552 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:49.644054 14527 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:17:49.657043 14536 consensus_queue.cc:1243] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:17:49.723887  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 123884us
W20260709 13:17:49.718401 14508 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.037s	sys 0.050s
W20260709 13:17:49.725669  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 133458us
W20260709 13:17:49.726792  9432 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.729297  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:49.730315 14550 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:49.731175 14550 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:49.727793 14413 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:49.736984  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 134956us
I20260709 13:17:49.754273  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.756004  8842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94e939be989f4d59b1983955951ab90f"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:17:49.749936  8839 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.756687  8842 raft_consensus.cc:606] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:49.756770  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:49.757124  8842 raft_consensus.cc:614] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:49.757632  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.757922  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.758483  8836 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:49.760754  8839 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:49.767767 14529 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.791s	user 0.002s	sys 0.004s
I20260709 13:17:49.772214  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 2470) took 1287 ms. Trace:
I20260709 13:17:49.775085 14565 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:49.776021 14565 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:49.776357 14565 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.772621  8844 rpcz_store.cc:276] 0709 13:17:48.484543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.487295 (+  2752us) service_pool.cc:224] Handling call
0709 13:17:48.487621 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:48.487987 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:48.488021 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:48.488446 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:17:48.598442 (+109996us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:48.598507 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.598610 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:49.767215 (+1168605us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:49.771899 (+  4684us) raft_consensus.cc:1685] finished
0709 13:17:49.771921 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.772151 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2789,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":48579840,"thread_start_us":109635,"threads_started":1,"wal-append.queue_time_us":395583}
I20260709 13:17:49.788630 14566 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.789362 14566 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.791466 14566 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:49.795571  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.797084 14565 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.798466 14565 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.798509  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.777469  8839 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:49.802243  8839 pending_rounds.cc:85] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 7
I20260709 13:17:49.802600  8839 pending_rounds.cc:107] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:49.802896  8839 raft_consensus.cc:2889] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.805953 14483 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:49.807706  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.808314  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.808648  8915 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:49.810065  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:49.810175  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.811990  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.814352  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.815585  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.816669  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.816787  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.817988  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:49.818614  8912 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:49.819947  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:49.776376 14045 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.823056  8917 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:49.892599  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:49.855628 13937 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:49.903245 13937 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.801031 14550 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:49.824931 14546 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.913179 14500 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:49.913899 14500 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:49.914382 14500 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.835867 14472 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:49.904987 14386 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.920570 14546 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.921736 14482 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:17:49.927989  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 2383) took 1881 ms. Trace:
I20260709 13:17:49.921368 14472 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:49.929634  8910 rpcz_store.cc:276] 0709 13:17:48.046472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.046630 (+   158us) service_pool.cc:224] Handling call
0709 13:17:48.046934 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:49.001131 (+954197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.927642 (+926511us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b54001d4054. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:49.927907 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2019877632}
I20260709 13:17:49.931486  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:49.944422 14565 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:49.944941 14565 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:49.945315 14565 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.950640  8910 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:49.952521 14567 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:49.953804 14565 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.970917 14375 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.964015 14472 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.976135 14472 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.977928  8841 raft_consensus.cc:2368] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
I20260709 13:17:49.982704  8916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 591) took 1210 ms. Trace:
I20260709 13:17:49.983090  8916 rpcz_store.cc:276] 0709 13:17:48.771846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.773255 (+  1409us) service_pool.cc:224] Handling call
0709 13:17:48.794756 (+ 21501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.870398 (+ 75642us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:49.389611 (+519213us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.539650 (+150039us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:49.551412 (+ 11762us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:49.551466 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.982424 (+430958us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b54003af554. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:49.982481 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:49.982639 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7166,"prepare.queue_time_us":367306,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":4964,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11989,"spinlock_wait_cycles":173294976,"thread_start_us":628255,"threads_started":2,"wal-append.queue_time_us":239346}
I20260709 13:17:49.986775 14375 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.991078  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:49.992820  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.993290  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.994192  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.994865 14535 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:49.995457  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.995586 14535 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:49.996732  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.997493  8766 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 20: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:49.997777 14414 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.998288 14414 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.998526 14535 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.998589  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:49.999531  8765 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:50.000571 14507 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:50.001191  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.001315 14507 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.002964  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.004153  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.004243 14507 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.996279  8769 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:50.004918  8917 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:49.994215  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.006724  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.007915  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.007776  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.008796  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.009136  8839 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:50.009486  8837 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:50.013607  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:50.017320  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.020730 14565 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:49.998692 14414 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.023669 14414 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.024405  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:50.024669  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.025269  8916 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:50.012460  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.014531  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:50.030045  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.032120  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.034085  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.035569  8762 raft_consensus.cc:2410] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:50.039741  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.042495  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.043184  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:50.043654  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:50.044528  8917 raft_consensus.cc:2368] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
I20260709 13:17:50.044904  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:50.045426  8767 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:50.034052 14528 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.050690  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:50.029757 14535 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.052489  8838 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:50.052529  8762 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:50.053263  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.053912  8732 leader_election.cc:400] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
I20260709 13:17:50.056365  8913 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:50.059330  8732 leader_election.cc:403] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:17:50.060693  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.061313  8912 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:50.062144  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.063015 14534 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.063184  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.063807  8912 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:50.060403  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.066334  8913 raft_consensus.cc:2393] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:50.068600  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.074340 14500 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:50.075836 14557 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.396s	user 0.004s	sys 0.000s
I20260709 13:17:50.077152  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.077515 14528 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:50.060441 14511 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:50.067634  8767 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:17:50.079829  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:50.064610  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:50.089473  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47039.6us
I20260709 13:17:50.091087  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:50.091405  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:50.091958  8909 raft_consensus.cc:606] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:50.093815  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:50.113674  8917 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:50.055358 14414 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.122956  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.124964 14534 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.129047 14505 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:50.123610 14485 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.130164 14511 consensus_queue.cc:1059] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:50.131335 14511 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:50.131759 14511 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.126170  8912 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:17:50.083827 14500 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.132184 14511 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:50.055850 14523 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:17:50.098847 14375 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.098541 14565 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.151468  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:50.152757  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 120690us
I20260709 13:17:50.159924  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.161324  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.163303  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.140149 14583 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
I20260709 13:17:50.174113  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.153295 14414 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.181638  9465 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:17:50.170404 14486 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.184724 14486 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:50.185246 14486 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.157226 14211 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:50.178139 14527 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.177838 14569 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:17:50.189024  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:50.192065 14410 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.166469 14505 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.197647  8761 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:50.165649 14565 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.207106  8767 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:50.201465  8916 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:17:50.209455  8912 raft_consensus.cc:606] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:50.209844  8912 raft_consensus.cc:614] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:50.209933  8766 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:50.202867  8808 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.204488  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.167115 14386 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:50.212050 14493 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.242861 14535 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:17:50.273547  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 92270.9us
W20260709 13:17:50.275720  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 72914.8us
I20260709 13:17:50.276801  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:50.332813  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 239075us
W20260709 13:17:50.334834  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58150us
I20260709 13:17:50.335820  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:50.336763  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 63826.2us
I20260709 13:17:50.336958  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.340749  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.213129 14583 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:50.351904 14567 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:50.352162 14375 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.357374 14375 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:50.357890 14375 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.361438 14565 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.366079 14583 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.334084 14546 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.369467 14546 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.374306 14546 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.375576  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.378441 14384 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.269955 14451 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:50.382108 14586 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:17:50.382946  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.383342  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.408631  9461 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:50.383466 14505 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:50.410080  8808 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.411294 14451 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.413292 14505 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.416601 14451 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.418426 14505 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:50.418358  8842 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:50.412585 14583 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.425649  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:50.428094  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.437556  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.439462  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.429131 14386 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:50.441999  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 167503us
I20260709 13:17:50.443305  8735 leader_election.cc:400] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
I20260709 13:17:50.443703  8735 leader_election.cc:403] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:17:50.448709  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:50.449458  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.450654  8766 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 20: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:50.452298  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.431280 14384 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:50.431530 14535 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:50.432082 14505 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.451872  8808 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:50.492087  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.501530  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:50.502612  9461 raft_consensus.cc:2393] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
I20260709 13:17:50.506260 14565 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:50.507175 14565 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:50.508957 14583 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20.
W20260709 13:17:50.509745 14477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:17:50.513257 13937 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.514583 13937 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.515013  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.518595  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:50.519331  8766 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.524360 14384 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:50.526335 14384 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.537766 14567 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:50.508351 14565 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:50.545193 14577 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.499s	user 0.003s	sys 0.003s
I20260709 13:17:50.548133  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:50.448419 14546 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.563105 14511 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.499141 14535 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.565263 14535 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:50.569562 14582 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:17:50.570847  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 400511us
I20260709 13:17:50.573194 14211 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.582747  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:50.586933  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
W20260709 13:17:50.593469  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 397404us
I20260709 13:17:50.596848  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:50.593745  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 2400) took 1282 ms. Trace:
I20260709 13:17:50.601102  8838 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:17:50.488265 14493 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.499717 14451 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:50.605639  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:50.597926  8911 rpcz_store.cc:276] 0709 13:17:49.311718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.342519 (+ 30801us) service_pool.cc:224] Handling call
0709 13:17:49.347870 (+  5351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.348248 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:49.360970 (+ 12722us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.580412 (+219442us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.603462 (+ 23050us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.605840 (+  2378us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:49.606083 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:17:49.837990 (+231907us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18000e74c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:49.898234 (+ 60244us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18000e74c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9
0709 13:17:50.246306 (+348072us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18000e74c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce6fd92060 00007fce6fda4716 00007fce6fdb5287 00007fce6fdb5208
0709 13:17:50.593368 (+347062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.593477 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.593525 (+    48us) raft_consensus.cc:1685] finished
0709 13:17:50.593543 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.593683 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56385,"prepare.queue_time_us":25469,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":78406,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":12893,"spinlock_wait_cycles":51780864,"thread_start_us":502285,"threads_started":2,"wal-append.queue_time_us":272708}
I20260709 13:17:50.610890  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.595705 14211 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:50.626319  8766 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:50.612124 14505 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:50.614693 13937 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:50.616804 14546 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.668521 14211 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.669936 14211 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.670320 14375 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:50.681574 14589 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:17:50.682934 14535 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.652837 14505 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.665302 14472 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:50.690795 13937 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:50.721578  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.712554 14505 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:50.727643  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 127165us
W20260709 13:17:50.733887  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 290796us
W20260709 13:17:50.735785  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 139022us
I20260709 13:17:50.736804  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:50.734691  8735 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:50.740413  8914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42828 (request call id 2394) took 1442 ms. Trace:
I20260709 13:17:50.742746  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.744912  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.745996  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:50.740715  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:50.741361 14413 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:50.759903  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:50.722411 14472 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.749269 14581 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.740887  8914 rpcz_store.cc:276] 0709 13:17:49.297505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.297897 (+   392us) service_pool.cc:224] Handling call
0709 13:17:49.298184 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.305570 (+  7386us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:49.320487 (+ 14917us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.069418 (+748931us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b180040ec40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a23a 00007fce6fda4a2a
0709 13:17:50.151452 (+ 82034us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.151933 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.152111 (+   178us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:50.152351 (+   240us) log.cc:844] Serialized 14 byte log entry
0709 13:17:50.152542 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.152640 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.364211 (+211571us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b180040ec40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc7b2a6 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f
0709 13:17:50.365805 (+  1594us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4800060cd8. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce74cc3aa1 00007fce74cbab37 00007fce74cba9ca 00007fce74db226f 00007fce74db1f37 00007fce74dc655c 00007fce74dc6508 00007fce74dc6488 00007fce74dc6443 00007fce74dc56ec 00007fce73cefa96
0709 13:17:50.570406 (+204601us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b180040ec40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce73c6e58f 00007fce6ccad571 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd
0709 13:17:50.571574 (+  1168us) spinlock_profiling.cc:243] Waited 9.04 ms on lock 0x7b180040ec40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:50.740189 (+168615us) raft_consensus.cc:1685] finished
0709 13:17:50.740213 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.740349 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":280586,"prepare.queue_time_us":21858,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":3716,"raft.queue_time_us":29229,"raft.run_cpu_time_us":4380,"raft.run_wall_time_us":217987,"spinlock_wait_cycles":56675840,"thread_start_us":73266,"threads_started":1,"wal-append.queue_time_us":890030}
I20260709 13:17:50.728063 14511 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:50.774422  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.775354  8838 raft_consensus.cc:2393] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:50.749133 14590 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:50.779201  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:50.772989 14413 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:50.780025 14445 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.756769 14387 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.783907 14451 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.788421 14486 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.603s	user 0.010s	sys 0.002s
I20260709 13:17:50.761914 14375 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:50.789589 14597 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:50.762593 14504 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:50.791857  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.792541 14345 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:50.770135 14583 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.802806  8836 raft_consensus.cc:2368] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:50.796761 14535 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.799571 14451 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:50.810750 14585 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:50.779855 13937 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:50.779187 14485 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.649s	user 0.012s	sys 0.000s
I20260709 13:17:50.826123  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:50.827099  8840 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:50.828917  9465 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:50.799036 14508 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:50.853237 14508 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.856168 14508 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:50.861029 14511 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.861660 14511 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.864166 14511 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:50.865365 14451 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:50.808893 14583 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:50.800401 14486 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.799347 14387 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.868637 14583 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.798769 14413 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:50.866112 14505 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:50.889111  8837 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:50.910778  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 573873us
I20260709 13:17:50.916009 14505 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:50.918121  8836 raft_consensus.cc:1240] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 13:17:50.976614  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 227177us
I20260709 13:17:50.979408  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:51.004566  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 267859us
I20260709 13:17:51.005501  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:51.006090  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 267386us
W20260709 13:17:51.008111  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 96205.8us
I20260709 13:17:51.016153  8735 leader_election.cc:400] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:51.016747  8735 leader_election.cc:403] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:51.027269  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:51.029960  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:51.030544  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:50.949290 14600 consensus_queue.cc:1059] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:17:51.032099  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:51.033859  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.005707 14508 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.009904 14509 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.023352 14568 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:51.044559  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:51.044852  8837 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:51.049242  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.033787 14590 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.037269 14581 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.056247  8836 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:51.041847 14595 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:51.046170 14483 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:51.042106 14511 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.040019 14603 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.043025 14508 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.067576 14511 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.068162 14568 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:51.068959 14598 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.074633 14486 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.055485 14509 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 19.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:51.086766 14387 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:51.070011 14483 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.094357 14511 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.078680 14603 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.128288 14603 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:51.136258 14602 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:17:51.160904 14509 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:51.161388 14568 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.161535 14509 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.163818 14509 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:51.164996 14509 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:51.109339 14598 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.165683 14509 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.167534 14598 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.169086  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:51.171126 14509 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:51.174916 14483 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.177031 14508 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:51.179283 14538 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:51.179900 14538 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:51.182852 14538 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.185793 14472 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.192718  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:51.193416  9461 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.198866  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:51.201366  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.202685  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.203830  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.204430  8836 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:51.205300  9461 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:51.208287 14590 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
W20260709 13:17:51.215911 14599 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.254s	user 0.004s	sys 0.000s
I20260709 13:17:51.216368 14511 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.219237 14511 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.212852 14581 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:51.221570 14596 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:17:51.229188 14410 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:51.229792 14410 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:51.230979 14410 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.233848 14528 raft_consensus.cc:3055] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:51.234403 14528 raft_consensus.cc:740] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:51.235421 14528 consensus_queue.cc:260] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:51.261893  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.263314  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:51.264621 14590 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:51.265102 14590 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.265527 14590 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.265831  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:51.266601  8840 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.268751  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:51.273696  8838 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:51.275293  8912 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:51.275836  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.281160  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.283978  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:51.284278 14486 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.285055 14486 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.284374  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.286358  8842 raft_consensus.cc:2410] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:51.286514 14583 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.287643 14486 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.288375 14583 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.290037 14590 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.296643 14211 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:51.291620  8914 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:51.299224  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:51.292049  8840 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:17:51.236769 14528 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.293905  8917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 600) took 1102 ms. Trace:
I20260709 13:17:51.307330  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:51.315748  8917 rpcz_store.cc:276] 0709 13:17:50.191001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.191174 (+   173us) service_pool.cc:224] Handling call
0709 13:17:50.191483 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.574228 (+382745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.574264 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.574726 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.867681 (+292955us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:17:50.867739 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.867907 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.215221 (+347314us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:51.293554 (+ 78333us) raft_consensus.cc:1685] finished
0709 13:17:51.293584 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.293833 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":382367,"raft.queue_time_us":383339,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13683,"spinlock_wait_cycles":23696640,"thread_start_us":292606,"threads_started":1,"wal-append.queue_time_us":386671}
I20260709 13:17:51.317541  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.232614 14410 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:51.309247  8838 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:51.319465  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:51.278187 14505 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.313858  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:51.185562 14538 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:51.312885  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:17:51.308566  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 266148us
W20260709 13:17:51.345492  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 43931.5us
I20260709 13:17:51.319478  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.322883  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:51.315116  8662 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 4 to 9, term changed from 9 to 10, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67), VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.352691  8662 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 14, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.354453  8840 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:51.355051  8766 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:17:51.355569  8735 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:51.335462 14583 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.357465  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.358525  8766 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:51.360723  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.361848  8766 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:51.342564 14598 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.319940 14581 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:51.367403  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:51.349543 14565 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:51.356802 14511 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:51.391021  8766 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:51.393018  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:51.364626 14603 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:51.405638  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:51.399746  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.401144  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:51.402740  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:51.404065  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.348497 14505 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.384172 14590 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.431617 14486 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:51.432346 14486 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.432816 14486 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.434000 14384 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.434563 14384 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.436515 14565 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:51.437480 14565 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.438948 14384 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:51.441100  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54213.7us
W20260709 13:17:51.442173  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49232.8us
I20260709 13:17:51.443461  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:51.444392 14608 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:17:51.449097 14388 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:51.452831  8882 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:51.454255 14388 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:51.458295 14375 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.458899 14375 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.461313 14375 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:51.461517 14614 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:17:51.390965 14581 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:51.465811  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:51.397783 14508 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:51.405548 14511 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:51.403823 14523 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.472923  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:51.488037  8768 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:51.384822 14598 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.375419 14583 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.490267  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.495720  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:51.492254  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.494827  8761 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:17:51.496296  8766 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:17:51.491968  8769 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:51.498008  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.498701  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.499459  8766 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:51.505659  8766 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:51.505983  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.520744 14493 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:51.522540  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.489575 14445 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:51.534957  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.500762 14593 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:51.501720 14619 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:51.522529 14508 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:51.634341  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 134763us
I20260709 13:17:51.502188 14523 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.534004 14493 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.637933 14508 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:51.668728  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 345904us
I20260709 13:17:51.633999 14483 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:51.703608  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 270055us
W20260709 13:17:51.707345  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.716463  8764 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:17:51.695278 14616 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:17:51.659857 14445 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:51.693889 14508 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.687999 14603 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:51.753676 14623 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:51.754479 14603 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.696344 14590 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.757264 14590 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.760200 14590 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.634286 14581 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.761600 14505 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.635880 14593 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.637651 14619 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.774699 14619 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:51.777547 14615 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:17:51.666442 14511 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:51.781553 14618 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:17:51.782776 14559 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:51.783284 14559 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:51.787854 14493 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:51.788757  9467 raft_consensus.cc:2410] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:17:51.791465  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:51.792626  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.736240 14624 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.698324 14483 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:51.796555  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:51.781575 14598 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:51.822933  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 167467us
I20260709 13:17:51.827298  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:51.830766  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:51.856473  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:51.857913  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:51.829252  8662 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.859858  8662 catalog_manager.cc:5697] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.867746  8662 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.869418  8662 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 14 to 15, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.872327  8662 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 14, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 14 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.874488  8662 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 8 to 11, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 11 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.877969  8662 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 17 to 18, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 18 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.814254 14538 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:17:51.881986  8662 catalog_manager.cc:5697] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.895462  8662 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 7 to 14, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.897297  8662 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 16 to 19, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 19 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:51.898792  8662 catalog_manager.cc:5697] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 6 to 8, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 8 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:51.875779 14384 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:51.875578 14535 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:51.904851 14483 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:51.828329 14375 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:17:51.906448  8912 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:17:51.865351 13937 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:51.889196 14581 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.916610  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:51.890825  8665 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 221) took 62950 ms (client timeout 15000 ms). Trace:
I20260709 13:17:51.917313  8913 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:51.891191 14621 log.cc:927] Time spent T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:17:51.892813 14445 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.905483 14483 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.888302  8917 raft_consensus.cc:1240] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:51.889986 14634 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.870407 14493 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.910946  8910 raft_consensus.cc:1240] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:51.912528  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:51.824674 14472 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:51.902040 14630 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.865041 14633 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.950598  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:51.932413  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:51.886662 14583 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:51.816488 14624 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.940042  8918 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:51.952814  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:51.960189  8841 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:51.963078  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:51.967887  8913 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:51.930194 14359 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:51.975813  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:51.975919  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 145721us
I20260709 13:17:51.908985 14505 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:17:51.938684 14601 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:51.982609  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:51.978492  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:17:51.978827  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 144950us
I20260709 13:17:51.987134  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.987507  8763 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:51.987784  8764 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:52.001351  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:52.002883  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:52.007145 14493 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.977887 14359 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.007902 14493 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.008394 14493 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.008308 14624 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.009132 14566 raft_consensus.cc:993] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:17:52.009753 14359 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:51.917387  8665 rpcz_store.cc:269] 0709 13:16:48.940735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:49.034745 (+ 94010us) service_pool.cc:224] Handling call
0709 13:17:51.890726 (+62855981us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:49.619791 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:49.620344 (+   553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:49.620374 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:17:49.620396 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:49.620981 (+   585us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:49.621038 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:49.621064 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:17:49.621393 (+   329us) tablet.cc:701] Row locks acquired
0709 13:17:49.621412 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:17:49.621548 (+   136us) write_op.cc:270] Start()
0709 13:17:49.621651 (+   103us) write_op.cc:276] Timestamp: P: 1783603069621505 usec, L: 0
0709 13:17:49.621672 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:17:49.622365 (+   693us) log.cc:844] Serialized 1308 byte log entry
0709 13:17:49.956007 (+333642us) op_driver.cc:464] REPLICATION: finished
0709 13:17:50.150566 (+194559us) write_op.cc:301] APPLY: starting
0709 13:17:50.156293 (+  5727us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:50.358589 (+202296us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:50.358746 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:50.522258 (+163512us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9732a 00007fce6fd1cf14 00007fce6fd1cec3 00007fce6fd1ce38 00007fce6fd1cdf3 00007fce6fd1c0dc 00007fce6fd45e16 00007fce6fd2dcbb 00007fce6fd1839d 00007fce6fd1bd75
0709 13:17:50.622062 (+ 99804us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:50.695037 (+ 72975us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:17:50.705375 (+ 10338us) write_op.cc:312] APPLY: finished
0709 13:17:50.723996 (+ 18621us) log.cc:844] Serialized 41 byte log entry
0709 13:17:50.729842 (+  5846us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:50.733601 (+  3759us) write_op.cc:454] Released schema lock
0709 13:17:50.739351 (+  5750us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:50.777282 (+ 37931us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:50.790474 (+ 13192us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":72861,"reported_tablets":54,"child_traces":[["op",{"apply.queue_time_us":169425,"apply.run_cpu_time_us":12173,"apply.run_wall_time_us":621613,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":469847,"prepare.run_cpu_time_us":10565,"prepare.run_wall_time_us":113287,"raft.queue_time_us":155570,"raft.run_cpu_time_us":67180,"raft.run_wall_time_us":580195,"replication_time_us":334171,"spinlock_wait_cycles":4450176,"thread_start_us":652648,"threads_started":4,"wal-append.queue_time_us":107975,"wal-append.run_cpu_time_us":12499,"wal-append.run_wall_time_us":2044215}]]}
I20260709 13:17:51.931705 14581 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.825450 14559 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:51.999756  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.942327 14483 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.029048  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:51.980340 14523 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.035105  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:52.037061 14359 raft_consensus.cc:1081] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:17:52.045924 14511 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:52.046355 14511 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.045096  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:52.049093  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 174988us
I20260709 13:17:52.054607  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:52.040918 14486 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 13:17:52.013463 14472 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:52.066401  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:51.972527 14634 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.072222  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:52.074167  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48797.9us
I20260709 13:17:52.044066 14593 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:51.974943 14630 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.109002  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:52.109459  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54930.1us
I20260709 13:17:52.128721  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:52.109710  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:52.108485  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:52.072156 14410 consensus_meta.cc:287] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.001s
I20260709 13:17:52.092905  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:52.075290  8917 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:17:52.089308  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.090307  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:52.018328 14601 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.119463 14388 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:52.120688  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 113180us
I20260709 13:17:52.050783 14511 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.068619 14551 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.138414  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.276678  8839 raft_consensus.cc:2410] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:17:52.173601  8844 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:17:52.172748  8769 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
W20260709 13:17:52.266230  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 176160us
I20260709 13:17:52.268530  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:52.273562  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 144951us
I20260709 13:17:52.279296  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:52.278419  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.108263 14641 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:52.074847 14645 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.281698  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:52.281410  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:52.072851 14486 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.120401 14650 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.258392 14583 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.264182 14388 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.260032 14633 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.269909 14566 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:52.314620  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:52.296254 14509 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:52.323027  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43842.7us
I20260709 13:17:52.323920  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:52.302820  8761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.024s	sys 0.012s
I20260709 13:17:52.264175 14527 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.271733 14624 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.336686 14624 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:52.337582 14646 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:17:52.338801 14601 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.338965 14624 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.339613 14624 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:52.340018 14625 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.515s	user 0.001s	sys 0.013s
I20260709 13:17:52.340130 14624 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.286445 14565 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.304003 14375 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.333529 14384 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:52.334213 14527 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.335680 14636 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.336102 14632 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:52.327201 14546 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.341408 14608 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:52.347630  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:52.329905  8761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.024s	sys 0.012s
I20260709 13:17:52.309258 14388 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:52.384274 14658 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:17:52.385883 14652 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:17:52.386444  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:52.386929 14632 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.388206 14653 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.388769 14653 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.389650 14483 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.390884 14653 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.391485 14607 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:52.308966 14583 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.349736 14631 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:52.332135  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 67542.1us
I20260709 13:17:52.328789 14650 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.299037 14603 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.297423 14641 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.327740 14566 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.302302 14551 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:52.462599  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.425922 14634 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.427896 14631 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.321807 14633 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.435137 14583 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:52.441141 14639 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.388s	user 0.000s	sys 0.001s
I20260709 13:17:52.442591 14493 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:52.444777 14647 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.324s	user 0.000s	sys 0.000s
I20260709 13:17:52.355928 14565 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.530808  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.451946  9467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54292 (request call id 819) took 1259 ms. Trace:
I20260709 13:17:52.452441 14624 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:52.455236 14528 consensus_meta.cc:287] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 1.134s	user 0.010s	sys 0.003s
I20260709 13:17:52.547468  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.513829 14472 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.548441  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.471880 14660 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:52.474439 14486 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.476851 14551 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.462656 14603 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.479615 14527 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.481143 14630 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.405007 14636 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.484249 14641 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.488462  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:52.490195  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:52.393447 14608 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
W20260709 13:17:52.412230 14508 consensus_meta.cc:287] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.002s
I20260709 13:17:52.623709  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.489889  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:52.625293  8768 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:52.626256  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:52.626948  8768 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.450085 14581 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.532421  8842 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 15.
I20260709 13:17:52.461817 14413 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.533998  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:52.534406  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:52.535156 14656 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:52.643898 14656 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:52.644973 14662 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:17:52.645262 14445 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.645828 14445 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.646251 14656 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.647341 14493 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.649168 14445 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.650559 14633 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.623863 13937 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.651400  8844 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:52.651636 13937 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.652982 14546 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.653517 14546 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.654325 13937 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.655490 14546 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.623356 14608 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.656615 14413 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.536075  8917 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:52.536332  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:52.541548  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:52.494452 14631 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.630992 14508 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.545856  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.543828  9467 rpcz_store.cc:276] 0709 13:17:51.192311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.198532 (+  6221us) service_pool.cc:224] Handling call
0709 13:17:52.451623 (+1253091us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400650ed4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:52.451833 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1346409216}
I20260709 13:17:52.470570 14566 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.522018 14601 consensus_queue.cc:1059] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:17:52.531301 14583 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:52.571918  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 248083us
I20260709 13:17:52.604492  9465 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.628911  8839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:17:52.578089 14486 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:52.642995  8912 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:52.643348  8836 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:52.658722  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.676945  8840 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:52.659703  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.661018  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.663616  8910 raft_consensus.cc:2368] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:52.665239  8837 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 9.
I20260709 13:17:52.659277  9459 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:17:52.556536 14472 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.679033  8843 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
W20260709 13:17:52.660332 14670 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:17:52.663298 14508 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.661109 14672 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.658856 14413 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.691332 14565 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.692380 14472 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.692695 14672 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.667318 14511 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.677356 14583 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.681452 14486 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.704995 14636 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.656833 14388 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.695118 14672 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.713320  9465 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:52.708833 14660 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:52.716764 14660 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
W20260709 13:17:52.717384 14663 log.cc:927] Time spent T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:17:52.717865 14583 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.717631 14660 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.707379 14345 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:52.721757 14486 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.723536 14511 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.724385 14608 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.724758 14603 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.727924 14631 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.718861 14345 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:52.772449  8734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.015s	sys 0.049s
W20260709 13:17:52.792279  8734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.016s	sys 0.050s
I20260709 13:17:52.774468  8760 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:17:52.552886  8762 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:52.528122  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 2328) took 1123 ms. Trace:
I20260709 13:17:52.780720  8839 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:17:52.783540  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 95781.6us
W20260709 13:17:52.789388  9434 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.735615 14608 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.733614 14631 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.833649 14413 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:17:52.889742  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:52.867611  8915 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:52.893040  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:52.894590 14608 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.893954 14413 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:52.896416 14413 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:52.899387  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.899569  8839 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:52.873476  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:52.886976  8767 rpcz_store.cc:276] 0709 13:17:51.405236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.405378 (+   142us) service_pool.cc:224] Handling call
0709 13:17:52.527848 (+1122470us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001a8954. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:52.528047 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110473088}
I20260709 13:17:52.903313 14413 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:52.905620 14388 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:52.911258  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:52.922191 14684 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.923454 14684 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:52.924542  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:52.926030 14603 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:52.927309 14684 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:52.928125 14505 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:17:52.932082 14660 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.945525  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:52.949819  8762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60042 (request call id 2318) took 1632 ms (client timeout 2001 ms). Trace:
W20260709 13:17:52.957971  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47069.8us
W20260709 13:17:52.958948  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51699.5us
I20260709 13:17:52.968186 14632 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:52.970369  8841 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:52.972703  8835 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:52.974383  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.975267  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.980288  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:52.983494  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:52.986820  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 394234us
I20260709 13:17:52.991544  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:52.992017  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:52.996312  8762 rpcz_store.cc:269] 0709 13:17:51.317123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.317286 (+   163us) service_pool.cc:224] Handling call
0709 13:17:52.949365 (+1632079us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400198a54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:52.949596 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2839364992}
I20260709 13:17:53.015884  8838 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:17:53.022964 14559 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.028347  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2527) took 1012 ms. Trace:
I20260709 13:17:53.029235 14603 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:53.006757 14666 log.cc:927] Time spent T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.509s	user 0.000s	sys 0.004s
I20260709 13:17:53.036159  8763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2340) took 1048 ms. Trace:
I20260709 13:17:53.036578  8763 rpcz_store.cc:276] 0709 13:17:51.987801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.036674 (+ 48873us) service_pool.cc:224] Handling call
0709 13:17:52.037051 (+   377us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.043333 (+  6282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.043380 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:52.066968 (+ 23588us) log.cc:844] Serialized 52 byte log entry
0709 13:17:52.279407 (+212439us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:17:52.306778 (+ 27371us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.467461 (+160683us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b18003cf4c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:52.622853 (+155392us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b18003cf4c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce737923c7 00007fce6fda49a7 00007fce6fdb40bf 00007fce6fdb4038
0709 13:17:52.623094 (+   241us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.623323 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.623398 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.899865 (+276467us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18003cf4c0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:52.975870 (+ 76005us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:53.035701 (+ 59831us) raft_consensus.cc:1685] finished
0709 13:17:53.035723 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.035995 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":502668,"prepare.queue_time_us":350873,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":95899,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":14522,"spinlock_wait_cycles":149941248,"thread_start_us":158422,"threads_started":1,"wal-append.queue_time_us":239776}
I20260709 13:17:53.030102  8761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 2517) took 1524 ms. Trace:
I20260709 13:17:53.042299  8809 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:53.028929  8769 rpcz_store.cc:276] 0709 13:17:52.015524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.308573 (+293049us) service_pool.cc:224] Handling call
0709 13:17:52.308820 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.873876 (+565056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.873952 (+    76us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.874030 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:52.874062 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.027858 (+153796us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540021e154. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:53.027905 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.028164 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083971840}
I20260709 13:17:53.052953  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 2422) took 1075 ms. Trace:
W20260709 13:17:53.059120  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 114033us
I20260709 13:17:53.053471  8910 rpcz_store.cc:276] 0709 13:17:51.977582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.978021 (+   439us) service_pool.cc:224] Handling call
0709 13:17:53.050918 (+1072897us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54000384d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:17:53.052657 (+  1739us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562282752}
I20260709 13:17:53.068399  9459 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:53.060907 14682 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.060719 14603 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.075901  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.078565  8837 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:17:53.082113  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.068795 14501 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:53.076670  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.039320  8761 rpcz_store.cc:276] 0709 13:17:51.505476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.506960 (+  1484us) service_pool.cc:224] Handling call
0709 13:17:51.507332 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.696131 (+188799us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:51.735883 (+ 39752us) log.cc:844] Serialized 14 byte log entry
0709 13:17:52.381756 (+645873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:52.381807 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:52.381853 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.029595 (+647742us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540037a354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:17:53.029655 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.029915 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":51689,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2462,"raft.queue_time_us":9180,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"spinlock_wait_cycles":433576832,"thread_start_us":632018,"threads_started":1,"wal-append.queue_time_us":679639}
I20260709 13:17:53.091105  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.092693  8837 raft_consensus.cc:2410] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:53.097321  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:53.098097  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.085397 14682 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:53.104879  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.106182  8915 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:17:53.105974 14682 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.088511 14501 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:53.109251 14501 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:53.110294  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:53.114957  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:53.115883  8844 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.125672 14413 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:53.130716  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 119767us
I20260709 13:17:53.131690  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:53.136649 14636 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:53.137136 14636 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.137527 14636 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:53.143281  8839 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.148758  8836 raft_consensus.cc:2393] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:53.153204  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.153541  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.153999  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.157439  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.128196 14603 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.160311  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.171217  8844 raft_consensus.cc:2468] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:53.170457  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.174731  8912 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:53.178027  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.176731  8912 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:53.179332  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:53.179702  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.180330  8840 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:53.180085  8912 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.177654  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.189953  8912 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.196982  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:53.198086  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.199404  8841 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:53.209599 14345 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:53.211889  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.214622 14505 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:53.216491  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:53.216990  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.217300  8765 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.224061  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.219521  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.232625  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.232692  8918 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:53.236899  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.253181  8768 consensus_meta.cc:287] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.009s
I20260709 13:17:53.253670  8768 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:53.260592  8839 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.228468 14603 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:53.269367  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.270203  8918 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
W20260709 13:17:53.271008  8884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.273629  8912 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
W20260709 13:17:53.267545  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 170450us
I20260709 13:17:53.229148 14523 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:53.290925  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.291654 14523 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.292446  8914 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:53.286648  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:53.287379  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.292300 14590 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:53.298520 14590 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.301383  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.304200  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.260272 14501 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.274217  8912 pending_rounds.cc:85] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:17:53.306813  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:53.315186 14684 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.315959 14684 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:53.315501  8807 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.67:39883 timed out after 1.535s (SENT) [suppressed 1 similar messages]
I20260709 13:17:53.331059  8765 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:53.268712 14603 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:53.320032  8912 pending_rounds.cc:107] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:17:53.327754 14501 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.333913  8912 raft_consensus.cc:2889] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:53.337158  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:53.348100  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.334673 14603 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:53.351397 14384 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:53.351752  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:53.352149 14384 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.353246  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.322082 14636 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.362396  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.343418 14505 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:53.374343  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.374557 14505 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.377362  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.378695 14632 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:53.379359 14632 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.390004  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.393136  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:53.394129  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51088.2us
I20260709 13:17:53.364373 14620 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.368002 14636 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.364789 14590 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.406260  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.367455 14523 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.383944 14384 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.365233 14527 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:17:53.414541  8735 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:53.429004  9467 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:17:53.429317  8839 raft_consensus.cc:1240] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:53.431901  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.441319  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.446079  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.410127 14620 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.431493 14505 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.454289  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.443969 14684 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.451504 14636 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:53.462970  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.461880  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.464654  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.462364  8909 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:53.473273  8883 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:53.474498 14559 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:53.475081 14559 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:53.478155 14446 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:53.478878 14446 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.459326 14632 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.482416  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:53.483378  8909 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:53.485287  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.486003  8918 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:53.493551  8839 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:53.495247  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:53.498864  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.496165  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.451716 14523 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:17:53.491320 14636 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:53.476151 14559 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.450376 14384 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:17:53.501915  8916 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:17:53.507524  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:53.511013  8915 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:53.511425  8915 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:53.507001 14636 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.511919  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.520519  8915 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.528216  8768 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:53.544243 14620 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:53.545086 14527 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:53.545979 14527 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.533319 14632 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:17:53.546954 14632 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:53.547363 14632 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:53.555166  8915 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.537431 14446 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:53.555361  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.563865 14682 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.564402 14682 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.564785 14682 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.551218 14527 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.575479  8768 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:53.568970 14590 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:53.581624  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 128236us
W20260709 13:17:53.581395 14693 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:17:53.592722  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90663.1us
I20260709 13:17:53.610781  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.622793  8662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 100) took 6249 ms. Trace:
I20260709 13:17:53.575567 14620 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:17:53.631711  8915 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:53.635569  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.623282  8662 rpcz_store.cc:276] 0709 13:17:47.412485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.417409 (+  4924us) service_pool.cc:224] Handling call
0709 13:17:53.622546 (+6205137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:52.297316 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:52.421179 (+123863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:52.421218 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:17:52.421239 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:52.422910 (+  1671us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:52.422998 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:52.423044 (+    46us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:17:52.424710 (+  1666us) tablet.cc:701] Row locks acquired
0709 13:17:52.424736 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:17:52.491157 (+ 66421us) write_op.cc:270] Start()
0709 13:17:52.516260 (+ 25103us) write_op.cc:276] Timestamp: P: 1783603072465920 usec, L: 0
0709 13:17:52.516305 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:17:52.627724 (+111419us) log.cc:844] Serialized 5214 byte log entry
0709 13:17:52.740348 (+112624us) op_driver.cc:464] REPLICATION: finished
0709 13:17:52.869093 (+128745us) write_op.cc:301] APPLY: starting
0709 13:17:52.929634 (+ 60541us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:53.086256 (+156622us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:53.110231 (+ 23975us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:53.470710 (+360479us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:53.471069 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:17:53.471141 (+    72us) write_op.cc:312] APPLY: finished
0709 13:17:53.471712 (+   571us) log.cc:844] Serialized 121 byte log entry
0709 13:17:53.479193 (+  7481us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.479491 (+   298us) write_op.cc:454] Released schema lock
0709 13:17:53.479557 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:53.480182 (+   625us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:53.480216 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":494231,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":1131,"apply.run_cpu_time_us":27015,"apply.run_wall_time_us":738398,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58389,"num_ops":13,"prepare.queue_time_us":361878,"prepare.run_cpu_time_us":34751,"prepare.run_wall_time_us":452891,"raft.queue_time_us":2279,"raft.run_cpu_time_us":1829,"raft.run_wall_time_us":136799,"replication_time_us":216635,"thread_start_us":302713,"threads_started":4,"wal-append.queue_time_us":64241}]]}
I20260709 13:17:53.640992 14642 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:53.642375 14642 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.645192 14111 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.645933 14111 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.651412 14527 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.650369  8666 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 13, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 13 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.631907 14384 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.654150 14384 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.661569 14384 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.673923  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.676342  8916 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:53.678659  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50323.9us
I20260709 13:17:53.680444  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:53.681198  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 51469.7us
I20260709 13:17:53.681627  8666 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 9 to 14, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:53.683282  8666 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 12, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:53.691648  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.695695 14387 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.697019 14642 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.699122 14387 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:53.699656 14387 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.700470  8666 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 13 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.703140  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:53.703850  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.704687  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:53.705195  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.705201  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:53.706168  8764 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.706714 14111 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:53.706188  8762 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 21: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:53.707897  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.704733  8760 raft_consensus.cc:2410] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:53.708813  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:53.712249  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.717309  8839 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:53.633911 14590 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.729121  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:53.719641  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:53.731881  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet e3a106d574bc4cfeaa6e7b1240430c4b with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:55342
I20260709 13:17:53.718907  8666 catalog_manager.cc:5697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 6 to 10, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:53.740590  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:53.741323  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:53.744293  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.741384  9465 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
W20260709 13:17:53.764475  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 200694us
I20260709 13:17:53.758498  8836 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:53.770692  8666 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 11, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:53.774139  8768 raft_consensus.cc:2410] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
W20260709 13:17:53.779362  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51280.5us
W20260709 13:17:53.775884  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 142041us
I20260709 13:17:53.785075  8666 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 9 to 12, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:53.719055 14682 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:53.786849  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67284.8us
I20260709 13:17:53.788125  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:53.784799  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 160311us
I20260709 13:17:53.791721  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.803402  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.785388 14413 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.805384 14559 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:53.824244  9433 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.832437 14559 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.846470 14559 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.849151  9431 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.850116 14660 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:53.851227 14660 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:17:53.855054  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:53.858894 14698 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:53.859736  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:53.814337 14632 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.811424 14603 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.876852  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:53.877854  8912 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:53.870048  8666 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:53.856272 14523 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:53.888365  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 103297us
W20260709 13:17:53.897363  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105752us
I20260709 13:17:53.899719  8808 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:53.901453  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.901901 14682 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.905432  8732 leader_election.cc:400] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:53.906198 14632 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.906896 14632 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:53.907146  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.908250 14632 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:53.909751 14523 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:53.913415 14590 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.918300 14603 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.919196 14709 tablet_replica.cc:333] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:17:53.921610  8763 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:53.908521  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.922087  8837 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20. Ops: []
I20260709 13:17:53.929508  8839 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:17:53.931176  8764 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:53.933221  8912 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:17:53.934485 14590 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:53.937011 14697 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:53.937325 14590 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.938026 14387 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:53.939635 14704 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:53.940021 14590 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:53.934412 14632 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:53.940958 14632 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:53.941980 14632 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.942736  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.943253 14632 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.944092  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.944617  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:53.944698  8769 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:53.967918  8765 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:53.971481 14559 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:53.973023 14710 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.966554  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:53.965504  8884 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:53.980042  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49042.7us
W20260709 13:17:53.980810  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72372.4us
I20260709 13:17:53.981693  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:53.982354 14603 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.982959 14603 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.987910 14387 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:53.994362 14501 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:53.996306 14620 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.996920 14620 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.999163 14620 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:54.004791 14709 raft_consensus.cc:2243] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:17:54.006034 14709 raft_consensus.cc:2272] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:17:53.989522 14636 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:53.976420 14701 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:54.011611  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 124164us
W20260709 13:17:54.012519  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 79067.6us
I20260709 13:17:54.014675 14668 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:54.015110 14668 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:54.016441  8884 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.017177 14709 ts_tablet_manager.cc:1916] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:17:54.017468 14700 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.021660  8761 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.022799 14636 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.023196 14554 raft_consensus.cc:2804] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:54.023741 14554 raft_consensus.cc:697] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:54.024417  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.025419 14527 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.024716 14554 consensus_queue.cc:237] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.027334  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.028134 14527 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:54.030158 14708 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:54.030855 14708 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.038304  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:54.028651  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.017309 14387 raft_consensus.cc:2764] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:17:54.044787 14700 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.016397 14668 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.047340 14668 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.048520  8840 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:54.042548 14620 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:54.049451 14620 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.050010 14559 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:54.051546 14620 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:54.051712  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:54.052327  9461 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.054627  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.041551 14603 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.055446  8840 raft_consensus.cc:2393] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:54.057839  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.058640  8843 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:54.060320  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.041774 14636 consensus_queue.cc:1059] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:54.063508  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:17:54.064966  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 73030.8us
I20260709 13:17:54.065192  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.066409  8912 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:54.063580 14636 raft_consensus.cc:3055] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:54.067637 14636 raft_consensus.cc:740] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:54.068010 14710 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:54.068656 14710 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:54.068881 14636 consensus_queue.cc:260] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.072813 14636 raft_consensus.cc:3060] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.070268 14708 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.070302  8807 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:54.075112  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46557us
I20260709 13:17:54.075610  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.076023  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.076136  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.076828 14603 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.077402  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.078660  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.079034  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.079384 14707 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.079846 14701 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.080235  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf
I20260709 13:17:54.080853 14682 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:54.080631 14701 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.081282 14682 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:54.081740 14682 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:54.076793 14708 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.071908  8843 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:17:54.069610 14710 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.073491  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.090099  9462 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:17:54.098008  8843 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:17:54.113576  9461 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
W20260709 13:17:54.114221  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46446.9us
I20260709 13:17:54.117444  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.117628  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.118114  8916 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:54.118517  8912 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
W20260709 13:17:54.119973  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 98733.5us
I20260709 13:17:54.120880  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.122133  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:54.123343  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.124900  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:54.127355  8807 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.115666  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.116823  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.131209  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.135931 14527 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:54.138641 14700 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:54.139916 14590 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:17:54.140316 14590 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:54.142400  8735 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:54.141176 14590 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.130704  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:17:54.153272  8807 raft_consensus.cc:2686] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:17:54.174453  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53761.2us
I20260709 13:17:54.149379 14413 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.115288 14387 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:17:54.119311 14620 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 13:17:54.183043  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 55780.5us
I20260709 13:17:54.160993 14523 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:17:54.173625  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:54.191504  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 48393.5us
I20260709 13:17:54.174065 14505 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:54.192996  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46286.9us
I20260709 13:17:54.193694  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.195436  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:54.196234  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.187898 14111 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:54.186332 14413 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.199054  8807 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.196154 14717 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:54.189821 14707 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:54.210026 14703 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:54.178223 14720 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:17:54.196460 14523 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:54.221210  9461 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:54.207515 14413 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.233065 14724 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:17:54.236086 14724 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:54.206422 14559 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.227625 14631 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:54.201398 14620 consensus_queue.cc:1243] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:54.208446 14717 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:54.228955 14686 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:54.242834 14723 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.254091 14720 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:54.254524 14720 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:54.255584 14642 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:54.255474 14720 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.256009 14642 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:54.250902 14631 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:54.222993 14501 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:17:54.227994 14682 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.253572 14717 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:54.237476 14703 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:54.199786 14505 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.219432 14603 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.219918 14111 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:54.283367  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 91170.3us
W20260709 13:17:54.285362  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70753.8us
I20260709 13:17:54.262243 14703 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.266089 14523 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.8, Last appended by leader: 8, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.257332 14631 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.256832 14720 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.259415 14590 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:54.237876 14708 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:17:54.298303  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.221829 14707 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.267783 14725 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.263532 14709 ts_tablet_manager.cc:1929] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 13:17:54.297879 14668 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.305495  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.306182  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.267656 14505 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.312827  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.252146 14559 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.314484 14111 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.324923  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.271971 14413 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.350689 14707 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.350674 14413 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:54.335572  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.336678  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.343228 14682 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.345827 14709 log.cc:1199] T e3a106d574bc4cfeaa6e7b1240430c4b P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/e3a106d574bc4cfeaa6e7b1240430c4b
I20260709 13:17:54.345341 14725 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.347494 14559 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:54.334941 14668 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:54.348379  9431 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.356526  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 241275us
I20260709 13:17:54.279356 14642 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.407944 14642 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:54.409458  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 84714.2us
I20260709 13:17:54.410516  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.390376 14700 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.389889 14710 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:17:54.413231  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 209921us
I20260709 13:17:54.397450 14701 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:54.420817  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:54.421523  8912 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:54.416932  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.425927  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.429948  8843 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.428582  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:17:54.434445  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 222224us
I20260709 13:17:54.435846  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.435182  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.442116  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.437000  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.353632 14631 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.450460  8839 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:54.453774  8912 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:54.448679  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.435375 14700 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.455917 14684 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:54.475914 14684 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:54.476446 14684 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:54.474134  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.415400 14710 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.496762  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet e3a106d574bc4cfeaa6e7b1240430c4b (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:17:54.498940 14725 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:54.500420 14731 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:54.495255 14705 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:54.505604 14705 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:54.506469 14726 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:54.506587 14705 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.507261 14726 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.427090 14701 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.491547 14505 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:54.531160  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:17:54.519292  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 91246us
I20260709 13:17:54.518015 14720 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.544286  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.558113  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:54.568493  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 52632.2us
I20260709 13:17:54.579661  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.582633  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.598537 14726 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:54.536101 14505 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.601786 14505 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.556232 14668 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:54.605329 14631 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.542455 14724 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:17:54.607914  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.608640  8764 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 16.
I20260709 13:17:54.610580  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.611320  8764 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:54.615199  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.615795  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.616250  8769 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:54.618886  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.619887  8766 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:54.621469  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.631656  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.633198  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:54.633822  8918 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.637341  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:54.637998  9462 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:54.578811 14523 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:54.644917 14523 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:54.645542 14523 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.647521  8843 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:54.648123 14708 raft_consensus.cc:2764] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:54.650216 14725 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.650061  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:54.661928  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 213307us
I20260709 13:17:54.662786  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.673100 14701 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:54.656070  8734 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:54.680408  8918 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:54.650068 14700 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:54.683619  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.657016 14717 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.700623  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.700840  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.703018  8767 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:54.704197  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.704654  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.705252  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.705919  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.706570  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.707656  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.708249  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.709180  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.710280  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.710407 14710 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.712738  8884 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.713665 14446 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:54.714166 14446 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:54.715128 14501 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:54.714985 14446 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.717200  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.717849  8761 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:54.719529  8766 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:54.720376 14684 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.723265  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.725292  8662 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:54.726473  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 63779.6us
I20260709 13:17:54.726799  8767 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.746351  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:54.727459  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 71472.6us
I20260709 13:17:54.728082 14700 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:54.732159  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:54.710464  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.725351  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.748557  8762 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:54.746384  8662 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:54.750996  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.750813  8662 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:54.752241  8662 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 16, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:54.753482  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:54.756348  8765 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:54.756554  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.759160  8912 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:54.767102  8843 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:54.769286  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.770358  8763 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:54.774561  8769 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:17:54.776607  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.775597 14703 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:17:54.765641 14733 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:54.779740  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.755652 14523 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.782508 14668 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:54.779769 14703 consensus_queue.cc:1243] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer bdb96be202c2447586477b2077b7d5bf log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:54.783013 14668 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:54.783443 14668 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.780357 14755 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:17:54.784452  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.749922 14700 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:54.789523 14700 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.755615 14505 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:54.793375 14505 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:54.794430 14505 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.797506  8764 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:54.802934 14755 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:54.803583 14523 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.803699 14755 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:54.803973 14738 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:54.804603 14738 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.805459 14755 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.806888 14590 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.807967 14755 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.809417 14701 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:54.810431 14701 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:54.810799 14701 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:54.811703 14701 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.803076  8912 raft_consensus.cc:1217] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Deduplicated request from leader. Original: 13.8->[14.9-18.11]   Dedup: 14.9->[16.10-18.11]
I20260709 13:17:54.812697 14701 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:54.815270  8835 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:54.816545  8840 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:17:54.818372  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 72098.7us
I20260709 13:17:54.819945  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.820113 14746 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:54.821080 14111 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:54.821832 14111 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:17:54.822324 14751 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:54.822738 14111 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.824198 14738 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:54.824318  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:54.824998  8911 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:54.825820 14717 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:54.827981 14668 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.812909  8912 pending_rounds.cc:85] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:17:54.837054  8912 pending_rounds.cc:107] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:17:54.837459  8912 raft_consensus.cc:2889] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.821131 14684 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:54.829986  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:54.832307  8911 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:54.838891  8840 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:54.845059  8767 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:17:54.851502 14668 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:54.852586  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 92302.8us
I20260709 13:17:54.840312  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.854389  8839 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:54.856001  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:54.856520  8882 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.857026  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:54.856935  8840 raft_consensus.cc:2368] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:54.861114  8837 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 20: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:54.861318  8835 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:17:54.862999  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.863955  8767 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.864606  8918 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:54.866407  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:54.868057  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:54.870179  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.871541  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:54.873853 14715 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:17:54.874809 14715 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:54.875161 14715 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:54.876076 14715 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.876945 14723 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:54.879700 14684 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:54.881796 14684 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:54.881997 14734 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:54.882700 14684 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.883896 14752 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:54.857550 14717 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.912175  8767 raft_consensus.cc:2468] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:17:54.913846  8769 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:17:54.915781  9432 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:54.839509 14746 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:54.887526  8735 leader_election.cc:400] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:54.917852  8735 leader_election.cc:403] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:54.878023 14643 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:54.899245 14590 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:54.919674 14603 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.919847 14523 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:54.921077 14740 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:17:54.932210  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60908.3us
I20260709 13:17:54.924243  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:54.943431  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:54.949983  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:17:54.951086 14756 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:17:54.951215  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.969923 14723 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:54.935272 14668 raft_consensus.cc:2804] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:54.938649 14523 consensus_queue.cc:1243] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer 773340b2958e4af5b2010b902b9e9c04 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:54.927538 14746 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:54.960937 14715 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:54.991051  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.932449 14700 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:54.998749  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:54.999540  8769 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: [16.10-17.11]
I20260709 13:17:54.998374  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.005931  8765 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:17:55.009567  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.011693  8764 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 20: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:55.016669  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:55.019594  8766 raft_consensus.cc:1275] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:17:55.020133  8766 pending_rounds.cc:85] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 9
I20260709 13:17:54.987828 14668 raft_consensus.cc:697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:55.020334  8766 pending_rounds.cc:107] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:17:55.027129  8766 raft_consensus.cc:2889] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.996238 14554 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:55.030349 14700 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:55.031960 14746 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:54.938897 14740 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.034301 14740 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:55.002990 14723 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:17:55.041813 14723 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:55.042212 14723 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:55.043036 14723 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.044495 14723 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:55.056345  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 50705.7us
I20260709 13:17:55.059270  9462 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:55.070814 14668 consensus_queue.cc:237] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:55.071271 14740 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:17:55.072003 14603 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15.
I20260709 13:17:55.030357 14554 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:55.081344 14554 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:55.082206 14554 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.083544 14554 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.084153 14755 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:55.084607 14755 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:55.085650 14755 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:55.094352  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 151046us
I20260709 13:17:55.094507 14708 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.103487  8836 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
W20260709 13:17:55.104221  8666 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 220) took 31379 ms (client timeout 15000 ms). Trace:
I20260709 13:17:54.994905  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:55.113232  8808 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.118062  8760 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:55.119936 14752 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.127159  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:55.128491  8762 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:17:55.130976  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:55.131405  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:55.104674  8666 rpcz_store.cc:269] 0709 13:17:23.772229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.816916 (+ 44687us) service_pool.cc:224] Handling call
0709 13:17:24.075002 (+258086us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400002490. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc760b2 00007fce75befa89 00007fce75b87da6 00007fce75b59088 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc
0709 13:17:55.104112 (+31029110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:54.004553 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:54.005304 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:54.005360 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:17:54.005382 (+    22us) tablet.cc:662] Decoding operations
0709 13:17:54.006457 (+  1075us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:54.006555 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:54.006599 (+    44us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:54.007407 (+   808us) tablet.cc:701] Row locks acquired
0709 13:17:54.007456 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:54.007661 (+   205us) write_op.cc:270] Start()
0709 13:17:54.007813 (+   152us) write_op.cc:276] Timestamp: P: 1783603074007591 usec, L: 0
0709 13:17:54.007837 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:17:54.079430 (+ 71593us) log.cc:844] Serialized 3230 byte log entry
0709 13:17:54.184163 (+104733us) op_driver.cc:464] REPLICATION: finished
0709 13:17:54.341269 (+157106us) write_op.cc:301] APPLY: starting
0709 13:17:54.341351 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:54.505434 (+164083us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:54.505535 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:54.561649 (+ 56114us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:54.561976 (+   327us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:17:54.562046 (+    70us) write_op.cc:312] APPLY: finished
0709 13:17:54.562453 (+   407us) log.cc:844] Serialized 81 byte log entry
0709 13:17:54.562645 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.562780 (+   135us) write_op.cc:454] Released schema lock
0709 13:17:54.562835 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:54.563281 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:54.563329 (+    48us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":53,"spinlock_wait_cycles":81762048,"child_traces":[["op",{"apply.queue_time_us":139634,"apply.run_cpu_time_us":14358,"apply.run_wall_time_us":221991,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":78899,"prepare.run_cpu_time_us":4907,"prepare.run_wall_time_us":80524,"replication_time_us":176178,"thread_start_us":56582,"threads_started":2}]]}
I20260709 13:17:55.086675 14755 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:55.141635  8837 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:55.150954  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:55.158567  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.164137  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.169576 14752 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.170387 14752 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.165503  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.173521  8808 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.182142  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.165059 14631 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.184616 14703 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.186151 14752 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.171823 14707 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:17:55.224942 14682 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:55.251233  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 69181us
I20260709 13:17:55.256129  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.264261  9465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:55.274367  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:55.275501 14559 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.275936 14559 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:55.276355 14559 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.251374 14682 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:17:55.289549  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.263898 14631 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:17:55.296156  8911 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:55.283563 14632 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:17:55.314622 14764 log.cc:927] Time spent T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:17:55.296059 14750 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:55.317958 14750 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:55.319082 14387 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:55.319665 14387 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.321237  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:55.321537  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:55.325233  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:55.326723  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:55.327822  8918 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:55.326843  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:55.330972  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:55.331875  8910 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:55.290278 14682 raft_consensus.cc:3060] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.348343  8910 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:17:55.350893  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:55.320513 14750 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:55.354926  8840 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:55.361341  9465 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
W20260709 13:17:55.356349  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.360677  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:55.362957  8734 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
W20260709 13:17:55.370708  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 114681us
I20260709 13:17:55.371811  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:55.371861  8838 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:17:55.372529  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.372498  8918 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:17:55.377002 14684 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:55.378788  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:55.379556  8916 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 16: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:55.383178  8910 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 8. Preceding OpId from leader: term: 21 index: 9. (index mismatch)
I20260709 13:17:55.377308 14700 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:55.389859  8911 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:55.390311  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.393970  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.391537  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:17:55.395329 14770 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:17:55.395615  8766 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:55.372648  8838 pending_rounds.cc:85] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 8
I20260709 13:17:55.391537 14111 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:17:55.396512  8838 pending_rounds.cc:107] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:55.399313  8838 raft_consensus.cc:2889] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:55.356967 14708 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.401475 14387 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:55.392335  8909 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:17:55.405689  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.410175  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:55.423056  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 51104.8us
W20260709 13:17:55.425626  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.429118  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:55.431406  8808 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.433228  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.411573  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:55.454169 14708 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:55.454891 14603 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.455521 14603 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.456707 14710 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.456939 14559 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.457835 14710 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:17:55.458455 14710 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:55.459144 14559 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:55.459568 14710 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.424896 14684 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.409068 14700 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:55.477471  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:55.377112 14682 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.417199 14701 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:17:55.487154  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53859.7us
I20260709 13:17:55.464349 14603 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:55.436057 14387 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 13:17:55.490530  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.491357  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:55.465960 14590 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.441288 14733 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:17:55.501935 14700 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:55.512065 14720 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.512794 14720 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:55.513290 14720 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.513968 14750 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:55.514640 14750 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:55.528909  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44414.7us
I20260709 13:17:55.530418  8914 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:17:55.532568  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55172.4us
I20260709 13:17:55.533674  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:55.535430 14684 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:55.535997 14684 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
W20260709 13:17:55.537169  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46779.1us
I20260709 13:17:55.536943 14684 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.543040  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:55.544183  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 71505.9us
I20260709 13:17:55.546669  8835 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:55.550648  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:55.549223  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:55.558542 14111 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:17:55.561923 14705 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:55.562520 14705 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.557446  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:55.581897  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.590171  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:55.590895  9462 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:17:55.592216  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:55.594434 14750 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:55.603905  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:55.604138  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.604781  8762 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:55.604905  8760 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:55.607647  8764 raft_consensus.cc:1240] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:17:55.609516  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.609912  8767 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:55.546519 14766 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.604808  8766 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:17:55.611152  8767 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:55.621325  8762 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:55.611997  8763 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 10: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:55.564692 14705 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:55.638687  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.624898  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:55.595940 14717 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:55.637691  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 88585.1us
I20260709 13:17:55.639123 14774 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:17:55.639258 14779 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 13:17:55.659848  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.668100 14682 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:55.660954 14781 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.598237 14603 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:55.627996  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.631420  8766 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:55.624823 14620 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:55.678347  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:55.638214 14766 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:55.658617 14717 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:55.682178  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57396.8us
I20260709 13:17:55.639492 14632 consensus_queue.cc:1059] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:17:55.693492 14720 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.677764 14705 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:17:55.703672 14720 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:55.649873 14642 consensus_queue.cc:1048] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:17:55.686995  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:55.705215  8909 raft_consensus.cc:2368] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:17:55.679040 14620 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:17:55.715519 14620 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:17:55.706379  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 46594.3us
I20260709 13:17:55.705698  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:55.685738 14746 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.638921 14776 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:17:55.725770  8839 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.751533  8843 raft_consensus.cc:3055] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:55.752229  8843 raft_consensus.cc:740] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:55.751621 14620 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:55.753157  8843 consensus_queue.cc:260] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:55.754369  8662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 101) took 1836 ms. Trace:
I20260709 13:17:55.686947 14717 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.688102 14631 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:55.726341 14766 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:55.762909 14766 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.754458  8843 raft_consensus.cc:3060] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.771392 14776 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:55.798863 14620 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:17:55.801731 14784 log.cc:927] Time spent T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:55.805341  8912 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:55.806509 14717 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:55.809381  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:55.810279  8917 raft_consensus.cc:2393] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:55.811568 14717 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:55.812786  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:55.816612  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:55.817576  8807 leader_election.cc:400] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:17:55.827046  8807 leader_election.cc:403] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.805516  8839 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:55.825271  8763 raft_consensus.cc:2368] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:17:55.754856  8662 rpcz_store.cc:276] 0709 13:17:53.917648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.917863 (+   215us) service_pool.cc:224] Handling call
0709 13:17:55.754284 (+1836421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:54.995155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:55.012446 (+ 17291us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:55.012485 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:17:55.012501 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:55.013397 (+   896us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:55.013466 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:55.013492 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:55.013921 (+   429us) tablet.cc:701] Row locks acquired
0709 13:17:55.013941 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:17:55.014090 (+   149us) write_op.cc:270] Start()
0709 13:17:55.014217 (+   127us) write_op.cc:276] Timestamp: P: 1783603075014043 usec, L: 0
0709 13:17:55.014240 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:17:55.037318 (+ 23078us) log.cc:844] Serialized 1674 byte log entry
0709 13:17:55.260720 (+223402us) op_driver.cc:464] REPLICATION: finished
0709 13:17:55.537867 (+277147us) write_op.cc:301] APPLY: starting
0709 13:17:55.537951 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:55.592918 (+ 54967us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:55.612012 (+ 19094us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:55.638873 (+ 26861us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:55.639085 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:17:55.639139 (+    54us) write_op.cc:312] APPLY: finished
0709 13:17:55.639399 (+   260us) log.cc:844] Serialized 49 byte log entry
0709 13:17:55.640147 (+   748us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:55.641061 (+   914us) write_op.cc:454] Released schema lock
0709 13:17:55.641116 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:55.641529 (+   413us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:55.641570 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49905,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":260848,"apply.run_cpu_time_us":7361,"apply.run_wall_time_us":103638,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20823,"num_ops":4,"prepare.queue_time_us":182002,"prepare.run_cpu_time_us":4221,"prepare.run_wall_time_us":64505,"replication_time_us":235827,"thread_start_us":288541,"threads_started":2}]]}
W20260709 13:17:55.828540  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 83228.7us
I20260709 13:17:55.828279 14715 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:17:55.819113  8843 raft_consensus.cc:1275] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:17:55.836908  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:17:55.837018  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 150105us
W20260709 13:17:55.843390  8734 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.869402  8808 leader_election.cc:400] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:17:55.870959  8912 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:55.882594  8762 raft_consensus.cc:2468] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:17:55.884511  8808 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:55.839959 14682 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:17:55.872809 14603 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.911319  9461 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
W20260709 13:17:55.905402  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 66984.6us
I20260709 13:17:55.857606 14111 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:55.896849 14505 raft_consensus.cc:2804] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:55.855943 14781 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
W20260709 13:17:55.904917  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 62501.1us
I20260709 13:17:55.929021 14771 consensus_queue.cc:1048] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:17:55.933746 14631 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:55.894323 14559 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.941614  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.942016 14787 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:55.942219 14788 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:55.943589 14733 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.946712  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:55.949700  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:56.006964  8763 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:56.007159  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57565.4us
I20260709 13:17:55.951766  8766 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:56.007892  8732 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:55.955044  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 86177.8us
I20260709 13:17:55.952625  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:55.995397  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:56.010025  8762 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:56.013624  8764 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 21: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:17:56.009346  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:55.984531 14505 raft_consensus.cc:697] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:56.032829  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:55.954739 14603 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.050940  8763 raft_consensus.cc:2393] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 21: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
W20260709 13:17:56.057175  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 116492us
I20260709 13:17:56.034510 14527 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:56.041699 14734 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:17:56.105981  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 93872.1us
I20260709 13:17:56.045136 14636 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:56.114058  8761 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:17:56.135392  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 150233us
I20260709 13:17:56.026057 14733 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.159925  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:56.175462 14750 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:56.176074 14750 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:56.177143 14750 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.116617 14734 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:56.139995 14527 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:17:56.184515 14789 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
W20260709 13:17:56.292582  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49021.9us
I20260709 13:17:56.185066 14505 consensus_queue.cc:237] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:56.309496 14791 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:17:56.310792 14734 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:56.315790 14799 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 13:17:56.326867 14793 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:17:56.334697 14797 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
W20260709 13:17:56.335397 14792 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
W20260709 13:17:56.335541 14785 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:17:56.326869 14796 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:17:56.318040 14636 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:56.387224  8843 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:56.306223 14527 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.409762 14636 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:17:56.436093  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 136872us
I20260709 13:17:56.377368 14603 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:56.472262  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:56.481323  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:56.482322  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:17:56.476295  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:56.490056  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:56.490932  8912 raft_consensus.cc:606] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:56.491282  8912 raft_consensus.cc:614] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:56.492736  8911 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:17:56.493566 14816 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.494133  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:56.494414 14816 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:56.496155  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:17:56.542397  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 153638us
W20260709 13:17:56.549291  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105078us
I20260709 13:17:56.611959 14733 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:56.622586 14819 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:56.627143  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 112647us
I20260709 13:17:56.631309 14816 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:56.655632 14816 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.656231 14816 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.658358 14816 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:56.662238  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:56.678790  9467 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
W20260709 13:17:56.641634 14779 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:17:56.673135  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 63025.1us
W20260709 13:17:56.673897  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45976.5us
I20260709 13:17:56.674455 14819 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:56.665087 14590 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.693003 14755 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:56.700475  8769 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 2388) took 1092 ms. Trace:
I20260709 13:17:56.732816  8910 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:56.702001 14738 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.706758  8917 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:17:56.739179  8917 pending_rounds.cc:85] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 10
I20260709 13:17:56.739504  8917 pending_rounds.cc:107] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:17:56.707914  8918 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:56.724510  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:56.733204  8769 rpcz_store.cc:276] 0709 13:17:55.607698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.608097 (+   399us) service_pool.cc:224] Handling call
0709 13:17:55.608382 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:55.821753 (+213371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:55.821800 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:55.838625 (+ 16825us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.101266 (+262641us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:56.216951 (+115685us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.241287 (+ 24336us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.241379 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:56.495749 (+254370us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b180035e480. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:56.698025 (+202276us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b180035e480. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:56.700177 (+  2152us) raft_consensus.cc:1685] finished
0709 13:17:56.700205 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.700396 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45150,"prepare.queue_time_us":71235,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":55866,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":25306,"spinlock_wait_cycles":47503488,"thread_start_us":479117,"threads_started":3,"wal-append.queue_time_us":375016}
I20260709 13:17:56.728166  8767 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:56.739814  8917 raft_consensus.cc:2889] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.739782  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:56.753100  9462 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:17:56.752945  8883 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:56.755060 14788 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:17:56.738853 14590 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.760352  8768 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:17:56.761088 14738 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.765782 14738 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:56.732795 14755 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:56.775960 14720 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:56.776592 14720 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.777002 14720 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:56.779637 14816 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:56.792404  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:56.805856  8761 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:56.806309  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:56.811148  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:56.790012 14746 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:56.812419  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:56.817667  8910 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:17:56.829877  8917 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.850109  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:56.854655  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:56.844079 14752 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:17:56.869988 14590 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:56.875633 14703 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:56.876230 14703 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.876528 14802 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:56.876996 14631 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:56.820290 14603 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:56.817250 14746 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.885234  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:56.877208 14802 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:56.817111 14788 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260709 13:17:56.819224 14738 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:17:56.906780  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:56.884836 14746 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:56.842295 14781 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:17:56.877566 14631 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:56.829123 14826 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.085s
W20260709 13:17:56.965662  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54238us
I20260709 13:17:56.906308 14787 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:56.893952 14684 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:17:56.901472 14705 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:17:56.966904 14603 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:56.991415  8836 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:56.993893 14631 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:56.986104 14803 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:17:56.997694  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 179115us
I20260709 13:17:57.002259 14111 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.002883 14111 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.006683 14815 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:57.008541  9465 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:17:57.009672  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:57.010196 14642 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:17:57.010741  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 115824us
I20260709 13:17:57.013046  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.014261  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:57.014880  8914 raft_consensus.cc:606] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:57.015206  8914 raft_consensus.cc:614] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:57.019718 14111 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:17:57.021723 14829 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:56.968604 14804 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:57.025401  8768 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:57.027154  8765 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:17:57.033849  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:56.978757 14787 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:57.070705 14816 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:17:57.084164 14833 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:17:57.068517 14819 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:17:57.085407 14838 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.085965 14838 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.088165 14838 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:57.068638 14720 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.123138  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.117040 14703 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:57.138381  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:57.128330 14802 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:57.154099  8917 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:17:57.160545 14832 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.194s	user 0.004s	sys 0.000s
I20260709 13:17:57.167321  8807 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:57.170507  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.174284  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.177678  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.179270  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.189158 14755 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.190135 14720 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:57.190761 14839 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:57.192258 14834 log.cc:927] Time spent T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:17:57.192289 14787 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:57.196827 14845 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:57.199317  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:57.201035 14738 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.201617 14738 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.204653  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:57.205247  8769 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:57.178260 14803 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:17:57.208541 14803 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:57.208946 14803 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:57.213014  8769 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:17:57.190853 14821 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.219103  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.220388  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.219632  8662 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 15 to 19, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:17:57.222496  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 43482.5us
I20260709 13:17:57.223318  8662 catalog_manager.cc:5697] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.225330  8662 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 14 to 16, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:17:57.228392 14603 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:17:57.250330  8911 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:57.255162 14828 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:17:57.255791 14828 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:57.257378  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.257938 14828 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:57.262662  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.285249  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:57.287346  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.233520 14738 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:57.290684  8915 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:17:57.297166  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:57.302142  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.303289  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.228080 14821 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.308439 14821 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:57.319610  8807 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:57.330384 14845 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:57.331413 14845 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:57.331766 14845 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:57.333313 14820 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.337443  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:57.321691 14728 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:57.338723 14728 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:57.332705 14845 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.339742 14728 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.341274 14642 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.341807 14642 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.343482 14846 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:57.343860 14642 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:57.344141 14846 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:57.345203  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.344317 14746 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:57.309482 14752 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:17:57.378734 14803 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.346239 14845 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:57.385073  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.387823  8918 raft_consensus.cc:1240] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260709 13:17:57.388202  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:57.359144 14787 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.403625  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.404516  8841 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 10.
I20260709 13:17:57.429270  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:57.429736 14684 raft_consensus.cc:476] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Not starting pre-election -- already a leader
I20260709 13:17:57.429931  8914 raft_consensus.cc:606] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:57.431932  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:57.400420 14846 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:57.441295  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.446995  8841 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:17:57.444299 14803 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:17:57.454928  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.455514 14839 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:17:57.465655 14857 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:17:57.467707 14853 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:17:57.471665 14746 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:57.473059  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:57.492551  8913 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:17:57.484668  8840 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:57.494288  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:57.486104  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.491434  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.491648  8769 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260709 13:17:57.491899  8761 raft_consensus.cc:1275] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:57.497072  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:57.505120  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:57.515341 14787 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:57.520174 14413 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:57.509491 14752 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.520802 14413 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:57.523352 14413 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:57.525293  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:57.527237 14755 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.530498 14631 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.530941 14631 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.531296 14631 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.532292  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:57.509801  8735 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:57.549110  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:57.509514 14781 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.562863  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:57.564383  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:57.566551  8836 raft_consensus.cc:2410] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:17:57.555989  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 46263.3us
I20260709 13:17:57.556625 14839 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:57.556751  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:57.577167  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:57.607951 14820 consensus_queue.cc:1048] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:57.610973 14631 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.598187 14527 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:17:57.616429  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:17:57.623413 14859 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:17:57.633239  8767 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 20. Current term is 21. Ops: []
I20260709 13:17:57.639561  8839 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:57.634090 14828 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:57.642597  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:57.683964 14631 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:57.664315 14828 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
W20260709 13:17:57.729964  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 87476.6us
W20260709 13:17:57.731592  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 89069.8us
I20260709 13:17:57.733258 14720 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:57.734753  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:17:57.734802  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 45440.8us
I20260709 13:17:57.733332  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:57.761910  8884 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:57.762847 14446 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:57.763134  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:17:57.765954 14869 log.cc:927] Time spent T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.075s	user 0.006s	sys 0.000s
I20260709 13:17:57.765698 14803 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:57.767095 14803 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:57.767647 14803 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:57.768579 14816 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:57.771377 14523 consensus_queue.cc:1059] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:17:57.772544 14523 raft_consensus.cc:3055] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:57.773046 14523 raft_consensus.cc:740] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:57.769038 14816 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:57.773983 14816 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.773984 14523 consensus_queue.cc:260] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:57.776644 14642 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:57.775679 14803 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.785696 14803 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.791589 14523 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.803978 14708 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:17:57.804445 14708 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:57.805259 14708 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.806421 14708 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:17:57.811129 14816 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:57.813179  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:57.814155 14501 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.814585 14501 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.814955 14501 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:57.815485 14866 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.321s	user 0.006s	sys 0.007s
W20260709 13:17:57.818559 14870 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.133s	user 0.004s	sys 0.005s
I20260709 13:17:57.844492  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:57.855628  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:57.856278  8909 raft_consensus.cc:606] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:57.886530  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:57.890982  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:57.894748  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:57.884608 14816 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:57.919189 14728 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:17:57.940783 14867 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.352s	user 0.003s	sys 0.012s
W20260709 13:17:57.942024 14868 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.254s	user 0.008s	sys 0.000s
W20260709 13:17:57.982236  8667 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 179) took 92204 ms (client timeout 15000 ms). Trace:
W20260709 13:17:57.985132  8667 rpcz_store.cc:269] 0709 13:16:25.777437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.777704 (+   267us) service_pool.cc:224] Handling call
0709 13:16:27.560649 (+1782945us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b5400002490. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cc75b71 00007fce6cc760b2 00007fce75befa89 00007fce75b87da6 00007fce75b59088 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc
0709 13:17:57.982029 (+90421380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187055,"reported_tablets":51,"spinlock_wait_cycles":5731584}
W20260709 13:17:58.029548  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 112655us
I20260709 13:17:58.040143 14501 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.053231  8917 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:58.054260 14501 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:58.055536  8912 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:58.058885 14733 raft_consensus.cc:993] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:58.059584 14723 raft_consensus.cc:1081] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:58.059629  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:58.078956  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:58.078899 14816 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:58.089924  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:58.090703  8766 raft_consensus.cc:2410] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:58.101020  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:17:58.106630  8767 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:58.107487  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:58.119204  8767 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.109277  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:58.120401  8837 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:17:58.110303  8840 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:17:58.121284  8840 pending_rounds.cc:85] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 10
I20260709 13:17:58.121526  8840 pending_rounds.cc:107] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:17:58.121793  8840 raft_consensus.cc:2889] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.128182  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:17:58.128819  8917 raft_consensus.cc:606] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:17:58.129536  8912 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.132714  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:58.130324 14684 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.134780 14111 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:58.138958 14876 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.151026  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:17:58.153324 14738 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.156167 14803 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:58.157083 14803 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.157454 14803 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:58.158236 14803 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.159508 14803 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.164136  8765 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:17:58.170636 14876 raft_consensus.cc:993] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:58.171371 14876 raft_consensus.cc:1081] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:58.191609  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:58.197634  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:17:58.198232  8762 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:58.198335  8662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 102) took 2067 ms. Trace:
I20260709 13:17:58.198599  8762 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.196729  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:58.190723  8767 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:58.198679  8662 rpcz_store.cc:276] 0709 13:17:56.130737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.130918 (+   181us) service_pool.cc:224] Handling call
0709 13:17:58.198276 (+2067358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:57.404539 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:57.405131 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:57.405168 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:17:57.405187 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:57.405750 (+   563us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:57.405810 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:57.405844 (+    34us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:17:57.444846 (+ 39002us) tablet.cc:701] Row locks acquired
0709 13:17:57.444905 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:17:57.445074 (+   169us) write_op.cc:270] Start()
0709 13:17:57.445207 (+   133us) write_op.cc:276] Timestamp: P: 1783603077445022 usec, L: 0
0709 13:17:57.445232 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:17:57.498807 (+ 53575us) log.cc:844] Serialized 1293 byte log entry
0709 13:17:57.936368 (+437561us) spinlock_profiling.cc:243] Waited 8.15 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:17:58.031827 (+ 95459us) op_driver.cc:464] REPLICATION: finished
0709 13:17:58.095401 (+ 63574us) write_op.cc:301] APPLY: starting
0709 13:17:58.095491 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:58.155123 (+ 59632us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b18001b2bc0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad522 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:17:58.170554 (+ 15431us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:58.170580 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:58.172598 (+  2018us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:58.172955 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:17:58.173010 (+    55us) write_op.cc:312] APPLY: finished
0709 13:17:58.173468 (+   458us) log.cc:844] Serialized 41 byte log entry
0709 13:17:58.173640 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:58.173750 (+   110us) write_op.cc:454] Released schema lock
0709 13:17:58.173795 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:58.174194 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:58.174229 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":341395,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":63308,"apply.run_cpu_time_us":6377,"apply.run_wall_time_us":78778,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16649,"num_ops":3,"prepare.queue_time_us":159310,"prepare.run_cpu_time_us":20752,"prepare.run_wall_time_us":190493,"raft.queue_time_us":88439,"raft.run_cpu_time_us":26399,"raft.run_wall_time_us":65444,"replication_time_us":586391,"spinlock_wait_cycles":39362176,"thread_start_us":263342,"threads_started":4,"wal-append.queue_time_us":143459}]]}
I20260709 13:17:58.192618 14816 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:17:58.236055 14845 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:58.237666  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:58.238257  8837 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.233577  8762 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.246223  8765 raft_consensus.cc:1240] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:58.247738  8767 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:58.248732  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:17:58.249498  9461 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.251134  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:58.258064  8762 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:58.259519  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:58.260136  8913 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:58.260421  8913 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:58.236690 14845 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.256582 14876 consensus_queue.cc:1059] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:17:58.275686 14845 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:58.285094  8913 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.286536  8913 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.288543  8917 raft_consensus.cc:3055] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:58.291832  8917 raft_consensus.cc:740] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:58.295495  9461 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:58.296234  8837 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:58.297784  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:58.298782  8767 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:58.300031  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:58.296437  8917 consensus_queue.cc:260] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:17:58.312021 14882 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:17:58.314203  8917 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.319020  8735 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:58.304260 14774 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.323344  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:58.323980  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:58.326382  8841 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.322433  8664 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 17 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.328595  8912 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:58.330320  8664 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.327965 14774 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:58.344609  8664 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 15, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.349357  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet c79353780ac54a25bd9999800873bbeb with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:59034
I20260709 13:17:58.354954  8913 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:58.357060 14774 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.359805  8732 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:17:58.371376  8841 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:58.371910 14846 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.372582 14846 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:58.374084 14846 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.336054 14527 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.378067  8917 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
W20260709 13:17:58.379021 14876 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 13:17:58.379154  8664 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.380782  8664 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 14 to 16, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.384930  8664 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.387773 14816 raft_consensus.cc:993] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:58.388404 14816 raft_consensus.cc:1081] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:17:58.388504  8664 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.394050  8664 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.395479  8664 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.386598 14527 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:58.406351  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:17:58.407086  8767 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:58.407524  8767 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.410849 14527 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:58.433218  8767 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.435214  8664 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 14, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.461302  8767 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:58.464648  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:58.465948  8841 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.462044  8664 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:58.470899  8664 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.525851  8841 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:58.511929 14774 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.543639  8664 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 15, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.553951  8664 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.539881  8735 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:58.558310 14523 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:58.558960 14523 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:17:58.559804 14523 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.561214  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:58.561847  8913 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.562254  8913 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:17:58.563187  8913 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.577730  8664 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 16, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:58.587667  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 116548us
I20260709 13:17:58.601918  8664 catalog_manager.cc:5697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 13, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 13 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.610483 14774 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:58.628950  8664 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:58.641577  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 52071.1us
I20260709 13:17:58.651648  8839 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.656608  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:58.672755  8910 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 13: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:17:58.676324  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70379us
I20260709 13:17:58.675845  8664 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.682194  8664 catalog_manager.cc:5697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 17 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.684877  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:58.698689  8767 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:17:58.709589  8664 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 7 to 11, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 11 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:17:58.704526  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:17:58.725513  8664 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:17:58.728489  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 86966.2us
I20260709 13:17:58.719388 14774 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:58.796506  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62291.2us
I20260709 13:17:58.801056  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet c79353780ac54a25bd9999800873bbeb (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
W20260709 13:17:58.801679  8651 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58160us
I20260709 13:17:58.830374 14774 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:58.872771  8913 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.880339  8913 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:58.901481  8843 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:58.914731  9462 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:58.921082 14527 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:58.941721 14774 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:58.937963 14527 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 13:17:59.047809  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 51880.5us
I20260709 13:17:59.048110 14794 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:59.183692  8917 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:59.184026  8913 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:59.183692  8910 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:59.137590 14794 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:59.210701 14892 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:59.219012 14896 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:17:59.205633 14803 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:17:59.243350 14794 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.258992  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:59.260180  8766 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:17:59.304333 14801 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.305136 14801 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.307775 14801 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:59.339108  8837 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:59.366856  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:59.367792 14891 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:59.368342 14891 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:59.368825 14891 raft_consensus.cc:3060] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:59.442428  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57333.4us
I20260709 13:17:59.448195  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:59.482020 14755 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:59.487181 14755 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.488076 14755 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.490588 14755 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.501466  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:59.502382  8767 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:17:59.508183 14755 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.508992 14755 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.512164 14755 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.515136 14891 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:59.522020 14774 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.522760 14774 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.524938 14774 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.528025  8843 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:59.535744  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:59.545401  8768 raft_consensus.cc:2468] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
W20260709 13:17:59.548996  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 344911us
I20260709 13:17:59.557006 14900 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:59.557655 14900 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.560240 14900 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.590837  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:59.591560  8837 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:59.604640  9432 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:17:59.605846 14794 raft_consensus.cc:2804] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:59.606683 14794 raft_consensus.cc:697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:17:59.607728 14794 consensus_queue.cc:237] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:59.623351  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:59.624032  8837 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:17:59.518555 14891 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.634313 14733 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:17:59.635040 14733 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.637534 14733 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:17:59.650234 14846 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:59.653048  8735 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:59.654042 14846 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:59.654615 14846 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.655104 14846 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.682492  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:59.683894  8766 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:17:59.684803  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:17:59.685789  8768 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 11.
I20260709 13:17:59.682384  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:59.686106  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:59.686996  8917 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:17:59.693925  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:59.694711  8910 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:59.699043  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:59.699855  8912 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:17:59.692863 14755 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:59.702855  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:59.704427  8912 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:17:59.710863  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:17:59.709321  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:59.713027  8912 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:59.719624 14684 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:17:59.719766  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:59.720233 14684 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.720654 14684 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:59.720960 14838 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:59.721357 14838 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:17:59.721741 14838 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:59.730890  8766 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:59.732911 14900 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:59.741611  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:17:59.742444  8917 raft_consensus.cc:2393] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 17: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:17:59.704121 14755 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.730386 14846 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.766729  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:59.766918  8912 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:59.770331  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:17:59.755080 14755 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.786953 14684 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.789314 14774 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:59.791194 14838 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.794407 14846 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.797778  8841 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:17:59.826620  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:17:59.827392  8835 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.843747 14838 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.848038 14684 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.851166  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:59.851866  8762 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:17:59.861235 14446 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.861826 14446 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:17:59.863937 14446 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:17:59.864262  8762 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 22.
I20260709 13:17:59.870582  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:17:59.871598 14774 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:17:59.872255 14774 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:17:59.873478 14774 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.889748  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:17:59.916968 14755 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:17:59.919014  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:17:59.919781  8768 raft_consensus.cc:2368] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
I20260709 13:17:59.921160  8808 leader_election.cc:400] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
I20260709 13:17:59.921470  8808 leader_election.cc:403] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:59.925098 14774 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:59.943082  8835 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:17:59.934337 14755 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:17:59.969391  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:18:00.012763  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 237418us
I20260709 13:18:00.024706  8884 leader_election.cc:400] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:00.026121  8884 leader_election.cc:403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:00.027974 14734 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:00.034708  8735 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:18:00.021739  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 245612us
I20260709 13:18:00.039745  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:00.040781  8912 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 11: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:18:00.040978 14921 log.cc:927] Time spent T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:18:00.045053 14846 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:00.045775 14846 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:00.046825 14846 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:00.062561  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:00.063221  8767 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:18:00.068197 14527 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:00.068925 14527 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:00.071802  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:00.071318 14527 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:00.077383 14734 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
W20260709 13:18:00.092352 14914 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.099s	user 0.005s	sys 0.000s
I20260709 13:18:00.090667 14891 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:00.101385  8917 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 22.
I20260709 13:18:00.102494  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:00.111200 14774 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 11. Current term is 12.
W20260709 13:18:00.121062 14923 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
I20260709 13:18:00.139811  8843 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:18:00.151027  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:00.151947  8767 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:00.158152  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:00.159044 14755 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:00.159612 14755 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:00.160519 14755 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:00.174823 14875 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:00.179169 14875 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:00.182502  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:00.183104 14875 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.192728 14875 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:00.207703  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:00.212765  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:00.213043  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:00.213662  8917 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.216434  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:00.219974  8912 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.221668  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:00.227669  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:00.205570 14875 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:00.234391  8917 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 12.
I20260709 13:18:00.232790 14523 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:00.247007  8912 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:00.269371  8882 leader_election.cc:400] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:00.270586  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:00.275527 14801 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:00.278693  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:00.287847  8766 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:00.288741 14926 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.308884  8913 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:00.316370  8910 raft_consensus.cc:1275] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:18:00.307137 14838 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:18:00.327026 14774 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:00.328042 14774 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:00.328466 14774 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:00.329125 14891 consensus_queue.cc:1048] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:00.343005 14774 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:00.344730 14774 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.444303  8911 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:00.447674 14888 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:00.522581  8662 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 20 to 21, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 21 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:00.527159  8662 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 15 to 16, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:00.609241  8910 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:00.617542 14523 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:00.636940  8840 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:00.638759 14523 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:00.639633  8662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 103) took 2399 ms. Trace:
W20260709 13:18:00.641093  8664 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 221) took 17581 ms (client timeout 15000 ms). Trace:
I20260709 13:18:00.640041  8662 rpcz_store.cc:276] 0709 13:17:58.239915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.240079 (+   164us) service_pool.cc:224] Handling call
0709 13:18:00.639537 (+2399458us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:00.589585 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:00.591241 (+  1656us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:00.591274 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:00.591291 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:00.603595 (+ 12304us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:00.603678 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:00.603706 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:00.604073 (+   367us) tablet.cc:701] Row locks acquired
0709 13:18:00.604091 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:00.604253 (+   162us) write_op.cc:270] Start()
0709 13:18:00.604370 (+   117us) write_op.cc:276] Timestamp: P: 1783603080604210 usec, L: 0
0709 13:18:00.604396 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:00.605105 (+   709us) log.cc:844] Serialized 913 byte log entry
0709 13:18:00.607606 (+  2501us) op_driver.cc:464] REPLICATION: finished
0709 13:18:00.608123 (+   517us) write_op.cc:301] APPLY: starting
0709 13:18:00.608222 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:00.609680 (+  1458us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:00.609787 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:00.611599 (+  1812us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:00.611784 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:00.611840 (+    56us) write_op.cc:312] APPLY: finished
0709 13:18:00.612063 (+   223us) log.cc:844] Serialized 33 byte log entry
0709 13:18:00.613384 (+  1321us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.613486 (+   102us) write_op.cc:454] Released schema lock
0709 13:18:00.613582 (+    96us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:00.614007 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.614039 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":25748,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":4420,"apply.run_wall_time_us":5828,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":59225,"prepare.run_cpu_time_us":4107,"prepare.run_wall_time_us":15816,"replication_time_us":3056,"thread_start_us":58841,"threads_started":1}]]}
W20260709 13:18:00.641629  8664 rpcz_store.cc:269] 0709 13:17:43.059987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.060312 (+   325us) service_pool.cc:224] Handling call
0709 13:17:43.195160 (+134848us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:00.640995 (+17445835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:59.203848 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:59.251401 (+ 47553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:59.251443 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:17:59.251464 (+    21us) tablet.cc:662] Decoding operations
0709 13:17:59.300144 (+ 48680us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:59.300270 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:59.300311 (+    41us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:17:59.329945 (+ 29634us) tablet.cc:701] Row locks acquired
0709 13:17:59.329966 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:59.330122 (+   156us) write_op.cc:270] Start()
0709 13:17:59.330244 (+   122us) write_op.cc:276] Timestamp: P: 1783603079330069 usec, L: 0
0709 13:17:59.330266 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:17:59.331047 (+   781us) log.cc:844] Serialized 8239 byte log entry
0709 13:18:00.239405 (+908358us) op_driver.cc:464] REPLICATION: finished
0709 13:18:00.398715 (+159310us) write_op.cc:301] APPLY: starting
0709 13:18:00.398802 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:00.472843 (+ 74041us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:00.480365 (+  7522us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:00.512379 (+ 32014us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:00.515097 (+  2718us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:18:00.515146 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:00.515552 (+   406us) log.cc:844] Serialized 188 byte log entry
0709 13:18:00.517561 (+  2009us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.517741 (+   180us) write_op.cc:454] Released schema lock
0709 13:18:00.517796 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:00.557928 (+ 40132us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.557975 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3767,"reported_tablets":53,"spinlock_wait_cycles":236858624,"child_traces":[["op",{"apply.queue_time_us":159069,"apply.run_cpu_time_us":26643,"apply.run_wall_time_us":158777,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91781,"num_ops":21,"prepare.queue_time_us":240230,"prepare.run_cpu_time_us":158298,"prepare.run_wall_time_us":563184,"raft.queue_time_us":146136,"raft.run_cpu_time_us":51455,"raft.run_wall_time_us":97046,"replication_time_us":908991,"thread_start_us":795787,"threads_started":4,"wal-append.queue_time_us":618283}]]}
I20260709 13:18:00.671905  8837 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:18:00.673564 14803 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:00.678023  8910 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:00.679557 14803 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:00.689221  8667 catalog_manager.cc:5697] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 2 to 18. New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.690862  8667 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.692399  8667 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 15 to 16, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.698700  8667 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 19 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.700331  8667 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 19 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.702267  8667 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 15, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.703603  8667 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 14, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.704931  8667 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.706306  8667 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 16 to 20, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.708137  8667 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.711961  8667 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.726871  8667 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.728282  8667 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 15, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 15 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.737846  8667 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 4 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 13 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.739681  8667 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.741034  8667 catalog_manager.cc:5697] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 15, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.742523  8667 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 15 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 16 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.746222  8667 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 9 to 10, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 10 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.747844  8667 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.757042  8667 catalog_manager.cc:5697] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 15, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.760142  8667 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.763499  8667 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 18, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 18 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.764945  8667 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.766376  8667 catalog_manager.cc:5697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.767871  8667 catalog_manager.cc:5697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 17 to 21, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 21 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.769523  8667 catalog_manager.cc:5697] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:00.771180  8667 catalog_manager.cc:5697] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.885493  8664 catalog_manager.cc:5697] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 17 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:00.887555  8664 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 15 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:01.011831  8667 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 222) took 2724 ms. Trace:
I20260709 13:18:01.017248  8667 rpcz_store.cc:276] 0709 13:17:58.287301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.287440 (+   139us) service_pool.cc:224] Handling call
0709 13:18:01.011743 (+2724303us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:00.784224 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:00.784762 (+   538us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:00.784795 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:00.784814 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:00.786672 (+  1858us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:00.786730 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:00.786758 (+    28us) tablet.cc:685] Acquiring locks for 27 operations
0709 13:18:00.788930 (+  2172us) tablet.cc:701] Row locks acquired
0709 13:18:00.788950 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:00.789098 (+   148us) write_op.cc:270] Start()
0709 13:18:00.789230 (+   132us) write_op.cc:276] Timestamp: P: 1783603080789057 usec, L: 0
0709 13:18:00.789256 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:18:00.789978 (+   722us) log.cc:844] Serialized 10549 byte log entry
0709 13:18:00.793076 (+  3098us) op_driver.cc:464] REPLICATION: finished
0709 13:18:00.793539 (+   463us) write_op.cc:301] APPLY: starting
0709 13:18:00.793624 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:00.810866 (+ 17242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:00.810980 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:00.862783 (+ 51803us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:00.863140 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 13:18:00.863190 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:00.863721 (+   531us) log.cc:844] Serialized 236 byte log entry
0709 13:18:00.870178 (+  6457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.870414 (+   236us) write_op.cc:454] Released schema lock
0709 13:18:00.870482 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:00.870861 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:00.870892 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9598,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":256,"apply.run_cpu_time_us":33907,"apply.run_wall_time_us":77282,"cfile_cache_hit":108,"cfile_cache_hit_bytes":112698,"num_ops":27,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":6019,"prepare.run_wall_time_us":6020,"replication_time_us":3701}]]}
I20260709 13:18:01.160823  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet e3a106d574bc4cfeaa6e7b1240430c4b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:55342
W20260709 13:18:01.172912  8663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 223) took 28428 ms (client timeout 15000 ms). Trace:
W20260709 13:18:01.173591  8663 rpcz_store.cc:269] 0709 13:17:32.744250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.744665 (+   415us) service_pool.cc:224] Handling call
0709 13:17:33.107161 (+362496us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:01.172675 (+28065514us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5237,"reported_tablets":54,"spinlock_wait_cycles":34733312}
I20260709 13:18:01.194983  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet e3a106d574bc4cfeaa6e7b1240430c4b (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:18:01.195734  8665 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 11 to 12, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 12 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:01.219910  8667 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 11, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.221909  8667 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.276968  8667 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.278718  8667 catalog_manager.cc:5697] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 15 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.283655  8667 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 17 to 22, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 22 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:01.285175  8667 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 12 to 13, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 13 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:01.286604  8667 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:01.383141  8766 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:01.405566  9467 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:01.409236 14523 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:01.411839  8840 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:01.414409 14846 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:01.415041  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 224) took 7149 ms. Trace:
I20260709 13:18:01.429301  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:01.464570 14523 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 5 to 12, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:01.467617  9462 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 5 to 12, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:01.415463  8665 rpcz_store.cc:276] 0709 13:17:54.265908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.266171 (+   263us) service_pool.cc:224] Handling call
0709 13:18:01.414983 (+7148812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:01.203016 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:01.203594 (+   578us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:01.203636 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:18:01.203659 (+    23us) tablet.cc:662] Decoding operations
0709 13:18:01.204042 (+   383us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:01.204110 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:01.204142 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:01.204327 (+   185us) tablet.cc:701] Row locks acquired
0709 13:18:01.204343 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:01.204490 (+   147us) write_op.cc:270] Start()
0709 13:18:01.204602 (+   112us) write_op.cc:276] Timestamp: P: 1783603081204445 usec, L: 0
0709 13:18:01.204639 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:18:01.205502 (+   863us) log.cc:844] Serialized 538 byte log entry
0709 13:18:01.208304 (+  2802us) op_driver.cc:464] REPLICATION: finished
0709 13:18:01.208670 (+   366us) write_op.cc:301] APPLY: starting
0709 13:18:01.208771 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:01.209643 (+   872us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:01.209752 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:01.210480 (+   728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:01.210626 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:01.210671 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:01.210873 (+   202us) log.cc:844] Serialized 25 byte log entry
0709 13:18:01.211012 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.211092 (+    80us) write_op.cc:454] Released schema lock
0709 13:18:01.211130 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:01.211479 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:01.211515 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5701,"reported_tablets":54,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":139,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":2756,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2736,"prepare.run_wall_time_us":2817,"replication_time_us":3537,"spinlock_wait_cycles":492416}]]}
I20260709 13:18:01.508710  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bac07da6a99849fb8f972372c187ee7b with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:01.540267  8840 raft_consensus.cc:2955] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 5 to 12, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:01.546583  8665 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 5 to 12, VOTER bdb96be202c2447586477b2077b7d5bf (127.7.122.67) evicted. New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:01.560701 14803 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:01.561328 14803 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.564256  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:01.565240  8835 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:01.564539 14803 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:01.566494  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:01.567374 14803 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.567800 14803 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:01.568233 14803 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.572939  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet bac07da6a99849fb8f972372c187ee7b with delete_type TABLET_DATA_TOMBSTONED (TS bdb96be202c2447586477b2077b7d5bf not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:59034
I20260709 13:18:01.575748  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:01.576618  8913 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:01.592608 14803 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.601743 14803 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:01.603722  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:01.606877  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:01.633383  8912 raft_consensus.cc:2393] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:01.639935  8840 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:01.641659  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:01.642827 14803 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:01.644270 14803 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:01.648954 14803 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.667687 14954 tablet_replica.cc:333] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:01.678537  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:01.679275  8912 raft_consensus.cc:606] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:01.684113  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:01.684746  8912 raft_consensus.cc:606] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:01.689711 14954 raft_consensus.cc:2243] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:01.697502 14954 raft_consensus.cc:2272] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:01.706725  8840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:01.707425  8840 raft_consensus.cc:606] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:01.707757  8840 raft_consensus.cc:614] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:01.714434  8910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:01.715055  8910 raft_consensus.cc:606] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:01.725967  8910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:01.726595  8910 raft_consensus.cc:606] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:01.729938  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:01.731705  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:01.700742 14954 ts_tablet_manager.cc:1916] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:01.790400 14734 raft_consensus.cc:993] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:01.791114 14734 raft_consensus.cc:1081] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:01.796412  8840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:01.797504  8840 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:01.797886  8840 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.807408  8840 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.813789  8840 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:01.813014  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:01.815025  8912 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:01.815706  8912 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:01.816658  8912 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.818516  8912 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.855043 14954 ts_tablet_manager.cc:1929] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:18:01.855605 14954 log.cc:1199] T bac07da6a99849fb8f972372c187ee7b P bdb96be202c2447586477b2077b7d5bf: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/wals/bac07da6a99849fb8f972372c187ee7b
I20260709 13:18:01.865267  8665 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 13 to 14, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 14 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.861711  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet bac07da6a99849fb8f972372c187ee7b (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
W20260709 13:18:01.879768  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 91682.9us
I20260709 13:18:01.885063  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:01.885712  8767 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.898492  8661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 183) took 6889 ms. Trace:
I20260709 13:18:01.898878  8767 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:01.898965  8661 rpcz_store.cc:276] 0709 13:17:55.013377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.013629 (+   252us) service_pool.cc:224] Handling call
0709 13:18:01.898316 (+6884687us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90781,"reported_tablets":54}
I20260709 13:18:01.907724  8912 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:01.919857  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:01.923019 14909 raft_consensus.cc:993] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:01.925379 14903 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:01.926064 14903 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:01.926966 14903 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.925431 14909 raft_consensus.cc:1081] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:01.967078  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:18:01.967773  8767 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:01.968251  8767 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:01.985910  8767 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:01.986632  8663 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 15, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.988379  8903 tablet_service.cc:1558] Processing DeleteTablet for tablet bac07da6a99849fb8f972372c187ee7b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:59034
I20260709 13:18:01.990069  8651 catalog_manager.cc:5028] TS bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): tablet bac07da6a99849fb8f972372c187ee7b (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:18:01.990561  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:01.991238  8843 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.018164  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:02.018970  8912 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:02.019518  8912 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:02.020840  8912 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:02.021955  8912 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:02.029286  8660 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 182) took 29187 ms (client timeout 15000 ms). Trace:
I20260709 13:18:02.028985  8767 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:02.029942  8660 rpcz_store.cc:269] 0709 13:17:32.841467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.854210 (+ 12743us) service_pool.cc:224] Handling call
0709 13:18:02.029164 (+29174954us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72908,"reported_tablets":54}
I20260709 13:18:02.027123  8843 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:02.037905  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:02.038975 14803 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:02.039491 14803 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:02.040563 14803 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:02.044180  8912 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:02.078060  8843 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:02.079522 14846 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:02.093868  8663 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 15 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.095209 14959 raft_consensus.cc:993] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:02.095768 14959 raft_consensus.cc:1081] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:02.098256  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:18:02.098891  8767 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.099234  8767 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:02.117280  8912 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:02.124707  8767 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:02.128068  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:02.128266  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:02.128674  9462 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:02.128758  8912 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:02.136675  8912 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:02.137542  8912 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:02.138232 14846 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:02.138765  8912 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:02.158705  9462 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
I20260709 13:18:02.162586  8767 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:02.183017  8734 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:18:02.184211 14803 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:02.184919 14803 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:02.185981 14803 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:02.193522 14959 raft_consensus.cc:993] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:02.194088 14959 raft_consensus.cc:1081] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:02.195801  8766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:18:02.196408  8766 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:02.196779  8766 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.204464  8766 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:02.206548  8766 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:02.207660  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:02.208035  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:02.208348  8840 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.208630  8911 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:02.208997  8911 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:02.209774  8911 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:02.210968  8911 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.218992  8912 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
I20260709 13:18:02.223955  8911 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:02.232612  8840 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:02.234328  8735 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:02.237469 14803 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:02.252538 14803 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:02.260972 14803 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:02.282454  8661 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 21 to 22, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 22 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.373586  8661 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 19 to 20, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 20 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:02.468042  8911 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:02.469970 14903 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:02.475380  8766 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:02.477180 14957 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:18:02.507493  8910 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:02.509462 14803 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:02.547183  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48249.5us
I20260709 13:18:02.590171  8843 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:02.592741 14846 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:02.665109  9462 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:02.667042 14846 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:02.665073  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 158832us
W20260709 13:18:02.685545  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48862.7us
I20260709 13:18:02.688721  8910 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:02.695091 14846 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:18:02.732895  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:02.758678  8912 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:02.773100 14956 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:02.844645  8837 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:02.851940 14846 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:18:02.955075 14979 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:03.002624  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50014.8us
W20260709 13:18:03.088490  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 188082us
W20260709 13:18:03.091531  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71136.3us
I20260709 13:18:04.157920  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:04.226271  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46501.7us
W20260709 13:18:04.586242  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60393.5us
I20260709 13:18:04.620308  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:04.621551  8843 raft_consensus.cc:606] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:04.651947  8911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:04.652618  8911 raft_consensus.cc:606] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:04.657160  8761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:04.657809  8761 raft_consensus.cc:606] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:04.663368  8911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:04.667295  8911 raft_consensus.cc:606] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Received request to transfer leadership to TS 3b34c95a175945b88b17f07fbc650abf
I20260709 13:18:04.671283  8911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:04.671838  8911 raft_consensus.cc:606] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:04.673144  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:04.675165  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:04.711273 14975 raft_consensus.cc:993] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:04.711921 14975 raft_consensus.cc:1081] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:04.715454  8837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:04.716143  8837 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.716909  8837 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.724817 14972 raft_consensus.cc:993] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:04.725389 14972 raft_consensus.cc:1081] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:04.729091  8761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:04.729732  8761 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.730119  8761 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.759425  8761 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:04.764752  8837 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:04.766836  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:04.767724  8844 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:04.768059  8844 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:04.768929  8844 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:04.770033  8844 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.776947 14734 raft_consensus.cc:993] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:04.777904 14959 raft_consensus.cc:1081] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:04.781275  8766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:18:04.782104  8766 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.782509  8766 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.802726 14734 raft_consensus.cc:993] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 3b34c95a175945b88b17f07fbc650abf to start an election
I20260709 13:18:04.803288 14734 raft_consensus.cc:1081] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Signalling peer 3b34c95a175945b88b17f07fbc650abf to start an election
I20260709 13:18:04.805459  8844 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:04.810264  9467 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549"
dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
 from {username='slave'} at 127.0.0.1:54308
I20260709 13:18:04.810897  9467 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:04.811267  9467 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.819068  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:04.819883  8917 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:04.820225  8917 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:04.821209  8917 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:04.822527  8917 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.823658  8837 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:04.825368  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:04.826308  9462 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.830639  9467 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:04.839319  8917 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:04.842597  9462 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:04.844548  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:04.848389  8761 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:04.851583 14957 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:04.852294 14957 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:04.853466 14957 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:04.862861  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:04.847486  8766 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:04.865315  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:04.863982  8917 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.866899 14846 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:04.867467 14846 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:04.868299 14846 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:04.871464  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:04.872093  8837 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.874881  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:04.875497  8910 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:04.875823  8910 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:04.876674  8910 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:04.880576  8910 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.865317  8766 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:04.887653  8837 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:04.888888  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:04.889997 14994 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:04.890486 14994 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:04.891422 14994 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:04.892026  8917 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:04.905812  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:04.906451  8843 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.914083  9467 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:04.918447  8910 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:04.921250  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:04.921911  8917 raft_consensus.cc:3055] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:04.922290  8917 raft_consensus.cc:740] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:04.923159  8917 consensus_queue.cc:260] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:04.924420  8917 raft_consensus.cc:3060] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.930382  8843 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:18:04.933902  9434 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:04.935103 14997 raft_consensus.cc:2804] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:04.935621 14997 raft_consensus.cc:697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:18:04.936764 14997 consensus_queue.cc:237] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:04.953626  8917 raft_consensus.cc:2468] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
W20260709 13:18:04.975577  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 67076.1us
I20260709 13:18:05.008075  8663 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 19 to 20, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:05.058147  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53200us
I20260709 13:18:05.059289  8665 catalog_manager.cc:5697] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 16 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 17 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:05.065099  8660 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 19 to 20, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 20 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:05.132095  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 138083us
I20260709 13:18:05.142462 15008 raft_consensus.cc:993] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:05.143107 15008 raft_consensus.cc:1081] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:05.146219  8844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:05.146869  8844 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:05.147222  8844 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.157017  8844 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:05.159288  8844 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:05.160234  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:05.160583  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:05.161049  8911 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.161283  8766 raft_consensus.cc:3055] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.161720  8766 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:05.162540  8766 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:05.164584  8766 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.170092  8911 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:05.171663  8807 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:05.172845 15005 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:05.175738 15005 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:05.176875 15005 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:05.213140  8766 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:05.272670  8660 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 16 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.312078  8663 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:05.360117  8844 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:05.362442 15004 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:05.373827  8910 raft_consensus.cc:1275] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:05.388613 15004 consensus_queue.cc:1048] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:05.394212  8837 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:05.415680  8911 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:18:05.423696  9462 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:18:05.429133 14986 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:05.417984 14803 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:05.430207 14957 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.009s
I20260709 13:18:05.445473  8912 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:05.492698  8837 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:05.499161  8917 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:05.461338 15008 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:18:05.507431 14994 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
W20260709 13:18:05.519929 15018 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:05.539153 14803 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:05.591673  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44291.5us
W20260709 13:18:05.617664  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61600.1us
W20260709 13:18:05.699826 15026 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:18:05.689566  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:05.722886 15016 log.cc:927] Time spent T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.115s	user 0.003s	sys 0.000s
I20260709 13:18:05.734298  8912 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:18:05.830386  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60261.3us
W20260709 13:18:05.830430  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56931.2us
W20260709 13:18:05.843160  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65670.1us
W20260709 13:18:05.909713 15026 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:18:06.065145  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 230546us
W20260709 13:18:06.083448  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 196550us
I20260709 13:18:06.130218 15057 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:18:06.197583  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 413181us
I20260709 13:18:06.257515  8766 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:06.361559 15051 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:07.200532  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:07.345978  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:07.346696  8841 raft_consensus.cc:606] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:07.351338  8766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:07.351963  8766 raft_consensus.cc:606] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:07.355365  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:07.355980  8912 raft_consensus.cc:606] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:07.362709  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:07.363328  8917 raft_consensus.cc:606] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:07.367473  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:07.368146  8841 raft_consensus.cc:606] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:07.369690  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:07.371500  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:07.452441 15054 raft_consensus.cc:993] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:07.453109 15054 raft_consensus.cc:1081] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:07.456226  8843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:07.457003  8843 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.457472  8843 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.475521 15029 raft_consensus.cc:993] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:07.477627  8843 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.478176 15068 raft_consensus.cc:1081] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:07.479936  8843 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:07.481750  8841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:07.482208  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:07.482457  8841 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.482980  8841 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.491135  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:07.491940  8765 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.482972  8912 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:07.497776  8912 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:07.498767  8912 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.500144  8912 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.508657  8912 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:07.510215  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:07.511479 15065 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:07.512041 15065 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:07.520143  8765 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:07.521077 15065 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.535372 15056 raft_consensus.cc:993] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:07.535926 15056 raft_consensus.cc:1081] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:07.538617  8768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:07.539531  8768 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.539994  8768 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:07.544945  8841 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.548382  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:07.549011  8912 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.554792  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:07.555514  8765 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:07.555917  8765 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:07.555943  8768 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.559098 15046 raft_consensus.cc:993] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:07.559703 15046 raft_consensus.cc:1081] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:07.561956  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:07.562528  8910 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:07.562883  8837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:07.563622  8837 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.563946  8837 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.571283  8910 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 23.
I20260709 13:18:07.572542  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:07.574574 15029 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:07.575205 15029 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:07.576154 15029 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.580536  8768 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 23 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:07.571313  8837 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.586229  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:07.586956  8843 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:07.587273  8843 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:07.588966  8843 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.591236  8843 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:07.596429  8841 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:07.595623  8765 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.605770  8765 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.638772  8765 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:07.640066  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:07.650207  8843 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 23.
I20260709 13:18:07.651366 15051 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.660914 15051 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:07.662428 15051 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.664040  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:07.664726  8765 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.676915  8912 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:07.681173  8917 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:07.683301  8837 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:07.685226  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:07.693424  8912 raft_consensus.cc:3055] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:07.693872  8912 raft_consensus.cc:740] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:07.694785  8912 consensus_queue.cc:260] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.696043  8912 raft_consensus.cc:3060] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.698000  8765 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:07.702198  8808 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:07.703445 15065 raft_consensus.cc:2804] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:07.704110 15065 raft_consensus.cc:697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:07.705802 15065 consensus_queue.cc:237] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:07.717967 15057 raft_consensus.cc:993] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:07.718634 15057 raft_consensus.cc:1081] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:07.721678  8660 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 22 to 23, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 23 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.720532  8663 catalog_manager.cc:5697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 18 to 19, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 19 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.728936  8765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:07.729609  8765 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:07.730027  8765 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.767688  8912 raft_consensus.cc:2468] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:07.771112  8765 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:07.778630  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:07.779273  8843 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:07.779582  8843 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:07.779994  9467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:07.780712  9467 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.780400  8843 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:07.793062  8843 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.794894  9467 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:07.796329  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:18:07.797277 15029 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:07.797863 15029 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:07.799034 15029 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:07.804455  8765 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:07.811784  8843 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
W20260709 13:18:07.817517  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50960us
I20260709 13:18:07.937409  8663 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 15 to 16, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.955303  8660 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.957217  8660 catalog_manager.cc:5697] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 15, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:07.976416  8837 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:07.979573 15029 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:18:08.058478  8766 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:08.064901 15051 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:18:08.128185  8912 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:08.133165 15057 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:08.149089  8913 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:08.171831 15085 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:08.205847  8765 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:08.210175 15057 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:08.326771  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 134462us
I20260709 13:18:08.382005  8765 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:18:08.384405  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45957.4us
I20260709 13:18:08.388512  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:08.425330 15056 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:08.445379  8913 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:08.466988  8910 raft_consensus.cc:1275] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:18:08.519814  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 133328us
I20260709 13:18:08.558115  8843 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:08.644748  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 171447us
I20260709 13:18:08.662882 15105 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:08.689097  9462 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:08.690429  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 205811us
I20260709 13:18:08.691855 15088 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:08.694907  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51065.7us
W20260709 13:18:08.748383  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 165965us
W20260709 13:18:08.779445  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 87037.6us
W20260709 13:18:08.784891  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49572.6us
I20260709 13:18:08.830317 15029 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 13:18:08.832554 15051 consensus_queue.cc:1048] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
W20260709 13:18:08.982015  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 146314us
W20260709 13:18:08.984443  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 192023us
W20260709 13:18:08.985026  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 152607us
W20260709 13:18:09.009603  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 193069us
W20260709 13:18:09.097877  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 109625us
W20260709 13:18:09.126403  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 133433us
W20260709 13:18:09.174252 15089 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.027s
W20260709 13:18:09.196434 15089 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.018s	sys 0.028s
W20260709 13:18:09.247731  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 97689.2us
W20260709 13:18:09.305869  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 56084.1us
W20260709 13:18:09.367938  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 76610.3us
W20260709 13:18:09.368010  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60152.8us
W20260709 13:18:09.414186  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 46239.5us
I20260709 13:18:09.751417  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:09.908569  8840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:09.909245  8840 raft_consensus.cc:606] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:09.924072  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da988855757643ccbb2593bad676d78d"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:09.924949  8912 raft_consensus.cc:606] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:09.986491  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:09.987198  8762 raft_consensus.cc:606] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:09.991376  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:09.992815  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:10.200194 15112 raft_consensus.cc:993] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:10.201032 15112 raft_consensus.cc:1081] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:10.205976  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:10.206557  8762 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.206883  8762 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.242273  8762 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:10.245616  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:10.245929  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:10.246362  8837 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:10.246783  8837 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:10.246465  9461 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.247851  8837 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:10.249267  8837 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.245616  8762 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:10.262805  8837 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:10.269369  8735 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:10.270455 15068 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:10.271041 15068 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:10.273373  9461 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:10.272698 15068 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:10.323726  8665 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.481108 15156 raft_consensus.cc:993] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:10.507314 15088 raft_consensus.cc:993] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:10.509820 15123 raft_consensus.cc:1081] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:10.516028  8839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da988855757643ccbb2593bad676d78d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:10.516623  8839 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.516986  8839 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.508071 15133 raft_consensus.cc:1081] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:10.527503  8913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42828
I20260709 13:18:10.528184  8913 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:10.528573  8913 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.546470  8839 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:10.559922  8913 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:10.562691  8913 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:10.565541  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:10.566521  8765 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:10.566852  8765 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:10.569535  8839 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:10.570333  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:10.570938  8918 raft_consensus.cc:3055] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:10.571229  8918 raft_consensus.cc:740] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:10.571995  8918 consensus_queue.cc:260] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:10.573189  8918 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.581323  8765 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:10.583549  8765 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.586077  8918 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:18:10.587466  8807 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:10.595993  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:10.596664  8839 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.596813  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:10.598879  9461 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:10.601078 15113 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:10.613256  8839 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:18:10.622189  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:10.627337  9461 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:18:10.646786  8765 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:18:10.645673 15153 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:10.653934 15153 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:10.655087 15153 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:10.648190 15113 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:10.693970 15113 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:10.779894  8661 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 11 to 12, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 12 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:10.785295  8660 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 11 to 12, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:10.832921  8837 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:18:10.835073 15086 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:10.986755  9461 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:18:10.994414  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:11.017081 15088 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
W20260709 13:18:11.055464  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65471us
W20260709 13:18:11.113204  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 124792us
I20260709 13:18:11.167341  8843 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:11.167411  8913 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:11.171396 15157 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:11.175442 15123 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:11.239357  9461 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:11.242008  8765 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:11.246747 15155 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:11.252506 15158 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:12.212182  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:12.901556  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:12.902230  8837 raft_consensus.cc:606] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:12.912777  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70141.3us
I20260709 13:18:12.915042  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:12.915652  8837 raft_consensus.cc:606] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:12.964437  8766 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:12.965153  8766 raft_consensus.cc:606] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:13.008785 15112 raft_consensus.cc:993] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:13.010327 15112 raft_consensus.cc:1081] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:13.010843  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:13.012449  8837 raft_consensus.cc:606] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:13.026705 15193 raft_consensus.cc:993] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:13.028152  8913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:13.028774  8913 raft_consensus.cc:606] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:13.027359 15193 raft_consensus.cc:1081] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:13.044725 15157 raft_consensus.cc:993] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:13.053452  8767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:13.054133  8767 raft_consensus.cc:606] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:13.057909  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:13.059800  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:13.060575  8913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42828
I20260709 13:18:13.061345  8913 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.061695  8913 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.070384  8913 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.072942  8913 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:13.074081  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:13.074222 15157 raft_consensus.cc:1081] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:13.074792  8767 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:13.075152  8767 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:13.075907  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:13.076508  8840 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.077086  8768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:13.077724  8768 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.078136  8768 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.075944  8767 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.080047  8767 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.084543  8918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42824
I20260709 13:18:13.085246  8918 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.085605  8918 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.097520  8840 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:13.100615  8918 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:13.102056  8884 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:13.107455 15190 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:13.108047 15190 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:13.108600  8918 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:13.109422 15190 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.110383  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:13.111017  8837 raft_consensus.cc:3055] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:13.111294  8837 raft_consensus.cc:740] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:13.112128  8837 consensus_queue.cc:260] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:13.113262  8837 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.114125  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:13.114753  9462 raft_consensus.cc:3060] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.118018  8768 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.120151  8768 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:13.121675  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:13.122362  8913 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.128283  8837 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:13.130996  9462 raft_consensus.cc:2468] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:13.132977  8884 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:13.131111  8767 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:13.135929 15188 raft_consensus.cc:2804] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:13.136150  8913 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:13.136593 15188 raft_consensus.cc:697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:13.137157  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:13.137805  8837 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:13.138252  8837 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:13.137885 15188 consensus_queue.cc:237] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:13.139078  8837 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.140431  8837 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.143569  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:13.148270  8837 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:13.149509 15191 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:13.150116 15191 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:13.151029 15191 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.175101 15088 raft_consensus.cc:993] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:13.175736 15088 raft_consensus.cc:1081] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:13.177546  8837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:13.178128  8837 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.178501  8837 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:13.186398  8837 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:13.188571  8660 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 15 to 16, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.192934  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:13.193614  8767 raft_consensus.cc:3055] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:13.193936  8767 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:13.194738  8767 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:13.195914  8767 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:13.203861  8837 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:13.205042  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:13.205878  9462 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:13.214923  9462 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:18:13.216717  8809 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:13.218219  8767 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 9.
I20260709 13:18:13.219457 15194 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:18:13.220117 15194 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:13.221195 15194 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:13.405901  8661 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 19 to 20, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 20 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.413543  8665 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 8 to 9, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 9 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.424101 15157 raft_consensus.cc:993] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:13.424844 15157 raft_consensus.cc:1081] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:13.431228  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:13.441344  8767 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.482332  8767 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.527896  8767 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:13.533041  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62220.1us
I20260709 13:18:13.551225 15210 raft_consensus.cc:993] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:13.551905 15210 raft_consensus.cc:1081] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
W20260709 13:18:13.553122  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08002b6d00 after lost signal to thread 7660
W20260709 13:18:13.554754  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0b80 after lost signal to thread 8701
W20260709 13:18:13.556699  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08002701a0 after lost signal to thread 8793
W20260709 13:18:13.563495  8698 debug-util.cc:398] Leaking SignalData structure 0x7b080003a800 after lost signal to thread 8868
I20260709 13:18:13.576042  8839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:13.580989  8839 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:13.581530  8839 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:13.574851  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08001d0c40 after lost signal to thread 8942
I20260709 13:18:13.576285  8767 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:13.592626  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3180 after lost signal to thread 9492
I20260709 13:18:13.602260  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:13.605269  8840 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:13.605805  8840 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:13.607038  8840 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.611213  8839 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.635279  8840 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.637269  8839 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:13.628355  8661 catalog_manager.cc:5697] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 20 to 21, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 21 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.631759  8767 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:13.641044  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:13.641857  8762 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.641952  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:13.642809  8909 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.661669 15209 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:13.663535  9462 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:13.673138  8762 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:13.677757 15195 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:13.678545  8808 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:13.679952 15198 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:13.680505 15198 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:13.681720 15198 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.683048  9462 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:18:13.685503 15183 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:18:13.688957  8762 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:18:13.692119  8909 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:13.694289  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:13.696596  8917 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:13.697026  8917 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:13.699815  8917 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.701392  8917 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.708403  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:13.710413 15187 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:13.711033 15187 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:13.712175 15187 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:13.727450  8835 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:13.695271 15195 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:18:13.733538  8661 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.750034  8917 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:13.759127  8840 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:13.775179 15208 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:13.784157  8836 raft_consensus.cc:1275] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:18:13.806053  8917 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:13.814755  8836 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:13.817047 15133 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:18:13.808828 15210 consensus_queue.cc:1048] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 13:18:13.820746 15173 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:13.924212  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49875us
W20260709 13:18:13.992993 15226 log.cc:927] Time spent T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:18:14.027477 15220 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 13:18:14.030454 15224 log.cc:927] Time spent T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:18:14.071326  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:14.151800  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 208407us
W20260709 13:18:14.227080  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 228138us
W20260709 13:18:14.267570  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 290130us
W20260709 13:18:14.373895  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 73006.1us
I20260709 13:18:14.502691  8768 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 13:18:14.526798  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79677.5us
I20260709 13:18:14.584753  8836 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:14.601243  8913 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:14.614014  8917 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:14.624060 15237 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:14.637953  8660 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:14.660995  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 124293us
W20260709 13:18:14.705124  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 128382us
I20260709 13:18:14.708969 15155 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:14.711203 15187 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:14.711858 15231 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:15.679733  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:15.820941  8762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:15.821750  8762 raft_consensus.cc:606] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:15.851348  8835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:15.852003  8835 raft_consensus.cc:606] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:15.860313  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:15.860991  8917 raft_consensus.cc:606] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:15.862740  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:15.864744  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:16.063508 15229 raft_consensus.cc:993] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:16.065521 15235 raft_consensus.cc:1081] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:16.069259  8837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:16.069986  8837 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.070475  8837 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.121105 15258 raft_consensus.cc:993] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:16.121706 15258 raft_consensus.cc:1081] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:16.123739  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:16.124356  8762 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.124743  8762 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.134513  8762 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.149950  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:16.150746  8835 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:16.151151  8835 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:16.152228  8762 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:16.152063  8835 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.157009  8835 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.203217  8837 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.205904  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:16.206526  8762 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.213950  8837 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:16.215715  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:16.226866  8912 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:16.227259  8912 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:16.228222  8912 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.237519  8912 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:16.236470  8762 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:18:16.244807  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:16.246155 15231 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:16.246934 15231 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:16.247982 15231 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.250420  8912 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:18:16.259333 15193 raft_consensus.cc:993] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:16.264993 15241 raft_consensus.cc:1081] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:16.272408  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:16.273069  8917 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.286553  8665 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 12 to 13, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 13 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.308772  8762 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:16.327371  8917 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:16.335618  8835 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:16.402464  8835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:16.403090  8835 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:16.403466  8835 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.411214  8835 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.423237  8835 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:16.424295  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:16.429858  8762 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:16.430713  8762 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:16.434023  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:16.435099 15187 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:16.435701 15187 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:16.439201  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:16.439328 15187 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.440579  8918 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.436935  8762 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:16.451280  8762 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.498262  8762 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:16.499084  8918 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:16.501427  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:16.502467 15256 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:16.503001 15256 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:16.503885 15256 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:16.558094  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78639.5us
I20260709 13:18:16.563728  8661 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.606211  8660 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 13 to 14, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 14 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:16.655095  8762 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:16.657302 15256 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:16.742990  8917 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:16.759948 15231 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:16.867893  8842 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:16.870479 15187 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:16.879860  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:16.922676  8918 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:16.925717 15260 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:17.077852  8918 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:17.080005  8762 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:17.087299 15258 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:17.194468 15231 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:17.571673  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 87488.9us
W20260709 13:18:17.652779  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 74981.1us
W20260709 13:18:17.733237  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 130325us
W20260709 13:18:17.734840  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 58265.9us
W20260709 13:18:17.746325  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 80662.5us
W20260709 13:18:17.747121  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 82994.2us
W20260709 13:18:17.929900  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47601.8us
W20260709 13:18:17.965145  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 78848us
W20260709 13:18:18.009820  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46889us
W20260709 13:18:18.036509  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50581.8us
I20260709 13:18:18.221613  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:18.365655  8835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:18.366459  8835 raft_consensus.cc:606] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:18.383152  8912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:18.383839  8912 raft_consensus.cc:606] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:18.390728  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:18.391376  8765 raft_consensus.cc:606] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:18.396032  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:18.399616  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:18.631232  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 110937us
I20260709 13:18:18.792662 15210 raft_consensus.cc:993] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:18.793417 15210 raft_consensus.cc:1081] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:18.832824  8842 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:18.833469  8842 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:18.833864  8842 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.891007  8842 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:18.907294  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:18.907721  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:18.907971  8913 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.908286  8913 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:18.908735 15291 raft_consensus.cc:993] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:18.909358 15316 raft_consensus.cc:1081] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:18.909298  8913 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:18.910984  8913 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.908311  9461 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.914180  8842 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:18.924147  8912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42828
I20260709 13:18:18.924398 15314 raft_consensus.cc:993] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:18.924801  8912 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:18.925240  8912 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.926703 15314 raft_consensus.cc:1081] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:18.932595  9461 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:18.932897  8912 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:18.956210  8912 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:18.957055  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:18.957738  8762 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:18.958087  8762 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:18.958859  8762 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:18.960201  8762 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.965631  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:18.966522  8842 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.940447  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:18.973242  8768 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.941641  8767 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:18.938387  8913 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:18.977288  8767 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:18.977988  8767 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.978684  8807 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:18.980386 15314 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.980940 15314 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:18.982935 15314 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:19.041481  8767 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:19.042466  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47396.7us
I20260709 13:18:19.043866  8767 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:19.044593  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:19.056273  8837 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:19.056633  8837 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:19.058455  8837 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:19.059576  8837 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.067066  8837 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
W20260709 13:18:19.041847  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45820.2us
I20260709 13:18:19.048765  8768 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:19.055583  8842 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:19.045185  8762 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:19.078123  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:19.079150 15309 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:19.079838 15309 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:19.081671  8735 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:19.080849 15309 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:19.084383 15316 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:19.088220 15316 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:19.089141 15316 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:19.114236  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44812.3us
I20260709 13:18:19.115593  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:19.116233  8913 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.130630  8913 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:19.144480  8661 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 15, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.208480  8663 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 14 to 15, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 15 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:19.258106  8665 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:19.426219  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:19.584398  8917 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:19.601382 15258 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:18:19.638475  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 83054.5us
I20260709 13:18:19.646423  9461 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:19.649650 15304 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:19.688177  8837 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:18:19.689889  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66155.9us
I20260709 13:18:19.718420 15339 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:19.756397  8913 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:19.758235  8837 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:19.789994 15308 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:19.806015  8768 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:19.875223 15325 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:19.893080  8762 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:19.949775 15328 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:19.951290  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45717.7us
W20260709 13:18:19.952535  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47566.1us
I20260709 13:18:19.956070 15314 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:21.078882  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:21.425447  8910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011917cac276499ba01c77d911c67d8d"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:21.426116  8910 raft_consensus.cc:606] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:21.442792  8768 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:21.443445  8768 raft_consensus.cc:606] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:21.446867  8836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:21.447844  8836 raft_consensus.cc:606] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:21.449484  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:21.451453  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:21.466442 15364 raft_consensus.cc:993] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:21.467286 15364 raft_consensus.cc:1081] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:21.469731  8843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "011917cac276499ba01c77d911c67d8d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:21.470359  8843 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.470744  8843 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.498624 15305 raft_consensus.cc:993] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:21.499274 15305 raft_consensus.cc:1081] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:21.500988  8768 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:21.501610  8768 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.501953  8768 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.513015  8768 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:21.531373  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:21.532011  8839 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:21.532289  8839 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:21.533058  8839 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:21.534098  8839 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.539268  8768 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:21.566551  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:21.567186  8912 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.575248  8912 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:21.584759  8839 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:21.586229  8735 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:21.587816 15341 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:21.588519 15341 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:21.589526 15341 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:21.587845  8843 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:21.606911  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:21.607684  8768 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.610337  8843 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:21.623190  8663 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 15 to 16, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.627406  8768 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:21.629035  8808 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:21.628751  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:21.630436 15366 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:21.631141 15366 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:21.632179 15366 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:21.639514  8910 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:21.640410  8910 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:21.643252  8910 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:21.646301  8910 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.681576  8910 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:21.685186  8665 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 15, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:21.697566 15316 raft_consensus.cc:993] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:21.698200 15316 raft_consensus.cc:1081] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:21.714022  8910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42828
I20260709 13:18:21.714637  8910 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:21.715029  8910 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.723299  8910 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.010383 15373 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.011065 15373 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.014039 15373 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.046612 15375 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.047250 15375 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.049098 15376 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.049765 15377 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.049860 15375 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.051160 15377 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.056027  8663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 281) took 1436 ms. Trace:
I20260709 13:18:23.056818 15380 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.057533 15380 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.060914 15305 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.060037 15379 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.062024 15379 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.061519 15305 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.066571 15377 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.067657 15305 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.069202 15366 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.070119 15379 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.069828 15366 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.072224 15366 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.072763 15366 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.073048 15299 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.073328 15366 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.073683 15299 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.075249 15374 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.075984 15299 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.050400 15378 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.075753 15366 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.077732 15299 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.078325 15366 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.078224 15378 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.078397 15299 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.079011 15366 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.080350  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.081387 15373 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.081941 15373 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.085496 15299 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.049835 15376 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.086640 15380 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.056979  8663 rpcz_store.cc:276] 0709 13:18:21.619375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.619824 (+   449us) service_pool.cc:224] Handling call
0709 13:18:23.055912 (+1436088us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:21.649267 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:21.650022 (+   755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:21.650064 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:18:21.650084 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:21.650508 (+   424us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:21.650583 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:21.650609 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:21.650807 (+   198us) tablet.cc:701] Row locks acquired
0709 13:18:21.650825 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:21.655779 (+  4954us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b1800047a40. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6f9424bc 00007fce6cc9048b 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccaa455 00007fce737cf16c 00007fce7378fc18 00007fce75c902d1
0709 13:18:21.656056 (+   277us) write_op.cc:270] Start()
0709 13:18:21.656348 (+   292us) write_op.cc:276] Timestamp: P: 1783603101655979 usec, L: 0
0709 13:18:21.656384 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:18:21.657251 (+   867us) log.cc:844] Serialized 538 byte log entry
0709 13:18:21.729738 (+ 72487us) op_driver.cc:464] REPLICATION: finished
0709 13:18:22.880666 (+1150928us) write_op.cc:301] APPLY: starting
0709 13:18:22.880776 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:22.882308 (+  1532us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:22.882342 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:22.883277 (+   935us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:22.883529 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:22.883590 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:22.883836 (+   246us) log.cc:844] Serialized 25 byte log entry
0709 13:18:22.884050 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:22.884155 (+   105us) write_op.cc:454] Released schema lock
0709 13:18:22.884206 (+    51us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":299392,"child_traces":[["op",{"apply.queue_time_us":1150589,"apply.run_cpu_time_us":4082,"apply.run_wall_time_us":40037,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":14060,"prepare.run_cpu_time_us":13503,"prepare.run_wall_time_us":31549,"raft.queue_time_us":45623,"replication_time_us":73174,"spinlock_wait_cycles":22445440,"thread_start_us":80211,"threads_started":4,"wal-append.queue_time_us":24369}]]}
I20260709 13:18:23.085100  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.076910 15379 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.088307  8762 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:23.091001 15366 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.091202 15373 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.080616 15378 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.094851 15380 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.100199  8843 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.106463 15380 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.107300 15316 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.107926 15316 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.109043 15380 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.075820 15374 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.102502 15375 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.113562 15374 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.114305 15316 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.114022 15375 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.118880 15375 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.126564 15375 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.124495  8761 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:23.125181  8910 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.114840 15362 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.110785 15380 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.103005 15305 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.137189 15382 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.088675 15379 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.152233 15330 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.153031 15381 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.153750 15364 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.154992  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.163236  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42828 (request call id 3134) took 1440 ms. Trace:
I20260709 13:18:23.163823  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.087932 15376 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.168404 15387 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.169242  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.179272  8761 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:23.171185  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.170980  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.180467  8767 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 13.
I20260709 13:18:23.176079  8910 rpcz_store.cc:276] 0709 13:18:21.713729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.713886 (+   157us) service_pool.cc:224] Handling call
0709 13:18:23.154525 (+1440639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:23.156960 15374 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.170930 15305 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.187271  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.171221 15375 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.189824  8769 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:23.186046 15366 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.192998  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.196622 15373 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.199191  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.199534 15305 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.202888 15392 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:23.204882 15371 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.475s	user 0.013s	sys 0.033s
I20260709 13:18:23.175140 15382 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.172539 15380 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.209213  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.211267  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.211410  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:23.230543  8837 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.212298  8769 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:23.177563 15381 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.164407 15362 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.217460  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.176908 15330 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.192207 15316 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.191906 15299 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.195973 15374 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.219784 15392 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.220166 15373 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.249063 15327 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:23.220345 15371 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.489s	user 0.013s	sys 0.033s
I20260709 13:18:23.219726 15384 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.249891 15327 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.250335 15384 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.252660 15384 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.253290 15384 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.253638 15392 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.253774 15384 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.255182 15392 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.255695 15392 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.256168 15384 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.223613 15379 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.257097 15316 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.259240 15362 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.259397 15316 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.223851 15380 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.224566 15378 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.225093 15341 raft_consensus.cc:493] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.261339 15330 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.261155 15341 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.262668 15388 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.263252 15388 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.265347 15381 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.266259 15379 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.266469 15374 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.266968 15375 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.266827 15379 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.227257 15382 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.188728 15364 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.267786 15327 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.268983 15378 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.269644 15364 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.270224  8761 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:18:23.185217 15387 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.271299 15378 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.273280 15387 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.274585 15330 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.275207 15330 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.265846  8837 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:23.277299 15379 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.277730 15391 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.277897 15341 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.278409 15391 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.279850 15334 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.283937 15334 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.231220  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.243516  8910 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:23.247406 15299 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.281543 15330 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.285040 15383 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.219515 15366 raft_consensus.cc:515] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.286973 15379 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.219054 15305 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.249912 15373 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.308418  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.311367  8767 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:23.311749  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.311430  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.314312  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.296164 15341 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.295681 15391 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.310158 15384 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.319789  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.297418 15382 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.297400 15378 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.322156  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.323014  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.313220 15381 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.323417 15366 leader_election.cc:290] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.323932 15393 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.318399 15364 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.323079  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.331812  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.332854  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.315277 15387 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.325066  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.345978 15394 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.345778 15381 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.349310 15396 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.349947 15364 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.385277 15364 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.350967 15299 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.345803 15385 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.353370  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.354446  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.355293  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.355400  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.356278  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.393702  8918 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:23.395018  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.395808  8918 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:23.322218 15341 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.331774 15384 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.325532 15305 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.334887 15382 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.357693 15375 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.317117 15383 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.358914 15393 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.359705  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.336038 15373 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.360498 15374 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.360383 15378 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.317505 15379 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.361625  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.361712 15392 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.364104  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.371814  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:23.382252 15396 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.366528  8914 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:23.370446 15330 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.369683 15366 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:23.422118  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 60151.7us
I20260709 13:18:23.403946  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.415841  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.416296  8916 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:23.423754  8910 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:23.376724 15387 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.399678 15381 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.416236  8769 raft_consensus.cc:3055] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:23.423064  8918 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:23.421741  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.424983  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.426020  8910 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:23.427201  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.425475  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.436468  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.437479  8915 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:23.432897  8769 raft_consensus.cc:740] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:23.440680  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.417237 15362 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.418958 15404 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.415009 15406 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.406229 15375 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.447165  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.439594  8769 consensus_queue.cc:260] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.455916  8769 raft_consensus.cc:3060] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.456987 15305 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.457737  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.458094  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.460321  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.399502 15385 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.463138 15385 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.463214  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.463907 15385 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.426460 15330 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.465171  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.466259 15330 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.451946 15404 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.468914 15386 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.469591 15404 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.469861 15386 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.470352  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.470986 15395 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.471632 15395 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.472504 15386 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:23.472990  8698 debug-util.cc:398] Leaking SignalData structure 0x7b0800148de0 after lost signal to thread 7660
W20260709 13:18:23.491465  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9140 after lost signal to thread 8701
I20260709 13:18:23.491887 15398 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.449302 15362 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.492547 15398 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.452076 15334 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.441525 15366 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:23.475374  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.400959 15394 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.477227  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.479497 15379 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.425823 15374 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.507903 15382 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.419540 15373 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.509654 15341 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.510077 15366 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.510737 15373 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.511431  8837 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 18.
I20260709 13:18:23.512490 15393 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.514174 15400 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.514660 15390 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.514839 15400 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.515262 15390 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.515573 15398 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.481755 15396 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.517320  8840 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:23.485073 15375 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.488215 15378 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.519244 15374 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.520603 15390 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.494393  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.521764  8836 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:23.506496 15384 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.494575 15406 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.522850  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.524291 15406 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.502800 15402 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.524780  8842 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:23.525084 15402 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.525800 15401 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.526496 15401 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.527443 15402 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.508065 15383 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.470259 15404 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.529585 15404 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.532176 15387 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.532353 15404 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.532572 15388 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.504565 15394 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.487684  8769 raft_consensus.cc:2468] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:23.539528  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.539892  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.540814  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.538990 15362 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.544337  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.499471 15395 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.545239  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.545591 15401 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.545624  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.545243 15400 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:23.549655  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 146625us
I20260709 13:18:23.549541  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.464578 15385 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.561110 15385 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.282624  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:23.493813  8698 debug-util.cc:398] Leaking SignalData structure 0x7b080030a9c0 after lost signal to thread 8793
I20260709 13:18:23.486330  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 285) took 1806 ms. Trace:
W20260709 13:18:23.594158  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 161051us
W20260709 13:18:23.597512  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 194847us
I20260709 13:18:23.601500  8884 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:23.603884  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 109424us
I20260709 13:18:23.609521 15400 raft_consensus.cc:2804] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:23.610276  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.611426  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.624140  9466 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:23.624408 15400 raft_consensus.cc:697] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:23.611616  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:18:23.613531  8698 debug-util.cc:398] Leaking SignalData structure 0x7b080023ea60 after lost signal to thread 8868
I20260709 13:18:23.625995 15410 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:23.626773 15410 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.626223 15400 consensus_queue.cc:237] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:23.626140  8698 debug-util.cc:398] Leaking SignalData structure 0x7b0800315f00 after lost signal to thread 8869
W20260709 13:18:23.630275  8698 debug-util.cc:398] Leaking SignalData structure 0x7b080000fa00 after lost signal to thread 8942
W20260709 13:18:23.633397  8698 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0a80 after lost signal to thread 9492
W20260709 13:18:23.634517  8698 debug-util.cc:398] Leaking SignalData structure 0x7b0800090300 after lost signal to thread 15371
I20260709 13:18:23.637658 15394 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:23.639261  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.627333 15410 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:23.641646  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 44724.6us
I20260709 13:18:23.642378  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.644477 15394 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:23.645113 15394 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.645677 15394 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:23.650876  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:18:23.651887  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.653023 15377 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:23.653507 15377 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.653934 15377 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.589859  8665 rpcz_store.cc:276] 0709 13:18:21.679711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.679867 (+   156us) service_pool.cc:224] Handling call
0709 13:18:23.486243 (+1806376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:21.688671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:21.689292 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:21.689326 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:21.689346 (+    20us) tablet.cc:662] Decoding operations
0709 13:18:21.690075 (+   729us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:21.690117 (+    42us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:21.690149 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:21.690336 (+   187us) tablet.cc:701] Row locks acquired
0709 13:18:21.690355 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:21.690497 (+   142us) write_op.cc:270] Start()
0709 13:18:21.690779 (+   282us) write_op.cc:276] Timestamp: P: 1783603101690449 usec, L: 0
0709 13:18:21.690806 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:18:21.692938 (+  2132us) log.cc:844] Serialized 538 byte log entry
0709 13:18:21.867775 (+174837us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd95e28 00007fce737d0581 00007fce737cfd58 00007fce737d49f1 00007fce737d49a9 00007fce737d4939 00007fce737d4901 00007fce737d3b2d 000000000038f354 000000000038f199
0709 13:18:23.250947 (+1383172us) op_driver.cc:464] REPLICATION: finished
0709 13:18:23.257184 (+  6237us) write_op.cc:301] APPLY: starting
0709 13:18:23.257299 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:23.258291 (+   992us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:23.258316 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:23.259055 (+   739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:23.259322 (+   267us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:23.259369 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:23.259567 (+   198us) log.cc:844] Serialized 25 byte log entry
0709 13:18:23.259718 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:23.259788 (+    70us) write_op.cc:454] Released schema lock
0709 13:18:23.259820 (+    32us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:23.260181 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:23.260207 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":5966,"apply.run_cpu_time_us":2974,"apply.run_wall_time_us":2974,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":12418,"prepare.run_wall_time_us":179287,"replication_time_us":1559983,"spinlock_wait_cycles":3233152}]]}
I20260709 13:18:23.657045  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:23.657567  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.658658 15392 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:23.661007  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48845.7us
I20260709 13:18:23.661516  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.665046 15403 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:23.665714 15403 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.666268 15403 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:23.674918  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.679867  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.692500 15313 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.693328  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.693380 15313 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.696372 15313 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.683734  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.710507  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.731112  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.733193  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:23.735966  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58198.8us
I20260709 13:18:23.736508 15374 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.737238 15374 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.737834 15374 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.741273 15388 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.741466  8735 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.741854 15388 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.742317 15388 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.742681 15398 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:23.744174  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.747423 15398 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.748023 15398 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.749913  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.750568 15392 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.748586 15398 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.754268  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.751552 15392 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.756260  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.758759  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.753268  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.764043  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.768149  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.769028  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.764075  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.770287  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.769698  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:23.771812  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.772675  9462 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:23.773108  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.774086  9468 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:18:23.781440  8735 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:23.783166 15395 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.736553 15403 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.787987  8840 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:23.789245 15403 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.797891 15394 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.801994 15394 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.801680 15410 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.810277  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.811101 15410 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.802775 15406 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:23.803191 15392 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:23.785900  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.805706  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.806128  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.815265 15373 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.815912 15373 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:23.816461 15373 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.823304 15377 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.826128  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.829887  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.831674  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.820753 15388 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.836179 15388 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.842653 15366 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:23.843201 15366 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:23.843619 15366 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:23.843362 15374 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.844797  8835 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:23.853475 15366 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:23.853103  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48901.4us
I20260709 13:18:23.855882 15366 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.842707  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:23.859961  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:23.860807 15410 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.861581 15410 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.862097 15410 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.866767  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.846052 15374 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.877141 15403 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:23.877734 15403 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.878247 15403 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.880141  9462 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:23.880347  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.881284  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.881683  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.883474  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.901183 15377 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:23.938334  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.950604  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.904637  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.919097  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:23.963294  8916 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 22.
I20260709 13:18:23.909087 15373 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.900522  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.949827  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:23.908907  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.933871  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:23.968674 15299 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:23.969491  8842 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:23.970539  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.966513 15373 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.893321  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:23.972642  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.904235  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:23.925117  8883 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:23.888659  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:23.974634  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:23.975090  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 50319.8us
I20260709 13:18:23.903007 15398 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.975682 15392 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:23.976411  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:23.977838  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.978220 15398 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:23.977088  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.979316  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:23.978593 15392 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.890391  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:23.980296 15392 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.980814 15392 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.985512 15400 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:23.986189 15400 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:23.986887 15400 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:23.988934 15410 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:23.991981 15383 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:23.992980 15408 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.998550 15299 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:24.000326  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 107198us
I20260709 13:18:24.000718 15373 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:24.000339  8809 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.002024 15400 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.005517 15403 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.011073 15392 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:23.887995  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.025681  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.026924 15408 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.029548  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.026626  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.021311 15373 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:24.035508  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.035670  8809 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.036270  8915 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 12.
I20260709 13:18:24.033131 15374 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.040894 15366 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.041795  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.040087  8913 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:24.031648 15383 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.034343 15373 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:24.030761 15403 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.045159  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a85c28eb5f2e4741b40ca8723a62f870" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.041646  8909 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 23.
I20260709 13:18:24.050722 15299 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.052465  8911 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:24.057081  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.062739  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.068794  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.068353  8917 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:24.055070 15400 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:18:24.073004  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 185140us
I20260709 13:18:24.073966  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.074753  8912 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:24.071985  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:24.078684  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.071884  8915 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:24.076360  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.082244  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.087002  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.087642 15392 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:24.089522  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.089867  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.090377  8835 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:24.091995 15408 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:24.093492  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.093971 15383 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:24.085884  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.098575  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:24.099680  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.097810 15299 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.100720 15403 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:24.101447 15374 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:24.101686 15403 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.105345  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.105928 15403 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:24.101231 15299 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.107734 15299 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.109632  9434 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.110419  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.111233 15413 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.112536 15413 raft_consensus.cc:493] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.104773 15410 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.084096 15406 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:24.113638 15406 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.114156 15406 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:24.115010  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.115236  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.113147 15413 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.117419  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.119463  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.120800  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.123795  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.124400  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.124939  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.125470  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.126065  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.126312 15408 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.126664  8912 raft_consensus.cc:1240] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.126825  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.127136 15408 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:24.128036  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.128010 15366 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.128991 15366 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.129576 15366 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:24.141242  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.153354  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.129576  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.157974  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.159631  8840 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:24.160923  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.161211  8837 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:24.161445  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.162336  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.162667 15373 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.158018 15410 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:24.179049  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 49638.1us
I20260709 13:18:24.180006  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.181115 15410 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.181861 15410 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.182340 15410 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.181098  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.180228 15403 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.183979  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.181391 15406 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.185444  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.187065 15403 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.179353 15299 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.172123 15413 raft_consensus.cc:515] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.191948  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.192795 15392 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.195989  8842 raft_consensus.cc:1240] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:24.196018  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 69279.2us
I20260709 13:18:24.202963  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.203902 15392 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.193516  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.204375  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.205004  8911 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:24.205809  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.206990  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.207684  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.208231  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.209120  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.209299  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.210246  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.211540  8807 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:24.211925  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.210366  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.212541 15374 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:24.233705  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.235024  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.234067  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:24.233264  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.238463  9461 raft_consensus.cc:1240] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:24.218444 15392 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.236219 15366 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.235234 15383 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.244290 15330 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.245523 15299 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.247362  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.247614  8808 leader_election.cc:304] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.243357 15406 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.232020 15374 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.245412 15366 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.257761 15330 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:24.261451 15394 raft_consensus.cc:2749] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.256323 15410 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.264339  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.266788  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.270738  8836 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 3b34c95a175945b88b17f07fbc650abf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:24.272517  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.272899  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.274190  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.276129 15400 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.270274 15403 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.276914 15375 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.277336 15375 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.277719 15375 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.279768 15412 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:24.281104 15412 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:24.283365 15383 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:24.283813 15383 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.285055 15383 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.287184 15383 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:24.291986 15408 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:24.299101 15408 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.254608 15374 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:24.300474 15408 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.301631  8884 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:24.302217 15408 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.302573 15400 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.302691  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:24.303107 15400 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.303596 15400 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.305771 15327 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.306254 15327 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.306368 15410 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.306674 15327 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.309062  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.320834 15377 consensus_queue.cc:1059] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:18:24.322297 15377 raft_consensus.cc:3055] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:24.322772 15377 raft_consensus.cc:740] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:24.323870 15377 consensus_queue.cc:260] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.327723 15377 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.328775 15412 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:24.330020 15413 leader_election.cc:290] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:24.330336 15412 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:24.330902 15373 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.330927 15412 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.332717  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.336047 15392 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.333056 15330 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:24.311635  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:24.334833 15327 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.349509  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.354229 15400 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.356503 15400 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:24.357612  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 100583us
W20260709 13:18:24.365581  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 97386.3us
I20260709 13:18:24.366520  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.367555 15413 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.368041  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.369088 15413 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:24.373525  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 78335.6us
I20260709 13:18:24.379257  8808 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.377811  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.376075 15392 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:24.380321 15392 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.381522 15392 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.383682 15392 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.389179 15373 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:24.389709 15420 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.396270  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.396646  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.396950  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:24.397500  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.401355  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.402240  8842 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:24.402944 15412 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.404317 15412 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.405153  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.406566  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.407892  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.408119  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.408528  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:24.409217  8913 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:24.410279  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.401477  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.411389  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.412093  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:24.412838  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 86093.1us
I20260709 13:18:24.413990  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.415227  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.416391  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.417233  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.394949 15400 consensus_queue.cc:1059] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:24.390368 15410 raft_consensus.cc:2749] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.410352 15416 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:24.420140  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.422019  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.389767 15373 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.432160 15373 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:24.428236  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.428256  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.434480 15327 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:24.428544  8844 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.442219  8909 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:24.445363  8844 raft_consensus.cc:1240] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:24.446435 15382 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:24.450330  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.450407  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.454600  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.421085 15375 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.459220 15375 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.463267  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.463871  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.464926  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.441423 15374 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.467721 15374 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.468948  8766 raft_consensus.cc:2468] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 19.
I20260709 13:18:24.475174  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.477428  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.478708  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.479422  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.476578  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:24.484541  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57293.8us
I20260709 13:18:24.486876  8808 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.498447 15374 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.504557  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.505220  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.510107  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.513597  8844 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.513911 15327 raft_consensus.cc:3055] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:24.514321 15327 raft_consensus.cc:740] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.515636 15327 consensus_queue.cc:260] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.516989 15327 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:24.516749 15373 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.519232 15373 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 24 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:24.521329  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79502.7us
I20260709 13:18:24.526078  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.528452  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:24.529505  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.535842  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.537444  8838 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:24.538790 15313 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.530260  9432 leader_election.cc:304] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:18:24.541204  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.542021 15377 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.543390 15420 raft_consensus.cc:2804] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:24.544433 15420 raft_consensus.cc:697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 19 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:18:24.546731 15420 consensus_queue.cc:237] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.549237 15421 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:24.550515 15421 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:24.550863 15421 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:18:24.550894  8844 raft_consensus.cc:2468] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:24.551820 15421 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.553701 15421 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.554394 15383 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:24.556649  8884 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.560657  8761 raft_consensus.cc:1240] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:24.561973  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.564177  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.554579  9431 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.573468 15418 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:24.573295 15383 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.564978  8766 raft_consensus.cc:1275] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:24.564414  8760 raft_consensus.cc:1240] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.573700  8844 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.547389  8912 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:24.564930  8915 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:24.581247 15377 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.574385  9466 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:24.574136 15418 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.582599 15418 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:24.583556  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.585055 15400 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.585314  8882 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.586196  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282538f07daf4dcdb59352e756a62ba8" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.586760  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.575961  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.579903  8884 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:24.588366 15408 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:24.588366 15377 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:24.600562 15313 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:24.601438 15313 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.602365  8882 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.603744  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.600528  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.588524 15400 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.606392  8840 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:24.623682  8841 raft_consensus.cc:1240] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:24.606489 15330 raft_consensus.cc:2804] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:24.617118  9431 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.617744 15416 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:24.618055  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:24.618283  8835 raft_consensus.cc:1240] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.604629 15392 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:24.621012  8836 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:24.617002  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52924us
I20260709 13:18:24.638764  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.604029 15313 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.643236  8732 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.645563 15420 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:24.666337  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.666661 15416 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.668788  8836 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:24.669612  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.670176  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:24.672312 15416 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.673090 15383 consensus_queue.cc:1059] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:24.673915  9431 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.674256 15383 raft_consensus.cc:3055] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:24.674815 15383 raft_consensus.cc:740] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.677234 15416 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:24.677430  8838 raft_consensus.cc:1240] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.679493  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.680380  8839 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:24.676014 15383 consensus_queue.cc:260] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.681825 15383 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.684324  8917 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:24.687491  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.621578 15418 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.689622  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:24.690701 15418 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.601393 15377 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.621855 15408 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.653963  8841 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:24.654492 15330 raft_consensus.cc:697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:24.656363  8835 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:24.661744  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:24.679628  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.699499  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:24.701948  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58859.5us
I20260709 13:18:24.648111  8665 catalog_manager.cc:5697] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 19 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:24.725996  8916 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
W20260709 13:18:24.738703  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 51398.2us
I20260709 13:18:24.739521  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.742704 15429 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:24.709084 15398 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:24.746479  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 66945.4us
I20260709 13:18:24.721468 15418 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.753400 15330 consensus_queue.cc:237] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.737795 15375 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.757364  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:24.798539  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 194865us
I20260709 13:18:24.804154 15382 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55342 (request call id 3) took 1705 ms. Trace:
W20260709 13:18:24.810501  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 66212.3us
I20260709 13:18:24.819936  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:24.798312 15406 raft_consensus.cc:2764] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:18:24.833534  9431 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.837224  8882 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.810184 15375 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:24.840339  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83064.2us
I20260709 13:18:24.841223  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.835846 15410 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.838673 15398 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:24.847468 15415 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:24.809306 15429 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.839754 15375 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.840171 15400 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:24.865204  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46205.8us
I20260709 13:18:24.870105 15419 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.871074 15432 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:24.871796 15432 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.874471 15432 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.821702 15382 rpcz_store.cc:276] 0709 13:18:23.098287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.098432 (+   145us) service_pool.cc:224] Handling call
0709 13:18:23.110186 (+ 11754us) log.cc:844] Serialized 494 byte log entry
0709 13:18:24.804021 (+1693835us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":238,"raft.run_cpu_time_us":1594,"raft.run_wall_time_us":1595,"thread_start_us":54942,"threads_started":1,"wal-append.queue_time_us":55230,"wal-append.run_cpu_time_us":1738,"wal-append.run_wall_time_us":1001694}
I20260709 13:18:24.879400 15377 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:24.897890 15429 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.898597 15429 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:24.899993 15429 consensus_queue.cc:1059] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 21.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:24.901090 15432 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:24.901150 15377 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:24.902421 15432 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:24.902859 15432 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:24.850315 15394 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:24.907747  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 66605.8us
W20260709 13:18:24.907887  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 70750.1us
I20260709 13:18:24.910961  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:24.923393  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:24.933710  8807 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.912003 15432 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.935446 15432 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.936801 15382 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:24.937707 15382 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:24.938269 15382 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.920755 15375 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.946777 15375 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:24.907094 15398 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:24.947757 15398 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:24.948812 15398 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.950733 15398 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:24.953830  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.958240  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49146.3us
I20260709 13:18:24.960270  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.905272 15394 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:24.965576  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 69348.2us
I20260709 13:18:24.911042 15429 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:24.923182 15430 raft_consensus.cc:3055] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:24.969935  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:24.965970 15406 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:18:24.970983  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 131538us
I20260709 13:18:24.970359 15394 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.981748 15436 consensus_queue.cc:1059] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:18:24.971920 15374 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.971835 15430 raft_consensus.cc:740] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:24.971127 15429 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:24.985522  8841 raft_consensus.cc:3060] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.994524 15430 consensus_queue.cc:260] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:24.996201 15430 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:24.995959 15313 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:24.997970 15437 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:24.998600 15437 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:24.978477 15406 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.017974  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:25.020092 15435 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:25.020776 15435 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:18:25.025096  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.025727  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.026077  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:25.042953  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 70286.8us
I20260709 13:18:25.047058  8841 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:18:25.016753 15437 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:18:25.053272  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 75633.4us
I20260709 13:18:25.046764 15382 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.059577  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:25.075769 15382 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:25.054312 15419 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260709 13:18:25.078514 15375 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:25.078950 15377 raft_consensus.cc:3055] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:25.079200 15375 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.079377 15377 raft_consensus.cc:740] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.080359 15375 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.065486 15429 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.085866 15429 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.087941  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:25.095145  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 122481us
I20260709 13:18:25.080556 15377 consensus_queue.cc:260] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.099100  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.108137  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:25.113963 15440 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.077s	user 0.000s	sys 0.006s
I20260709 13:18:25.097035 15406 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:25.113520 15377 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.122404 15434 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.120494  9466 raft_consensus.cc:1240] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:25.125855 15436 consensus_queue.cc:1059] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:25.127261 15398 raft_consensus.cc:3055] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:25.127913 15398 raft_consensus.cc:740] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.129212 15398 consensus_queue.cc:260] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:25.130136 15394 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.130738 15398 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:25.131412  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:25.132483 15426 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.121049 15313 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.121695 15441 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:25.120339  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.132735  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:25.136440  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.136538  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:25.137912 15444 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.141090 15426 consensus_queue.cc:1059] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:25.142793 15426 raft_consensus.cc:3055] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:25.143226 15426 raft_consensus.cc:740] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:25.146515 15383 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.147516 15383 consensus_queue.cc:1048] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.147279  8661 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 3 to 10, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.149128 15412 consensus_queue.cc:1059] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:25.149895  8661 catalog_manager.cc:5697] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 17 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:25.022032 15435 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.150907 15330 raft_consensus.cc:3055] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:25.157572  8732 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.154021 15442 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:25.138839 15432 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:25.159361  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60280.6us
I20260709 13:18:25.174892  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.149571 15394 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:25.162967  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:25.159057 15330 raft_consensus.cc:740] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:25.167372  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:25.169214 15436 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.186056 15330 consensus_queue.cc:260] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:25.158444  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 50123.4us
I20260709 13:18:25.188341 15330 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.180007  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.144485 15426 consensus_queue.cc:260] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.185328 15313 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:25.198601  8807 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:25.202935  8732 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.197346 15377 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.216068  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:25.216933  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:25.216830  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:25.224591  8918 raft_consensus.cc:1240] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:18:25.226640  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:25.199934 15394 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.199759 15313 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:25.228739  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:25.228341 15430 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:25.236500  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:25.237006  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.232699 15445 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.233688 15313 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.260311 15373 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.278602  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.260221 15299 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:25.256436 15377 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:25.268656  8764 raft_consensus.cc:1275] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:18:25.269085 15430 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.270922  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.283598 15377 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.281121 15373 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.288518 15373 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.280622 15299 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.285794 15430 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:25.294531  8807 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:25.310730 15299 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.299120 15375 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 13:18:25.318023  8909 raft_consensus.cc:1240] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:25.320153 15382 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:25.320485 15426 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.323341 15377 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:25.325420  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51c7e309721f4da1bcd1626da407d364 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:18:25.326047 15374 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.326483 15374 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.326833 15430 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:25.327346 15374 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:25.331586 15382 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.334821 15435 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.332609 15382 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.340101  8766 raft_consensus.cc:2468] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 23.
I20260709 13:18:25.341068  8763 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:25.361142 15429 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:25.363641 15429 consensus_queue.cc:1059] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:25.366925  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.328744 15374 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.375304  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:25.375701  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:25.383812  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.369807 15441 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.386472  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:25.388399  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.386523  8735 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.391551  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.393258  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.397008  8840 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.382552 15432 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.407783  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.407985  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.408229  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.409065  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.389711 15441 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.410162  8839 raft_consensus.cc:1240] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:25.391750 15437 consensus_queue.cc:1059] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:18:25.434026 15437 raft_consensus.cc:3055] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:25.434476 15437 raft_consensus.cc:740] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.405870 15429 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.425848 15446 consensus_queue.cc:1059] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:18:25.426296  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:18:25.442297  8733 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.445833 15437 consensus_queue.cc:260] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.403541 15394 consensus_queue.cc:1059] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:25.451905 15394 raft_consensus.cc:3055] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:25.452368 15394 raft_consensus.cc:740] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.459880  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.462098  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.473279  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:25.474066  8917 raft_consensus.cc:1240] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.476648  8837 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:25.477607  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.479187  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:25.480661  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:25.482384  8918 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 14: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:25.482940  8732 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.484112  8732 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.487128 15394 consensus_queue.cc:260] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:25.489104 15456 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.000s	sys 0.002s
I20260709 13:18:25.483359 15437 raft_consensus.cc:3060] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.483506 15408 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:25.459367 15313 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.498150  8769 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.499533 15313 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:25.497290 15398 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.482545 15446 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.503628 15377 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:25.504132 15377 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.498140 15436 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:25.447182 15441 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.517285 15377 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.519642 15377 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:25.510259 15436 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.526645  8808 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.530284 15445 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.532661  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.535729 15375 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.536026 15430 raft_consensus.cc:3055] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:25.536379 15375 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.536706 15430 raft_consensus.cc:740] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.537904 15430 consensus_queue.cc:260] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.541181  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.542327 15458 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:25.542477  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 136967us
I20260709 13:18:25.542523  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.537951 15375 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.547035 15430 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:25.547678 15426 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.548220 15426 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.550983 15426 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:25.538856 15446 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.551847  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:25.552600  8769 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
I20260709 13:18:25.554109 15441 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.558020  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:25.526377 15436 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.574239 15436 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.573509  8663 catalog_manager.cc:5697] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 17 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.587800  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:25.588887  8842 raft_consensus.cc:1240] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:25.563105 15299 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.590493  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.569535 15330 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:25.596076  8916 raft_consensus.cc:2955] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 3 to 10, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:25.607519  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.608343  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.609229  8843 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 22: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:25.622236  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet 51c7e309721f4da1bcd1626da407d364 with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:60040
I20260709 13:18:25.604995 15330 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.630462 15330 raft_consensus.cc:3060] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:25.603273 15382 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:25.639601 15394 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:25.661696  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54266.9us
I20260709 13:18:25.668902 15464 tablet_replica.cc:333] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
W20260709 13:18:25.671326  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 200706us
W20260709 13:18:25.672789  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 100669us
I20260709 13:18:25.675172  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.677050  9432 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.679224  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:25.680549 15430 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:25.683980  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.665123 15377 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.686179  8808 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.678581 15419 consensus_queue.cc:1048] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:18:25.692261  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:25.683652 15435 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.697702 15460 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:25.677841 15446 consensus_queue.cc:1059] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:18:25.685262 15418 raft_consensus.cc:2804] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:25.699292 15418 raft_consensus.cc:697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 23 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:18:25.699419 15446 raft_consensus.cc:3055] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.699954 15446 raft_consensus.cc:740] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.700381 15418 consensus_queue.cc:237] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:25.700961 15446 consensus_queue.cc:260] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.705075 15446 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.710016 15442 consensus_queue.cc:1059] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:25.713620  8918 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:25.714337 15435 raft_consensus.cc:3055] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:25.714787 15435 raft_consensus.cc:740] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:25.715763 15435 consensus_queue.cc:260] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.720551 15435 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.726792  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:25.729072 15432 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:25.729750 15432 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:25.730333  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 44211.7us
I20260709 13:18:25.731182 15366 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:25.740705 15430 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.745824 15432 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:25.750370 15374 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.751298  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.752171  8843 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:25.747311  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:25.753744  9468 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:25.755074  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:25.762840  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.759509  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.770433  8761 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.768234 15443 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.777590  8808 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:25.771039 15426 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.780071 15426 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.771499 15460 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.775673 15398 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.790285 15460 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:25.788429 15366 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:25.797554 15460 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.797612 15464 raft_consensus.cc:2243] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:25.804544 15366 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:25.804991 15366 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:25.805157 15330 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.775764 15299 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:25.773586 15443 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.800944  8761 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:18:25.826395  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54088us
I20260709 13:18:25.784839 15406 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:25.829530 15464 raft_consensus.cc:2272] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:25.806180 15366 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.837479  8760 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.846257  8765 raft_consensus.cc:1275] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:18:25.846701  8765 pending_rounds.cc:85] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 10
I20260709 13:18:25.846897  8765 pending_rounds.cc:107] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:18:25.847169  8765 raft_consensus.cc:2889] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:25.852315 15426 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:25.853125  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:25.854125  8763 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:25.856568  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:25.867784 15392 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.868225 15470 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:25.868453 15392 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:25.872215  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:25.872638  8761 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:25.873250  8764 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:25.876341  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:25.870849 15392 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:25.877261  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.868752 15470 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.877763  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.897742  8843 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:25.864557 15464 ts_tablet_manager.cc:1916] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:25.901933  8760 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:25.902890  8837 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 21: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:25.871188 15406 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:25.899657 15470 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.934763  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:25.935500  8765 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:25.912153 15299 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:18:25.908175 15373 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:18:25.924619 15443 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:25.929507 15467 consensus_queue.cc:1048] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:25.936836  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:25.938563  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:25.909581 15392 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:25.949427  8837 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:18:25.945869 15463 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:18:25.919157 15472 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.972384  8913 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:18:25.995293  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 90223.7us
I20260709 13:18:25.949054 15392 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:25.975886 15366 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.961431 15430 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:25.968731 15435 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.990064 15446 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:25.958773 15473 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.002538 15392 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.995116 15472 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.036418 15467 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.034864 15473 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:26.031410 15435 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.044651 15446 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.057485 15473 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.108140  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:26.077975 15467 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.129182  8913 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:26.133641  8837 raft_consensus.cc:1240] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:26.138523  8912 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.158800 15408 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.159412 15408 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.160807 15442 consensus_queue.cc:1059] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:26.161780 15435 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:26.162010 15442 raft_consensus.cc:3055] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:26.162470 15442 raft_consensus.cc:740] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:26.164458  8663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 235) took 1002 ms. Trace:
I20260709 13:18:26.166817 15467 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.164899  8663 rpcz_store.cc:276] 0709 13:18:25.162248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.162734 (+   486us) service_pool.cc:224] Handling call
0709 13:18:25.218947 (+ 56213us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:26.164401 (+945454us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:25.605461 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:25.628916 (+ 23455us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:25.628952 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:18:25.628969 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:25.629337 (+   368us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:25.629390 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:25.629416 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:25.629600 (+   184us) tablet.cc:701] Row locks acquired
0709 13:18:25.629616 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:25.629766 (+   150us) write_op.cc:270] Start()
0709 13:18:25.629873 (+   107us) write_op.cc:276] Timestamp: P: 1783603105629706 usec, L: 0
0709 13:18:25.629893 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:25.680531 (+ 50638us) log.cc:844] Serialized 538 byte log entry
0709 13:18:25.740365 (+ 59834us) op_driver.cc:464] REPLICATION: finished
0709 13:18:25.775915 (+ 35550us) write_op.cc:301] APPLY: starting
0709 13:18:25.777520 (+  1605us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:25.865297 (+ 87777us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd95e28 00007fce737d0581 00007fce737cfd58 00007fce737d49f1 00007fce737d49a9 00007fce737d4939 00007fce737d4901 00007fce737d3b2d 000000000038f354 000000000038f199
0709 13:18:25.974158 (+108861us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:25.974184 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:25.975037 (+   853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:25.975344 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:25.975393 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:25.975597 (+   204us) log.cc:844] Serialized 25 byte log entry
0709 13:18:25.975796 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.975884 (+    88us) write_op.cc:454] Released schema lock
0709 13:18:25.975922 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:25.976333 (+   411us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:25.976375 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5289,"reported_tablets":3,"spinlock_wait_cycles":20823936,"child_traces":[["op",{"apply.queue_time_us":18967,"apply.run_cpu_time_us":5038,"apply.run_wall_time_us":210652,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"mutex_wait_us":7578,"num_ops":1,"prepare.queue_time_us":5284,"prepare.run_cpu_time_us":7338,"prepare.run_wall_time_us":277853,"replication_time_us":110289,"spinlock_wait_cycles":114917632}]]}
I20260709 13:18:26.169210 15446 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:26.135556 15403 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:26.173499 15445 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:26.169242  8660 catalog_manager.cc:5697] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 22 to 23, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 23 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:26.175808 15472 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.163379 15442 consensus_queue.cc:260] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.178604 15442 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.179625 15330 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.181313 15460 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.183652 15460 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:26.188520  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:26.190294  8769 raft_consensus.cc:2468] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
I20260709 13:18:26.192219  8761 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:26.192355 15470 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.194782 15470 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.195678 15392 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.198081 15392 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.200565 15461 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:26.205825 15408 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:26.207420  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.208326  8843 raft_consensus.cc:2393] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 20: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:26.209358  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.211371  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:26.212139  8843 raft_consensus.cc:2393] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:26.216903  8665 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 18 to 19, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 19 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.218947  8665 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 13 to 14, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 14 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.217549  8843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:26.220335  8843 raft_consensus.cc:606] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:26.222723 15464 ts_tablet_manager.cc:1929] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 13:18:26.224543 15464 log.cc:1199] T 51c7e309721f4da1bcd1626da407d364 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/51c7e309721f4da1bcd1626da407d364
I20260709 13:18:26.230350  9468 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:26.229496  8665 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 15 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 16 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.232201  8734 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:26.232697  8665 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 17 to 18, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 18 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.233940  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet 51c7e309721f4da1bcd1626da407d364 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:18:26.234704  8665 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 15 to 16, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 16 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:26.240504  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.241320  8837 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:26.242599  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.243227  8837 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:18:26.244542  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:26.245247  8837 raft_consensus.cc:2393] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 22: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:26.230535  8912 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:26.246498  8913 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:26.257859  8769 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:26.233803 15460 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:26.281878  8765 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:26.311931 15479 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:26.322044 15481 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:26.323536  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:26.324638  8837 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:26.325556  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.326283  8835 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:18:26.323618 15481 raft_consensus.cc:993] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:26.337914 15482 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.338507 15482 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.280814 15446 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.343219 15481 raft_consensus.cc:1081] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:26.326539 15487 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:26.360796  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:26.363034  8884 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:26.373441  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 259032us
I20260709 13:18:26.381621  8843 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 21: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:26.379014  8884 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:26.305462 15460 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:26.396921  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:26.399235  8765 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:26.377077 15446 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.407718 15446 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:26.280248 15473 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.388746 15470 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:26.415127  8884 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:26.392321 15392 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:26.423981  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:26.424790  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:26.428838  8769 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:18:26.430775 15392 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.431263 15392 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.392841 15479 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:26.409466 15482 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:26.433463  8915 raft_consensus.cc:3060] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:26.433655  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:26.435500 15494 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:26.443470 15392 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:26.469449  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 54374.1us
I20260709 13:18:26.471980  8915 raft_consensus.cc:1275] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:26.477564  8882 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:26.419677 15470 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.534978  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:26.532027  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:26.540371  8909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
W20260709 13:18:26.545285  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 74717.2us
I20260709 13:18:26.548877 15443 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.549162 15482 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.549448 15443 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.549695 15482 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.551609 15443 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:26.552116 15443 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.553505 15477 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:26.554060 15477 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.551609 15482 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:26.552587 15443 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.556177 15477 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.557755 15490 raft_consensus.cc:2804] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:26.557364 15460 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.558326 15490 raft_consensus.cc:697] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 22 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:26.559237 15490 consensus_queue.cc:237] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.9, Last appended by leader: 9, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:26.557430  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 80018.6us
I20260709 13:18:26.564880  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:26.567662 15419 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:26.568521 15419 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.571540 15419 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:26.468339 15446 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.592809  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.593569  8837 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:26.596511  8735 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:26.436487 15494 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.601359  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.614300  8837 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:26.542330 15470 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:26.604683  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 220308us
I20260709 13:18:26.539499 15478 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:26.651360  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:26.644737  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.679497  8839 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:26.616595  8909 raft_consensus.cc:606] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:26.679841  8769 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:26.680043  8909 raft_consensus.cc:614] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:26.654620  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.659107  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:26.602336 15442 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.603454 15446 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.600265 15496 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.685436 15496 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.681036  8838 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:18:26.687906 15496 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.687815  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:26.689545  8839 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:26.690097  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:26.690244 15496 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.692256  8735 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:26.692536 15496 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.693545 15435 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:26.694247 15435 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.694667 15435 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.695108 15496 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.684490 15446 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:26.703590 15392 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.705510  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:26.706559  8762 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:26.707027  8762 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.706456 15435 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.710436 15382 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.711382 15382 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:26.719805 15486 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:26.720677 15486 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.722275 15473 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.723387 15486 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.557366 15443 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:26.730304  8763 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:26.690822  8910 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:26.740588  8765 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:26.750168  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:18:26.755008  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 188325us
I20260709 13:18:26.760106  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:26.680465 15478 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.774886  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:26.775938  8765 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:18:26.728404 15442 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.735755 15436 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:26.784446 15478 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.789439 15442 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.804770 15430 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.848417  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:26.850279  8917 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 17.
I20260709 13:18:26.882448  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:26.852820  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:26.901357  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:26.858727 15430 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:26.832159 15499 consensus_queue.cc:1048] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:18:26.892850  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:18:26.914043 15498 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:18:26.921164  8910 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:26.931296  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:26.933379  9461 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:26.934746  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:26.924355  8762 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:26.941771  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 89016.2us
I20260709 13:18:26.946331 15382 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:26.917099 15505 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:26.966468  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:26.946848 15392 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:26.977679  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:26.986766  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:26.989878 15507 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:18:26.992282 15500 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:18:27.001885  8762 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:27.012660  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 76031.8us
I20260709 13:18:26.975841 15494 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:26.985038 15490 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:27.008739 15443 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:27.022827 15511 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:27.023427 15511 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:27.023909 15511 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:27.027321 15490 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:27.010921 15392 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:27.030377 15497 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.236s	user 0.001s	sys 0.001s
I20260709 13:18:27.030275 15392 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.018563 15443 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.032596 15443 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.032896 15470 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.035151 15470 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.035954  8911 raft_consensus.cc:2368] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:27.037343  8883 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:27.039074  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:27.039337 15442 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.040380 15486 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:27.041217  8761 raft_consensus.cc:2368] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 18. Current term is 19.
W20260709 13:18:27.023524 15503 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:18:27.028515 15490 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.048552 15442 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.041072 15486 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.052994 15486 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.053424 15486 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.058408  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.059264  8766 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:27.060384  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.063436  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.067399  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.068846  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.070721  8763 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:18:26.980373 15505 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.112555  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.113685  8762 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.103132  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.116569  9466 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:27.120756  8767 raft_consensus.cc:2393] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:27.124145  8767 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:27.126991 15511 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.082211 15330 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.129201 15330 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.131559 15330 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.134265 15494 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.134858 15494 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.135170 15511 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.139726  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.140548  8768 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.179481  8768 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:18:27.197233  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109646us
I20260709 13:18:27.205818  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:27.161374 15494 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.204483  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.214352 15509 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.149610 15443 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.218456  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.206688  9459 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:27.216722  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:18:27.192495 15506 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.259s	user 0.005s	sys 0.001s
I20260709 13:18:27.222905  8769 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:27.154681 15478 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.222788  8882 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.227708  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.198621 15460 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.231838  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:27.204808 15430 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.250967  8762 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:27.225809 15470 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:27.223698 15400 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:27.234155  8766 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:27.254397  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.255290  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:27.259359  8916 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.255481  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:27.260123  8918 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.221946 15458 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:18:27.268406  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.272060  8843 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 19.
I20260709 13:18:27.252360 15382 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.240440 15410 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:27.275449 15392 raft_consensus.cc:2804] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:27.260628 15400 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.263461 15470 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:27.268365 15505 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.231729 15509 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.303623  8882 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.306809  8916 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:18:27.241813 15460 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:27.308383  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 107749us
I20260709 13:18:27.310124  8882 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.285466 15410 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.313829  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.315872  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.317203  8766 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:27.317235  8912 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:27.325392  8762 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:18:27.325786  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:27.292794 15400 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.293318 15516 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:27.306455 15470 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:27.343055  8768 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:27.288434 15382 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.325086 15410 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.312129 15392 raft_consensus.cc:697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:27.357295 15430 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:27.357584 15392 consensus_queue.cc:237] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.357975 15430 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.360157 15430 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:27.331806 15490 raft_consensus.cc:2804] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:27.366940 15478 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:27.367151 15382 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.367759 15443 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.369989 15525 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.354244  8764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 3502) took 1245 ms. Trace:
I20260709 13:18:27.384095 15460 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.386343 15509 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.334012 15516 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.390962 15516 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.391942 15400 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.370018 15490 raft_consensus.cc:697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:27.408504 15490 consensus_queue.cc:237] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.371312  8764 rpcz_store.cc:276] 0709 13:18:26.108319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.108452 (+   133us) service_pool.cc:224] Handling call
0709 13:18:26.118299 (+  9847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.118674 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.118693 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.119149 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.401305 (+282156us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:26.422292 (+ 20987us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.422511 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.422812 (+   301us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.350908 (+928096us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b18002e0c60. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:18:27.353496 (+  2588us) raft_consensus.cc:1685] finished
0709 13:18:27.353814 (+   318us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.354049 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21063,"prepare.run_cpu_time_us":18473,"prepare.run_wall_time_us":55154,"raft.queue_time_us":5959,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":45176,"spinlock_wait_cycles":92396288,"thread_start_us":263378,"threads_started":1,"wal-append.queue_time_us":433073}
I20260709 13:18:27.422498  8918 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
W20260709 13:18:27.441428  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 46489.1us
W20260709 13:18:27.437131 15515 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:18:27.456670 15435 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.457681  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:27.458397  9459 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.482317  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 287) took 1750 ms. Trace:
I20260709 13:18:27.482821  8665 rpcz_store.cc:276] 0709 13:18:25.732062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.732226 (+   164us) service_pool.cc:224] Handling call
0709 13:18:27.482223 (+1749997us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:26.317573 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:26.318140 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:26.318174 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:18:26.318187 (+    13us) tablet.cc:662] Decoding operations
0709 13:18:26.318867 (+   680us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:26.318917 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:26.318948 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:26.319472 (+   524us) tablet.cc:701] Row locks acquired
0709 13:18:26.319494 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:18:26.319633 (+   139us) write_op.cc:270] Start()
0709 13:18:26.319748 (+   115us) write_op.cc:276] Timestamp: P: 1783603106319589 usec, L: 0
0709 13:18:26.319767 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:26.320428 (+   661us) log.cc:844] Serialized 2079 byte log entry
0709 13:18:26.390752 (+ 70324us) op_driver.cc:464] REPLICATION: finished
0709 13:18:26.429490 (+ 38738us) write_op.cc:301] APPLY: starting
0709 13:18:26.442546 (+ 13056us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:26.575033 (+132487us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:26.615324 (+ 40291us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:26.899243 (+283919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:26.948924 (+ 49681us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:18:26.962333 (+ 13409us) write_op.cc:312] APPLY: finished
0709 13:18:27.015735 (+ 53402us) log.cc:844] Serialized 57 byte log entry
0709 13:18:27.066336 (+ 50601us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:27.073788 (+  7452us) write_op.cc:454] Released schema lock
0709 13:18:27.077442 (+  3654us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:27.122803 (+ 45361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:27.144326 (+ 21523us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":20843,"apply.run_cpu_time_us":27402,"apply.run_wall_time_us":681616,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":14658,"prepare.run_cpu_time_us":3254,"prepare.run_wall_time_us":52050,"replication_time_us":54706}]]}
I20260709 13:18:27.491674  8911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42828 (request call id 3189) took 1068 ms. Trace:
I20260709 13:18:27.515043  8911 rpcz_store.cc:276] 0709 13:18:26.423621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.423732 (+   111us) service_pool.cc:224] Handling call
0709 13:18:27.491305 (+1067573us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54002b0f54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:18:27.491518 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398504320}
I20260709 13:18:27.502243 15516 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:27.507454 15442 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.508107  8663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 142) took 1176 ms. Trace:
I20260709 13:18:27.534409  8663 rpcz_store.cc:276] 0709 13:18:26.332171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.333487 (+  1316us) service_pool.cc:224] Handling call
0709 13:18:26.457267 (+123780us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:27.508007 (+1050740us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":194483968}
I20260709 13:18:27.495294 15486 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.526898  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:27.531808  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.547215  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.533244  9459 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:18:27.547857  8766 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
W20260709 13:18:27.558243  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 69780.9us
I20260709 13:18:27.551716  8883 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:27.568207  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 258152us
I20260709 13:18:27.540680 15436 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.571261  8910 raft_consensus.cc:2368] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 17. Current term is 18.
I20260709 13:18:27.542347 15508 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:27.570027  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.575627  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.579859  8839 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:27.580195  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:27.580953  8837 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:27.581722  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.575911  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:27.583365  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:27.583463  8838 raft_consensus.cc:3060] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.583988  8835 raft_consensus.cc:3060] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.586562  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.587302  8765 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.546603 15330 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:27.594846  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.576058  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.595569  8767 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.594264  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.594146  8842 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:27.596180  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:27.596814  9466 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:18:27.595525  8839 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
I20260709 13:18:27.592895  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:27.602149  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 159134us
I20260709 13:18:27.602581  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.603703  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.605820  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.605989  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.606684  8918 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:27.607112  8766 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:27.608430  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:27.609344  8918 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.616006  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.558954 15525 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:27.614157  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:18:27.725817  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 111742us
W20260709 13:18:27.726914  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75055.9us
I20260709 13:18:27.726248  8838 raft_consensus.cc:2468] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:18:27.727948  8882 leader_election.cc:400] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 18. Current term is 19.
I20260709 13:18:27.726747  8837 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:27.591276 15434 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.657231  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.658242 15437 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:27.660341 15486 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:27.578181 15508 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.651546 15410 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.579716 15436 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.662760  8918 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
W20260709 13:18:27.740082  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47645.6us
I20260709 13:18:27.663151 15470 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.654296 15400 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.581439 15521 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.595137 15330 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.666085  8835 raft_consensus.cc:2468] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:27.630299 15430 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.673112 15536 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:27.544927 15516 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.573745 15530 raft_consensus.cc:2804] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:27.690881  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:27.697995  8732 leader_election.cc:400] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:27.760032  8732 leader_election.cc:403] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.760125  9468 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.596493 15460 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.720230  8765 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:27.563144 15435 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.728329  8882 leader_election.cc:403] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.544667 15442 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.730062  8915 raft_consensus.cc:2368] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16.
I20260709 13:18:27.729969  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.731170  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:27.733304  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.767190  8839 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:27.767449  8841 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:18:27.767905  8839 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:27.734337  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:27.685102 15535 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:18:27.731421  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:27.748770  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:27.753151 15330 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.761973  8913 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:18:27.769531  8842 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.769644  8843 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.742151 15508 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:27.767282  8914 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:27.741927 15446 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:18:27.743808 15437 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.755615 15521 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:27.741439 15434 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.768764  8839 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.788440  9468 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:27.771996 15435 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.768951 15496 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 18. Current term is 19.
I20260709 13:18:27.782812 15530 raft_consensus.cc:697] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:27.768072 15460 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.786669 15443 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:27.814122  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 214309us
I20260709 13:18:27.758682 15536 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.823969 15547 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:27.825976 15538 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.830715  8767 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:27.800838 15525 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.829952 15443 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.838156 15410 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:27.846757  8842 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:18:27.836927  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:27.850694 15516 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.851022  8765 raft_consensus.cc:606] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:27.837852 15521 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.851468  8765 raft_consensus.cc:614] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:27.836833  8732 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:27.837180 15473 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.853935 15549 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:27.853981 15473 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.855516  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.842286 15443 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.856417 15548 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.842585 15536 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.856393  8732 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.857584 15548 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.859861  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.861284 15446 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.861853 15446 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.862280 15446 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.859962 15548 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.863430 15548 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:27.863917 15548 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:18:27.864421 15501 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.947s	user 0.000s	sys 0.010s
I20260709 13:18:27.864537 15460 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.865080  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:18:27.869659  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.870327  8765 raft_consensus.cc:3060] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.873883 15299 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.819156 15430 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:27.874368 15299 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.878407  8843 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
I20260709 13:18:27.836104 15474 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:27.886620  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.886994  8764 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:27.826748 15538 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.892794 15538 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.893151 15530 consensus_queue.cc:237] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.888121 15443 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:27.894989 15443 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.895957 15470 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.896953  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 3180) took 1565 ms. Trace:
I20260709 13:18:27.890326 15436 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:27.837922 15544 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.902410  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 90167.9us
I20260709 13:18:27.890470 15545 raft_consensus.cc:493] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:27.842192 15435 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.900233  8882 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:27.906366  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 151194us
I20260709 13:18:27.897334  8760 rpcz_store.cc:276] 0709 13:18:26.331407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.331878 (+   471us) service_pool.cc:224] Handling call
0709 13:18:26.332153 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:26.355255 (+ 23102us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:26.355284 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:26.370082 (+ 14798us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.615722 (+245640us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:26.615770 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.615930 (+   160us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.863685 (+1247755us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:18:27.896634 (+ 32949us) raft_consensus.cc:1685] finished
0709 13:18:27.896654 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.896893 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22640,"raft.queue_time_us":37873,"raft.run_cpu_time_us":623,"raft.run_wall_time_us":10297,"spinlock_wait_cycles":26071808,"thread_start_us":213039,"threads_started":1,"wal-append.queue_time_us":418570}
I20260709 13:18:27.906832  8882 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.903733  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:27.905017  8769 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:27.909427  8910 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:27.910050  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:27.910686  9468 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.913108  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:27.886222 15400 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:27.885295 15473 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.888970 15474 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.927387  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.915406 15299 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.922037  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.929553  8915 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
W20260709 13:18:27.922452  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 195720us
I20260709 13:18:27.922757  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.944998  8760 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 13.
I20260709 13:18:27.924671  8765 raft_consensus.cc:2468] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:27.897461 15437 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:27.922884  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 143118us
I20260709 13:18:27.951642  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:27.954659  9468 raft_consensus.cc:2468] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:27.957069  9466 raft_consensus.cc:2393] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:27.951643  9431 leader_election.cc:400] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 17. Current term is 18.
I20260709 13:18:27.957770  9431 leader_election.cc:403] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.959417  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.960107  8914 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:27.960382  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.916371 15496 raft_consensus.cc:2804] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:27.969729  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:27.975107  9459 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 13:18:27.918201 15400 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:27.977705  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.974572  8734 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:27.974547  8910 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:27.974217  8732 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:27.980086 15551 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.980293 15442 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.993633  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:27.981122  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:27.925763 15410 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:27.985046 15523 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 17. Current term is 18.
I20260709 13:18:27.985430 15434 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:27.985565 15531 raft_consensus.cc:2804] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.986080 15460 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.005458 15460 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.007926 15460 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.007668 15330 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.986022 15541 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
W20260709 13:18:28.008610 15542 log.cc:927] Time spent T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:18:27.991919 15446 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.930147 15474 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.003602 15496 raft_consensus.cc:697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:27.919153 15443 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:27.959626 15549 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:28.010262 15496 consensus_queue.cc:237] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.014581 15550 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.015126 15550 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.979911 15430 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.989262 15400 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.913944 15545 raft_consensus.cc:515] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:27.994889 15436 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.015497 15550 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.911310 15544 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:27.925437 15548 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.028384  9434 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.031028  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.033074  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.010953 15446 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.033782  8763 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:28.037830  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.038012  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:28.020104 15531 raft_consensus.cc:697] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:28.041350  8761 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 24.
I20260709 13:18:28.002506 15410 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.042963  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.047144  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.001150 15551 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.059917 15545 leader_election.cc:290] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:28.060286 15529 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:28.041401 15538 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.056411 15375 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.037343 15554 raft_consensus.cc:2764] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:18:28.067554 15544 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.046535 15382 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.069367 15550 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.044114 15374 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:28.080929 15529 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.085127 15375 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.100834 15374 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.105321 15375 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.106736 15374 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.111656  8660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 284) took 1410 ms. Trace:
I20260709 13:18:28.096936 15382 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.126458 15382 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.118088  8660 rpcz_store.cc:276] 0709 13:18:26.700889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.701064 (+   175us) service_pool.cc:224] Handling call
0709 13:18:28.111560 (+1410496us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":5}
I20260709 13:18:28.119776  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:28.095420 15543 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:28.101858 15529 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.086316 15538 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:28.147357  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 399755us
I20260709 13:18:28.136474 15443 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.141651 15330 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:28.068670 15531 consensus_queue.cc:237] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.096107 15508 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.153872  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:28.146009 15434 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:28.157382 15434 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.161604  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:28.166301 15508 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.167150  9459 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.167970 15330 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.168538 15330 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.170616  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.170897 15330 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:28.171868  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.172585  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.171943  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.172731  8912 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 23.
I20260709 13:18:28.173391  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.174351  8914 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:18:28.175218 15330 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.175967 15330 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.167456 15434 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:28.178920 15547 consensus_queue.cc:1059] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:28.179941 15547 raft_consensus.cc:3055] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:28.180265 15547 raft_consensus.cc:740] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:28.180513  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "019a0cde8c994b9a83ff212e5c02437c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:28.181062  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.181104 15547 consensus_queue.cc:260] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.166528 15551 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.183353 15547 raft_consensus.cc:3060] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.183480  8839 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.187954 15538 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.144023 15543 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.189450 15410 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.190824 15474 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.192166  8844 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 22: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:28.193799 15549 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.194253 15549 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.195860 15529 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.196097 15443 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.166356 15550 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.186313 15400 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.204037 15443 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:28.205809  8915 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.185752 15375 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.207962 15375 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.202000  9459 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:28.205608  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:18:28.210320  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53643.9us
I20260709 13:18:28.210922  8883 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:28.202795  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.213231  8914 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.199283  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:28.214224  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49027.6us
I20260709 13:18:28.216151  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.212719  8915 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
I20260709 13:18:28.216355  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:28.225481 15430 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:28.226011 15430 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.226531 15430 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.226164  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.227264  8909 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:28.190824 15543 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.205402 15400 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:28.232719  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.233273  8914 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:28.235961  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.236245  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.236548  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.237130  8842 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:28.237445  8835 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:18:28.237739  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.238217  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.239328  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.239651  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.239953  8838 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.240376  8835 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:28.241297  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.241976  8842 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 24.
I20260709 13:18:28.243568  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.233394  8732 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:28.248744  8809 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:28.251909 15410 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:28.252521 15410 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.253065 15445 raft_consensus.cc:2804] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:28.253456  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.253649 15445 raft_consensus.cc:697] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:28.254417  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.254753 15445 consensus_queue.cc:237] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.257128  8884 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:28.258150  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.259039  8836 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 22: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:18:28.260528  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47404.1us
I20260709 13:18:28.261960  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:28.262492 15490 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.263218 15490 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.263593 15490 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.263950 15490 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.264369  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:28.264959 15546 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:28.265527 15546 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.266075 15443 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:28.267637 15443 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:28.267835 15546 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.268211 15443 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:28.230589 15548 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.273315 15548 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.273726 15548 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.274715 15330 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:28.278002 15474 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.278831  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:28.234754 15496 raft_consensus.cc:2804] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:28.281097 15496 raft_consensus.cc:697] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:28.282078 15496 consensus_queue.cc:237] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.285271 15529 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.290300  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.291211  8841 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
W20260709 13:18:28.291493  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 58183.3us
W20260709 13:18:28.292166  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48688.6us
W20260709 13:18:28.293344  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.294510  8839 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:18:28.297670 15551 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.298427 15544 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:28.298813 15544 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.299234 15544 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:28.290750 15561 log.cc:927] Time spent T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:18:28.300966 15494 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:18:28.302062 15550 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:28.302798 15550 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.305049 15550 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:28.305233  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.305845  8836 raft_consensus.cc:3060] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.305967  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.308316  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.309018  8835 raft_consensus.cc:3060] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:28.309194  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:28.308719  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.311355  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.315503  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.292219  8732 leader_election.cc:304] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.318156  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.320758  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.322332  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.322839  8835 raft_consensus.cc:2468] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:28.323206  8839 raft_consensus.cc:2393] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 13: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:28.323655  8842 raft_consensus.cc:1240] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:28.324123  8844 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 19.
I20260709 13:18:28.327518  8838 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:28.328236  8835 raft_consensus.cc:1275] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 9. Preceding OpId from leader: term: 22 index: 10. (index mismatch)
I20260709 13:18:28.328960  8732 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.326341  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.333086  8842 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:28.331826  8735 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.341845  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.342746  8918 raft_consensus.cc:2368] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 19. Current term is 20.
I20260709 13:18:28.345994  8840 raft_consensus.cc:2393] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 24: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:28.255028 15410 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.349108  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:28.349913  8765 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:28.350684  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.351092  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:28.353067  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.295437 15531 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:28.353076  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.361272  8837 raft_consensus.cc:3060] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.361328  8767 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:28.354261  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.352932  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.363802  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.364063  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.365939  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.365309  8807 leader_election.cc:400] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16.
I20260709 13:18:28.371124  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 21 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.332337 15545 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:28.373546  9431 leader_election.cc:400] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf for earlier term 19. Current term is 20.
I20260709 13:18:28.345911 15513 raft_consensus.cc:2764] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:18:28.333097 15437 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.375978  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.375674  8840 raft_consensus.cc:2368] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:28.395032 15442 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.395658 15442 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.397851 15442 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.379977  8807 leader_election.cc:403] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:28.402541  8882 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:28.380388  8842 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.374998  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.346738 15521 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.337796 15550 raft_consensus.cc:2749] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:28.380609 15545 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.415390 15545 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.352761 15446 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:28.416829 15446 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:28.389104 15544 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.418110 15446 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.390653  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.376899 15541 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:28.393391 15430 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.403364  8882 leader_election.cc:403] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:18:28.412724  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.285000 15443 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.428812  8836 raft_consensus.cc:2468] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:28.368891 15531 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:28.430686  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.445892  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.450863  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:28.450079  8761 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:28.451820  8762 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:28.442638  8842 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
W20260709 13:18:28.433753  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50144.7us
I20260709 13:18:28.468416  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.422149 15521 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:28.472173  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.475261  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.479413  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:28.480269  8760 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 22: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:28.475361  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.481791  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:28.449791 15478 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:28.451221 15531 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:28.452998 15375 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16.
I20260709 13:18:28.455926 15541 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:28.499212  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:28.505504  8769 raft_consensus.cc:1240] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:28.480721 15521 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:28.455001 15549 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.475000 15330 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:18:28.530889  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.531697  8909 raft_consensus.cc:2393] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 20: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:28.564050  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.567688  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.568647  8840 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:28.570148  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.576373  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.590314  8732 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.569797 15419 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.594481  8732 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.610038 15544 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 25 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.643309  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.653988  8838 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:28.655424  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.613881 15436 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:28.636747 15544 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:28.653170 15559 log.cc:927] Time spent T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:18:28.683797  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.691723  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.692242  8837 raft_consensus.cc:2468] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
W20260709 13:18:28.725255  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.741137  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.741676  8836 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:28.590016 15541 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:28.701685 15549 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.734267 15430 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.754184  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.707229 15545 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.760705  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.761703  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.763980  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:28.721570  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:28.788805  8838 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.796456  8911 raft_consensus.cc:2393] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 22: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:28.696013 15442 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 13:18:28.814241  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.700631 15490 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.842422  8838 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:28.848296  8884 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:28.860031  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.779815 15521 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.881863  8840 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 25.
W20260709 13:18:28.882620 15548 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.608s	user 0.011s	sys 0.003s
I20260709 13:18:28.885651  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.889822  8763 raft_consensus.cc:1240] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:28.894448  8843 raft_consensus.cc:1240] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:28.883970 15516 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:28.885533 15436 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:28.902871  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.897078 15392 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.895308 15548 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.900854 15400 consensus_queue.cc:1059] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:18:28.916260  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.924288  8840 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:28.912437 15516 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.925550  8735 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.927574  8838 raft_consensus.cc:1275] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:18:28.931458  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.930121  8735 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:28.905007 15525 consensus_queue.cc:1048] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:28.935467  8884 leader_election.cc:400] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22.
I20260709 13:18:28.940481  8836 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:28.945847  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:28.947664  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.948848  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.949541  8917 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.948766  9468 raft_consensus.cc:1275] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:28.949998  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.950475  8915 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:28.949081  8913 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:28.952533  8914 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:28.957226  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.961733  8766 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:28.961898  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.963963  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:28.912343 15330 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:28.966450  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:28.935804 15549 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:28.933166 15545 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.940006 15430 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:28.936110 15443 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:28.940387 15473 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:28.999924  8764 raft_consensus.cc:1275] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:29.000548 15430 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 25 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:29.001998 15430 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:28.971365 15543 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:28.969753 15584 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:29.013260  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:29.013386  8732 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:28.935668 15586 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:18:29.020306  8764 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:28.980438 15585 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:28.976810 15490 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:29.029810  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 53688.5us
I20260709 13:18:28.987316 15548 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.987934 15521 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:28.989660 15549 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:29.034759  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:29.049731  8910 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.052348  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:28.968228 15436 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.057444  8764 raft_consensus.cc:2368] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
W20260709 13:18:29.035776 15583 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:18:29.032066 15446 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:29.021982 15473 consensus_queue.cc:1059] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 13:18:29.061915  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89172.8us
I20260709 13:18:29.057140 15551 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:18:29.070087  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.071309 15543 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:29.073380  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.049747 15545 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:18:29.074329 15543 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:29.074592 15392 raft_consensus.cc:3055] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:29.075335 15392 raft_consensus.cc:740] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:29.088343 15531 consensus_meta.cc:287] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.003s
I20260709 13:18:29.088922 15531 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.090082  8912 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 24.
I20260709 13:18:29.082334 15585 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:29.063577 15584 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:29.097602  8837 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:29.097420 15392 consensus_queue.cc:260] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.098762 15392 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.103060 15490 consensus_queue.cc:1048] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:29.104036 15600 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:29.105721 15531 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:29.108755  8917 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:29.111099  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:29.113535  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:29.113962  8840 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:29.116297  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:29.116992  8838 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:29.121332  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 144454us
I20260709 13:18:29.125664  8839 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:29.105998 15490 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.129333 15598 consensus_queue.cc:1048] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:18:29.120633 15585 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.134758 15585 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.137782  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.138485 15585 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:29.139322 15548 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.137638 15550 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:29.130373  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:29.142827  8840 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:29.147157  8838 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:29.152989  8910 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:29.162002  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:29.136314  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:29.193377  8715 auto_rebalancer.cc:629] Failed to schedule move for tablet 589fb2d6cab941e09bb87a5254bc9d48: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:29.142493 15549 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.199072  8917 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:29.148571 15490 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.202309 15490 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:29.206538 15587 log.cc:927] Time spent T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.143s	user 0.004s	sys 0.000s
I20260709 13:18:29.211472  8882 leader_election.cc:400] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
I20260709 13:18:29.211854  8882 leader_election.cc:403] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.213418  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:29.214680 15600 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
I20260709 13:18:29.226858  8838 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:29.230628  8844 raft_consensus.cc:1275] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 19 index: 9. (index mismatch)
I20260709 13:18:29.247869  8764 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:29.249219  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:29.249974  8839 raft_consensus.cc:2368] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
I20260709 13:18:29.254011  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 3414) took 1019 ms. Trace:
I20260709 13:18:29.254475  8843 rpcz_store.cc:276] 0709 13:18:28.235049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.235246 (+   197us) service_pool.cc:224] Handling call
0709 13:18:28.255743 (+ 20497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:28.895060 (+639317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.253722 (+358662us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b540021c354. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:29.253925 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468320640}
W20260709 13:18:29.264205  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.268553  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 105417us
I20260709 13:18:29.269165  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:29.269930  8839 raft_consensus.cc:2368] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 24. Current term is 25.
I20260709 13:18:29.224417 15490 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:29.282172 15446 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:29.286907  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.289158  8735 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:29.294973 15446 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:29.295573 15446 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:29.296464 15446 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.300263 15540 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.300913 15540 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:29.301781 15486 consensus_queue.cc:1048] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:29.303648 15540 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:29.308590  8735 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:29.309391  8764 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:29.309760 15548 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:29.310288 15548 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:29.311168 15548 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.311837  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:29.313302  9459 raft_consensus.cc:1275] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:18:29.316651  8735 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.267793 15598 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:18:29.347059  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.324517 15496 raft_consensus.cc:3055] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:18:29.360245 15595 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:29.388983 15535 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:18:29.373953 15496 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:29.403539  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:29.405516 15474 raft_consensus.cc:2764] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:18:29.406677  8842 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:29.385038 15400 consensus_queue.cc:1048] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:18:29.411059  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.415266 15525 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:29.415637 15330 consensus_queue.cc:1048] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:29.421845  8768 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:29.429555  9468 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:29.432538  9468 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:29.437161 15494 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:29.441548  8843 raft_consensus.cc:1240] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:18:29.444433  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:29.499883  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55562us
I20260709 13:18:29.500980  8808 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:29.530754  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105508us
I20260709 13:18:29.545625  8915 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:18:29.606523  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105673us
I20260709 13:18:29.607472  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:29.608479  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54399.7us
W20260709 13:18:29.657838  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.704437  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 97102.2us
I20260709 13:18:29.705963  8808 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.528966 15552 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.606930 15549 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:29.699913 15605 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:18:29.699532 15375 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:29.732254  8808 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.621826 15600 consensus_queue.cc:1059] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 13:18:29.740729  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.714685 15606 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.736430 15375 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.745308 15552 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.756347  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.706997 15543 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:29.767295 15612 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:18:29.754209 15606 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:29.787549 15622 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 13:18:29.754057 15375 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:29.737179 15549 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:29.800516 15596 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:29.808436  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 52447.7us
I20260709 13:18:29.810439  8808 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.822422  8808 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:29.823091 15373 consensus_queue.cc:1059] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:29.825127 15606 consensus_queue.cc:1059] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:29.826359 15479 raft_consensus.cc:3055] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:29.826813 15479 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:29.826683 15606 raft_consensus.cc:3055] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:29.827652 15606 raft_consensus.cc:740] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:29.828039 15479 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.825512 15373 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.829432 15494 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:29.838887 15479 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.845291 15513 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.858446 15550 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:18:29.870407 15633 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.871045 15633 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.874054 15446 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.874675 15446 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.876521 15632 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:29.869619 15625 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:18:29.893442 15375 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.896066 15375 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:29.896219  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.836849 15606 consensus_queue.cc:260] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.879419 15633 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:29.876820 15446 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:29.913491  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 84382.2us
I20260709 13:18:29.908574 15509 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.916563 15509 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:29.919054 15509 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:29.863185 15513 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:29.881997 15628 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.920717  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:29.921619 15591 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.855s	user 0.005s	sys 0.009s
I20260709 13:18:29.922283 15549 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:29.923547  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:29.926601 15636 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.945313  8837 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:29.928231 15586 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.930085 15606 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:29.932315  8839 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:29.934525  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.935202  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.935150  8835 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:29.935766  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:29.877125 15632 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.946481  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.951200  8842 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:29.942284 15635 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:29.959761 15513 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:29.943810 15628 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.965785 15628 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:29.973958 15632 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:30.000046  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.950248 15586 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.960299 15496 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:29.975741 15543 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.014694  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 68275.3us
I20260709 13:18:30.019533  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:29.950182 15636 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:29.975752 15635 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.013180 15632 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.031980  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.019475 15628 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.037961  8765 raft_consensus.cc:1275] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 13:18:30.038405  8765 pending_rounds.cc:85] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting all ops after (but not including) 13
I20260709 13:18:30.038631  8765 pending_rounds.cc:107] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:18:30.038879  8765 raft_consensus.cc:2889] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.030025 15599 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.030160 15496 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:30.021520 15543 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.031764 15430 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:18:30.037262 15642 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:18:30.066417 15636 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:30.074229 15586 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.075245  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:30.037154 15628 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.079977 15628 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.084808 15635 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.041353 15599 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:30.039577 15632 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.099923 15632 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.106062  8915 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:30.107932 15637 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:30.040006 15638 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:18:30.108789  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.109205  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.110524 15543 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.112211 15620 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.112955  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.112814 15620 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.116600 15620 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:30.118657 15600 consensus_queue.cc:1243] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer 74de73c0f36d4c3aa7a483c7fdb39e4a log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:30.108596  8913 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:30.121393  8912 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:30.122275  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.121764  8912 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:30.124219  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.125008  8916 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
W20260709 13:18:30.128046  8883 consensus_peers.cc:597] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3373a354d754ec48ac0cc05829af66f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:30.128360 15599 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.137708  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.146734  8916 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:30.147607  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.139379  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.139617  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.139895  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.140213  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.152631  8918 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:30.145817  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.154855  8843 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 20.
I20260709 13:18:30.155710  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.155735  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.133791  8915 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:18:30.157014  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.151489  8911 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 13.
I20260709 13:18:30.164636  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.166738  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.174638  8735 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.124068  8912 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.175971  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.176368  8912 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:30.181159 15635 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:30.182410  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.182606  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.183393  8769 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:30.184770  8732 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.190507  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.192893  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.193490  8766 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:18:30.196996  8732 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.202287  8732 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.203110  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:30.280500  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.308902  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:30.311143  8912 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:18:30.311703  8912 pending_rounds.cc:85] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Aborting all ops after (but not including) 9
I20260709 13:18:30.311988  8912 pending_rounds.cc:107] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:18:30.312260  8912 raft_consensus.cc:2889] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.174036 15628 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.196370 15632 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.195489 15586 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:30.166229 15525 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:18:30.210302 15550 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:30.201766 15584 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:30.207866 15513 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:30.417956  8884 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.003s	user 0.017s	sys 0.017s
W20260709 13:18:30.422224  8884 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.017s	sys 0.017s
W20260709 13:18:30.422542  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 1.00815e+06us
I20260709 13:18:30.423317  8884 leader_election.cc:400] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17.
I20260709 13:18:30.424404  8884 leader_election.cc:400] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 24. Current term is 25.
I20260709 13:18:30.424654  8884 leader_election.cc:403] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:18:30.213635 15514 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:30.206450 15633 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.211s
I20260709 13:18:30.409283 15541 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:30.421109 15619 log.cc:927] Time spent T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:18:30.416623 15550 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.413483 15470 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.427234 15514 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.457226 15479 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:30.444547 15550 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:30.463861 15606 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
W20260709 13:18:30.464774  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.406898 15628 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.466392 15514 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:30.443369 15541 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.483604 15660 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:30.465981 15470 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.489718 15606 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:30.474140 15479 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.506824 15660 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:30.524041 15660 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.526412 15479 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:30.527521 15443 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:18:30.540576 15604 log.cc:927] Time spent T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.331s	user 0.005s	sys 0.000s
I20260709 13:18:30.540323 15606 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:30.554414 15668 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:30.554785 15541 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:30.555824 15628 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:30.562402  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 159640us
I20260709 13:18:30.618976  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:30.567740 15470 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:30.619828 15400 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:30.620244 15400 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.620651 15400 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:30.569270  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 144996us
I20260709 13:18:30.569866 15496 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 24. Current term is 25.
I20260709 13:18:30.621623  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.622505 15585 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:30.623260  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.625833  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.619271 15606 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.574120 15550 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.582068  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:30.586086  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 383854us
I20260709 13:18:30.587067 15669 ts_tablet_manager.cc:933] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:30.591706  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 388643us
I20260709 13:18:30.628191  8732 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:30.629495 15633 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:30.629896 15633 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.630254 15633 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:30.595927 15636 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:30.636724  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.637282 15636 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.637753 15636 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:30.637992 15594 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:30.650766 15375 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.651268  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.596652 15642 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.651402 15375 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.652547 15642 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:30.652802  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.654104  8732 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.599086 15639 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.654377 15375 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.654754 15639 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.610160  8665 catalog_manager.cc:5697] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 14, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:30.656891 15628 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:30.657037 15430 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.657428 15628 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.657845 15628 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:30.658341 15430 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:30.619144 15486 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:30.654412 15642 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:30.662452  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.662837  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.663156  8761 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:30.623108  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.665148 15330 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.665932 15330 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:30.670370  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.670775  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.674949  8841 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:30.635852  8663 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 18 to 19, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 19 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.665153  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:30.693348  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.698431  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.699205  8769 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:30.699435  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.698932  8663 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.703545  8916 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:30.570770 15514 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:30.718608  8663 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:30.720803  8663 catalog_manager.cc:5697] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 21 to 22, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 22 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:30.648370 15400 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.657065 15392 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.744520  9468 raft_consensus.cc:1240] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:18:30.721160 15486 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:30.731854 15596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.005s	sys 0.013s
W20260709 13:18:30.782729  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.742151 15584 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:30.802354  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:30.807536  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:30.787501 15596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.005s	sys 0.013s
W20260709 13:18:30.794636 15652 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.053s	user 0.000s	sys 0.008s
I20260709 13:18:30.809036  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.834441 15330 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:30.835892  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 88818.9us
W20260709 13:18:30.796949 15666 log.cc:927] Time spent T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.196s	user 0.000s	sys 0.011s
I20260709 13:18:30.775465 15647 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:18:30.796268 15627 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.659s	user 0.043s	sys 0.040s
I20260709 13:18:30.759416 15474 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:30.842626 15330 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.746299 15445 consensus_queue.cc:1048] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:18:30.846866  8917 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:30.807027 15616 log.cc:927] Time spent T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:18:30.809886 15638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.005s
I20260709 13:18:30.833315 15486 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:30.763635 15392 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.835444 15639 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.860219  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:30.804715 15635 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:18:30.876461 15330 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:30.865171 15638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.011s	sys 0.006s
I20260709 13:18:30.808540 15584 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.881033  8844 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:18:30.848619 15669 tablet_copy_client.cc:323] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.67:39883
I20260709 13:18:30.851392 15633 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.898342 15648 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.898892  8839 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:30.899818 15400 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:30.901660 15550 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.860571 15474 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.910085  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:30.890367 15534 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:30.961568  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:30.961839  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 52642.4us
I20260709 13:18:30.962450  8842 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:30.865388 15585 consensus_queue.cc:1059] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:18:30.942848  8840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 3441) took 1549 ms. Trace:
I20260709 13:18:30.943583  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.881775 15479 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.965237 15479 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:30.967367 15687 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.058s	user 0.002s	sys 0.002s
I20260709 13:18:30.967541 15479 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:30.946513  8836 raft_consensus.cc:1275] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:30.953325  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:30.869644 15486 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.891008 15632 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:30.971164 15632 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.971680  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:30.972460 15494 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.851397 15647 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:30.960163  8764 raft_consensus.cc:1240] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:30.963435  8840 rpcz_store.cc:276] 0709 13:18:29.360154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.364545 (+  4391us) service_pool.cc:224] Handling call
0709 13:18:29.364891 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:29.386460 (+ 21569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:29.386508 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:29.421664 (+ 35156us) log.cc:844] Serialized 26 byte log entry
0709 13:18:29.833697 (+412033us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:29.833757 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:29.833876 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:30.136932 (+303056us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b18001dfaa0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6ccad3f3 00007fce6ccaf7c1 00007fce6ccaf779 00007fce6ccaf709 00007fce6ccaf6d1 00007fce6ccae9cd 000000000038f354 000000000038f199 00007fce6cc9083a
0709 13:18:30.617672 (+480740us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:18:30.909290 (+291618us) raft_consensus.cc:1685] finished
0709 13:18:30.909318 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:30.909479 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39948,"raft.queue_time_us":23022,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6089,"spinlock_wait_cycles":84487808,"thread_start_us":321192,"threads_started":1,"wal-append.queue_time_us":370797}
I20260709 13:18:30.980000  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:30.911557 15677 log.cc:927] Time spent T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.069s	user 0.006s	sys 0.000s
I20260709 13:18:30.993302  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.994387  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.994661  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:31.003367  8761 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 20: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:31.007695  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:31.015380  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 265198us
I20260709 13:18:30.974982 15534 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.006628 15632 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.018630 15514 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.170055 15486 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:31.312784  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 287842us
I20260709 13:18:31.020295 15541 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:31.331194  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 305087us
I20260709 13:18:31.327008 15516 raft_consensus.cc:3055] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:31.370906  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:30.942909 15648 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.391077  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:31.329856 15534 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.423729  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.425635  8768 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:31.392333 15636 consensus_meta.cc:287] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.754s	user 0.017s	sys 0.000s
I20260709 13:18:31.440374  8928 tablet_copy_service.cc:140] P bdb96be202c2447586477b2077b7d5bf: Received BeginTabletCopySession request for tablet e3373a354d754ec48ac0cc05829af66f from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:35822)
I20260709 13:18:31.441273  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:31.405519 15657 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.331s	user 0.000s	sys 0.008s
I20260709 13:18:31.366930 15606 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:18:31.404369 15675 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.372s	user 0.004s	sys 0.003s
I20260709 13:18:31.387507 15516 raft_consensus.cc:740] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:31.403069 15373 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.480681  8928 tablet_copy_service.cc:161] P bdb96be202c2447586477b2077b7d5bf: Beginning new tablet copy session on tablet e3373a354d754ec48ac0cc05829af66f from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:35822: session id = 3b34c95a175945b88b17f07fbc650abf-e3373a354d754ec48ac0cc05829af66f
W20260709 13:18:31.481068 15650 log.cc:927] Time spent T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.338s	user 0.002s	sys 0.006s
I20260709 13:18:31.481174 15373 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.483930 15373 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:31.427309 15591 log.cc:927] Time spent T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:31.465380  8837 raft_consensus.cc:1240] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:31.475777 15673 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.472108 15642 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:31.486040 15673 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.486231 15642 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.488300 15642 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.490008 15516 consensus_queue.cc:260] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:31.491333 15516 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.488320 15673 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.484477 15373 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:31.498039 15695 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:31.498464 15695 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:31.499256 15470 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.499284 15695 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.499936 15470 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.415788 15509 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:31.500960  8928 tablet_copy_source_session.cc:215] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:31.501132 15509 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:31.502130 15470 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:31.503446 15509 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:31.505033 15648 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:31.509291 15392 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:31.509963 15633 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.510926 15474 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.446060 15543 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.516496 15647 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:31.519064 15628 consensus_meta.cc:287] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.861s	user 0.013s	sys 0.007s
I20260709 13:18:31.519529 15628 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.520561  8763 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:31.456418 15479 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:31.522213 15642 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:31.524394  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50754.4us
I20260709 13:18:31.525254  8732 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:31.525974 15642 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.477962 15606 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.531397 15606 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.404011 15541 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.543810  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:31.549417  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.559571  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.562139  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.567034  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.568372  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:18:31.560633  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:31.570116  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.571678  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.460811 15636 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.568123 15550 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.574095 15550 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.512740 15543 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.588312  8767 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:31.589397  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:31.596446  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:31.598706  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.598765  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.601147 15636 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.605322  8837 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:31.606760 15543 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.608127 15541 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:31.577378 15478 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.609537 15478 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.610744  8917 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
I20260709 13:18:31.612083 15478 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:31.613588 15681 log.cc:927] Time spent T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:18:31.590602 15584 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.613701 15628 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.598577 15523 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:31.617633 15392 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:31.629154  8912 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:31.638934  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.639127  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.640055  8837 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:31.643342  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.643510  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.629261 15539 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.655077  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.660074  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.662333  8763 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:31.662268  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.663277  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.664098  8765 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
W20260709 13:18:31.666164  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 253500us
I20260709 13:18:31.668547  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.672580  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:31.673307  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.671134  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:31.677994  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.681627  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.636765 15392 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.688501  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:31.690248 15529 consensus_queue.cc:1059] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:31.691668 15529 raft_consensus.cc:3055] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:31.692081 15529 raft_consensus.cc:740] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:31.693082 15529 consensus_queue.cc:260] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.694748 15529 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:31.703697  8917 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:31.706897  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.707628  8837 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
I20260709 13:18:31.717569  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:31.721930  8808 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:31.722527  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:31.686044 15606 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.726797 15470 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:31.728217 15620 consensus_queue.cc:1048] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:31.730901 15496 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.733119 15445 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:31.733915  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:31.734130 15494 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:31.737054  8882 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:31.761274  8840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:31.719545 15375 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:31.742056 15606 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:31.770289 15400 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:31.777040  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 55214.4us
I20260709 13:18:31.724221 15541 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:18:31.780453  8884 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:31.719484 15596 consensus_queue.cc:1059] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:18:31.778829  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:31.768702 15550 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:31.776450 15535 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.777454 15606 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.796380  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:31.777678 15400 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:31.790652  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 201699us
I20260709 13:18:31.788051  8884 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:31.799762  8882 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:31.789681  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 114396us
I20260709 13:18:31.804556 15330 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:31.805102 15330 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:31.805346  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:31.806715  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 255072us
I20260709 13:18:31.807607  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.809489  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:31.797217 15445 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.811725 15445 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.812105 15445 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.814636 15600 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.774951 15375 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:31.820087  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:31.832310  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.832718  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.834546  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.835482  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.797184 15496 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.786322 15703 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:31.832427  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.841586  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.805734 15400 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.857811  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:31.816259 15596 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.828195 15535 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:31.850812 15703 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.847640 15496 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.890599 15703 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:31.891139 15496 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.902863  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.903903  8769 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:31.904882  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:31.911798  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.913074  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:31.857823 15658 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:18:31.934110  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 58926.2us
I20260709 13:18:31.937628  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:31.866894 15535 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.915867 15701 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.907194 15600 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.927731 15550 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:31.966370  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66048.1us
I20260709 13:18:31.926849 15621 raft_consensus.cc:493] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:32.070571  8840 raft_consensus.cc:606] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.070953  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.101958  8840 raft_consensus.cc:614] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:32.102272  8841 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
W20260709 13:18:32.114552 15711 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:18:31.943004 15392 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:31.948010 15535 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:31.947715 15702 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:18:32.144685  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 177345us
W20260709 13:18:32.146039  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 226592us
I20260709 13:18:32.162696 15373 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:32.163625 15373 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.167063  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.168164  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.168308  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:32.169056  8838 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 22: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:32.175083  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.175297  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.176422  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:32.179440  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 323563us
I20260709 13:18:32.184190  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:31.960098 15496 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.069558 15584 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
W20260709 13:18:32.177985 15534 consensus_meta.cc:287] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.721s	user 0.014s	sys 0.000s
I20260709 13:18:32.245697 15534 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.198024  8735 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.194841  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.137166 15550 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:18:32.203838 15709 log.cc:927] Time spent T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
W20260709 13:18:32.205178 15705 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:18:32.218088 15669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3373a354d754ec48ac0cc05829af66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:32.220654 15373 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:32.284186  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 86294.6us
I20260709 13:18:32.286515  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.126374 15621 raft_consensus.cc:515] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:32.225435 15375 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:32.229164  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83724.6us
I20260709 13:18:32.155381 15702 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:32.230841 15715 log.cc:927] Time spent T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:32.179605 15479 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:32.235810 15410 raft_consensus.cc:3055] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:32.238399 15695 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:32.243405  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:18:32.260207  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.441645  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 125700us
I20260709 13:18:32.282150  8915 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 18: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:32.280959 15525 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:32.475924  8835 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:32.274871 15550 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:32.307711  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.277936 15628 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.294570 15551 raft_consensus.cc:2749] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.493068  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 3858) took 1463 ms. Trace:
I20260709 13:18:32.495051  8843 rpcz_store.cc:276] 0709 13:18:31.029973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.031726 (+  1753us) service_pool.cc:224] Handling call
0709 13:18:31.369936 (+338210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.370339 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.370369 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.393937 (+ 23568us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.797318 (+403381us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:31.797381 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.797487 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.492747 (+695260us) raft_consensus.cc:1685] finished
0709 13:18:32.492780 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.492983 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":405,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":24012,"thread_start_us":351680,"threads_started":1,"wal-append.queue_time_us":470568}
I20260709 13:18:32.501791  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:32.499552 15635 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.506454 15635 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.505896  8840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:32.511466  8840 raft_consensus.cc:606] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.503952 15633 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.448508 15410 raft_consensus.cc:740] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:32.491457 15486 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.469286 15716 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:32.470024 15584 raft_consensus.cc:493] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.530998 15633 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.470265 15392 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.471130 15642 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:32.472255 15541 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.473176  8735 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.508734 15635 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:32.544047  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 70964.5us
I20260709 13:18:32.531942  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:32.292832  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 98089.9us
I20260709 13:18:32.556396  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.583323  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:32.522709 15693 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.544054 15635 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:32.493297 15479 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:32.527700 15551 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.509835 15628 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:32.602178  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45854.3us
W20260709 13:18:32.607705  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 165592us
I20260709 13:18:32.501157 15525 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.532222 15534 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.617812  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:32.619421  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:32.584780 15721 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.635962  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:32.637599  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 54402.3us
I20260709 13:18:32.599215 15638 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.542979 15541 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.641657  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:32.608711 15543 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:32.643033  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.609061 15724 raft_consensus.cc:493] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.542122 15392 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.541666 15584 raft_consensus.cc:515] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.561012 15486 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:32.606174 15693 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:32.646389 15606 consensus_meta.cc:287] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.838s	user 0.015s	sys 0.000s
I20260709 13:18:32.624584 15551 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.657356 15534 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:32.690773  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47513.1us
I20260709 13:18:32.692167  8768 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.694633  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.664824 15494 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.645668 15721 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.696355 15529 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:32.700441 15725 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:32.667742 15496 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.704609  8768 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:32.624522 15410 consensus_queue.cc:260] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.666731 15722 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:32.714363  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.715163  8840 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:32.707836  8735 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.712037  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:32.655818 15638 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.711229 15642 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:32.710345 15529 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.660035 15724 raft_consensus.cc:515] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.698845 15731 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.725322 15731 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:32.727373 15635 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:32.727913 15731 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:32.729640 15392 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.693734 15514 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:32.708475 15711 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:18:32.709029 15621 leader_election.cc:290] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:32.774171  8764 raft_consensus.cc:1240] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:32.746376 15721 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:32.751988 15713 log.cc:927] Time spent T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.242s	user 0.004s	sys 0.000s
I20260709 13:18:32.753024 15642 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.777402 15642 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:32.717474 15496 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.778563 15496 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.779083  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.779791 15642 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.754426 15551 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.754554 15525 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.755522 15479 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:32.740778 15584 leader_election.cc:290] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.782207  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.755779 15541 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.683871 15606 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.761866 15663 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:32.762669 15514 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:32.759413 15535 consensus_meta.cc:287] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
W20260709 13:18:32.763959 15703 consensus_meta.cc:287] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.873s	user 0.013s	sys 0.000s
W20260709 13:18:32.764006 15445 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.951s	user 0.011s	sys 0.002s
W20260709 13:18:32.766057 15714 log.cc:927] Time spent T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:18:32.766536 15486 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:32.767508 15628 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.737558 15410 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:32.774026  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.776647 15638 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.757318 15693 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:32.783666  8807 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.781644  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.802945  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.804396  8767 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60042 (request call id 3271) took 1146 ms. Trace:
I20260709 13:18:32.805689  8843 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:32.714227 15722 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:32.780725 15496 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.812114 15663 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:32.813555 15703 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.814145 15514 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.806476 15550 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.814898 15606 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.816928 15535 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.821492 15330 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.842792 15330 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:32.805052 15400 consensus_meta.cc:287] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.942s	user 0.012s	sys 0.001s
W20260709 13:18:32.825314  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 86258.2us
I20260709 13:18:32.825819  8842 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
W20260709 13:18:32.830528  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 172175us
I20260709 13:18:32.833146  8764 raft_consensus.cc:2410] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:32.838977  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:32.839529  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:32.849740  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.829363  8767 rpcz_store.cc:276] 0709 13:18:31.657767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.657937 (+   170us) service_pool.cc:224] Handling call
0709 13:18:31.658381 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.658843 (+   462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.658887 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.659471 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.753819 (+ 94348us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b1800229060. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc8fe07 00007fce75aeaab9 00007fce6ccac69b 00007fce6ccaa93f 00007fce6ccacc02 00007fce6f93420b 00007fce6f939d23 00007fce6f93a0d1 00007fce6fd55a0f
0709 13:18:31.905899 (+152080us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:31.933353 (+ 27454us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.137655 (+204302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.137760 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.751149 (+613389us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b4400022b4c. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6cb35db1 00007fce6cbd3c85 00007fce6cbd46a2 00007fce6f9461db 00007fce6f941aaf 00007fce6f93586e 00007fce6f934bb6 00007fce6f9347d8 00007fce6f93e221 00007fce6f93e1d9 00007fce6f93e169
0709 13:18:32.804175 (+ 53026us) raft_consensus.cc:1685] finished
0709 13:18:32.804196 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.804334 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":267713,"prepare.queue_time_us":31268,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":218496,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":41618,"spinlock_wait_cycles":102840960,"thread_start_us":151860,"threads_started":1,"wal-append.queue_time_us":647709}
I20260709 13:18:32.840231  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:32.841641  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa48bba2a08c4fcdae35a029b7107f70" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:32.844959  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:32.843145  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:32.851493  8915 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:32.849926  8735 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:32.853313  8838 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 20: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:32.833266 15722 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:32.827445 15445 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.839895 15721 raft_consensus.cc:493] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:32.859572 15724 leader_election.cc:290] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.859941 15445 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.862370  8836 raft_consensus.cc:2393] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 21: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:32.845635 15739 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:32.856832 15628 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:32.857489  8884 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.122.66:32843 timed out after 1.841s (SENT) [suppressed 4 similar messages]
I20260709 13:18:32.869376  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.868918 15516 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:32.870239  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.872236  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.872762  8760 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:32.870963  8917 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:32.868602  8761 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:32.852375 15400 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:32.873193  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.023958 15535 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:32.881714 15628 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.040911 15742 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:32.861801 15721 raft_consensus.cc:515] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.052218 15628 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.052141 15742 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.053787 15721 leader_election.cc:290] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:32.881176 15739 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.040314  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 145) took 2921 ms. Trace:
I20260709 13:18:33.055013  8918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35822 (request call id 853) took 1143 ms. Trace:
I20260709 13:18:33.056488 15739 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:32.897367 15703 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:32.954284  8882 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.007467  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:32.888940 15663 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.055351  8665 rpcz_store.cc:276] 0709 13:18:30.119281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.119448 (+   167us) service_pool.cc:224] Handling call
0709 13:18:33.040181 (+2920733us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:30.737975 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:30.851151 (+113176us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:30.855943 (+  4792us) write_op.cc:435] Acquired schema lock
0709 13:18:30.859837 (+  3894us) tablet.cc:662] Decoding operations
0709 13:18:30.897040 (+ 37203us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:30.908933 (+ 11893us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:30.955918 (+ 46985us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:31.002464 (+ 46546us) tablet.cc:701] Row locks acquired
0709 13:18:31.005442 (+  2978us) write_op.cc:260] PREPARE: finished
0709 13:18:31.023672 (+ 18230us) write_op.cc:270] Start()
0709 13:18:31.068751 (+ 45079us) write_op.cc:276] Timestamp: P: 1783603111023604 usec, L: 0
0709 13:18:31.074606 (+  5855us) op_driver.cc:348] REPLICATION: starting
0709 13:18:31.558363 (+483757us) log.cc:844] Serialized 533 byte log entry
0709 13:18:32.708271 (+1149908us) op_driver.cc:464] REPLICATION: finished
0709 13:18:32.894176 (+185905us) write_op.cc:301] APPLY: starting
0709 13:18:32.894280 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:32.895396 (+  1116us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:32.895500 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:32.953482 (+ 57982us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.012854 (+ 59372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:33.024322 (+ 11468us) write_op.cc:312] APPLY: finished
0709 13:18:33.033184 (+  8862us) log.cc:844] Serialized 25 byte log entry
0709 13:18:33.034442 (+  1258us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.034568 (+   126us) write_op.cc:454] Released schema lock
0709 13:18:33.034625 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:33.035277 (+   652us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.035317 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":179292,"apply.run_cpu_time_us":4227,"apply.run_wall_time_us":140948,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":78374,"prepare.run_cpu_time_us":54865,"prepare.run_wall_time_us":1105280,"raft.queue_time_us":618900,"raft.run_cpu_time_us":16481,"raft.run_wall_time_us":180363,"replication_time_us":1608158,"thread_start_us":829039,"threads_started":4,"wal-append.queue_time_us":354080}]]}
I20260709 13:18:33.041294  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.059988 15400 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:33.012703 15550 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:33.027118  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.062254  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.064980 15742 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:32.980676 15702 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.073125 15529 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.059159  8765 raft_consensus.cc:2393] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:33.074770 15628 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:33.075198  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 343733us
I20260709 13:18:33.055477  8918 rpcz_store.cc:276] 0709 13:18:31.911792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.912021 (+   229us) service_pool.cc:224] Handling call
0709 13:18:31.916783 (+  4762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:32.454320 (+537537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.454369 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:32.454431 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:32.454480 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:33.054754 (+600274us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b54003aeb54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:33.054801 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.054929 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235446144}
I20260709 13:18:33.082263  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.013399  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.085063  8760 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.085310  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:32.872848  8767 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:33.086675  8841 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:33.090801 15550 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.093825 15695 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.095417  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:18:33.100368  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 255508us
I20260709 13:18:33.101331  8760 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 23.
I20260709 13:18:33.103104  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.105283  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.106858  8735 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.108343  8764 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:33.099040 15735 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.112068  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.118083  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.112438  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:33.109661  8735 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.110368  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.113487  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.115536  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.115569  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.120770  8843 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:33.120913  8762 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.116928  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.124104  8837 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 22: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:33.127099  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.105396 15663 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:33.132790  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 275522us
I20260709 13:18:33.099646 15683 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.134963  8844 raft_consensus.cc:2393] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:33.108253 15445 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.139731  8735 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.094252 15550 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.144953  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.118131 15639 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:33.154891  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.143872  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.153067  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.156941  8735 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.157948  8761 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:33.099550 15695 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.166079  8762 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:33.140645 15739 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:33.167140 15739 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:33.167405  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.170367 15722 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.173242 15551 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.177750 15669 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54308 (request call id 1073) took 2712 ms. Trace:
I20260709 13:18:33.178212 15669 rpcz_store.cc:276] 0709 13:18:30.475921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.481374 (+  5453us) service_pool.cc:224] Handling call
0709 13:18:30.628190 (+146816us) ts_tablet_manager.cc:934] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
0709 13:18:31.866138 (+1237948us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:32.773485 (+907347us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:32.773631 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:33.090547 (+316916us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:33.133329 (+ 42782us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:33.177542 (+ 44213us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:33.177627 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":99724,"tablet-copy.queue_time_us":94705,"thread_start_us":204895,"threads_started":2}
I20260709 13:18:33.179651 15669 tablet_copy_client.cc:806] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:33.180310 15669 tablet_copy_client.cc:670] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:33.164961 15673 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:33.133764 15530 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.156616 15479 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.147750 15683 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.189342 15479 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.190472  8836 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
I20260709 13:18:33.187112 15430 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:33.190950 15683 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.191362 15430 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:33.129431 15735 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.195123 15735 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:18:33.196085  8808 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.188779 15530 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.161053 15635 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:33.198339 15635 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.198886 15635 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.199759 15530 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:33.208820  8837 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20. Ops: [19.10-19.10]
W20260709 13:18:33.213498  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 47463.4us
I20260709 13:18:33.216877  8844 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:33.223949 15628 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:33.187673  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 52176.2us
I20260709 13:18:33.228425  8760 raft_consensus.cc:1240] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:33.228818  8842 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40104 (request call id 3864) took 1650 ms (client timeout 1841 ms). Trace:
W20260709 13:18:33.229239  8842 rpcz_store.cc:269] 0709 13:18:31.578378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.578497 (+   119us) service_pool.cc:224] Handling call
0709 13:18:33.228635 (+1650138us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540042b3d4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:18:33.228729 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2810435840}
I20260709 13:18:33.231585 15494 raft_consensus.cc:993] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:33.232102 15494 raft_consensus.cc:1081] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:33.187317 15550 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.167539 15739 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.235934  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:33.237097 15543 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:33.237617 15543 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:33.238000 15543 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.245656  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.246367  8665 catalog_manager.cc:5697] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 14 to 16, leader changed from 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 16 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:33.248901  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.251084  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2fb7e71822c4226a7ee8579013bfe9f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.249233  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.251425  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.252578  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.252918  8915 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:33.253352  8911 raft_consensus.cc:2368] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19.
I20260709 13:18:33.252578  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.254788  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.189924 15695 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.257866 15708 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.192329 15430 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.282166  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.282481 15708 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.283790  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "968e06ae5d2744aeb0b947873b369af8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.284358  8836 raft_consensus.cc:3060] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.256047  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.281961 15722 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:33.286064  8882 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:33.286085 15708 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.192235 15479 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:33.293924  8808 leader_election.cc:304] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.265594 15445 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.297593  8839 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:33.269601 15639 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.298172  8665 catalog_manager.cc:5697] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:33.300855  8769 raft_consensus.cc:1240] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:33.265627  8764 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:33.141032 15738 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:33.277961  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.278357  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.277915  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.279232  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.315243 15330 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:33.279587  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.315479  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.280830  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.316107  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.316393  8917 raft_consensus.cc:3060] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.294150 15739 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.268311 15543 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.313726  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.281062 15669 tablet_copy_client.cc:538] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:33.316722  8911 raft_consensus.cc:3060] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:33.198647 15633 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.317507  8913 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:33.320394  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.320526 15330 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.320394  8836 raft_consensus.cc:2468] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
W20260709 13:18:33.363555  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50591.7us
I20260709 13:18:33.365007  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.367530  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.367720  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.369252  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.369431  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.361789  9461 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:33.370759  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.348541  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.354388  8663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 285) took 4004 ms. Trace:
I20260709 13:18:33.356397  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.358400  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.358660  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.358832  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.359839  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.360306  8735 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:33.371748  8837 raft_consensus.cc:2368] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20.
I20260709 13:18:33.393936  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.394651  8837 raft_consensus.cc:2368] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:33.394858  8839 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:33.372567  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "860647fd65b141d8842fde1bd4f9a549" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.395834  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:33.370674  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.400355  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.402319  8735 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:33.319113 15479 raft_consensus.cc:2749] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.402715  8917 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:33.409126  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.415867 15330 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:33.416689  8836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:33.417316  8836 raft_consensus.cc:606] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:33.392531  8663 rpcz_store.cc:276] 0709 13:18:29.350245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.350427 (+   182us) service_pool.cc:224] Handling call
0709 13:18:33.354294 (+4003867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:31.908608 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:31.957401 (+ 48793us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:31.957436 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:31.957454 (+    18us) tablet.cc:662] Decoding operations
0709 13:18:31.958036 (+   582us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:31.958093 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:31.958120 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:18:31.958470 (+   350us) tablet.cc:701] Row locks acquired
0709 13:18:31.958488 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:18:31.958633 (+   145us) write_op.cc:270] Start()
0709 13:18:31.958744 (+   111us) write_op.cc:276] Timestamp: P: 1783603111958584 usec, L: 0
0709 13:18:31.958763 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:31.959425 (+   662us) log.cc:844] Serialized 1694 byte log entry
0709 13:18:32.863808 (+904383us) op_driver.cc:464] REPLICATION: finished
0709 13:18:33.035727 (+171919us) write_op.cc:301] APPLY: starting
0709 13:18:33.035824 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:33.181788 (+145964us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:33.181906 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:33.184233 (+  2327us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:33.184417 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:18:33.184467 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:33.184693 (+   226us) log.cc:844] Serialized 49 byte log entry
0709 13:18:33.223219 (+ 38526us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.223317 (+    98us) write_op.cc:454] Released schema lock
0709 13:18:33.223359 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:33.297052 (+ 73693us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:33.297088 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3686,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":171321,"apply.run_cpu_time_us":7752,"apply.run_wall_time_us":261257,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16696,"num_ops":4,"prepare.queue_time_us":1107168,"prepare.run_cpu_time_us":3163,"prepare.run_wall_time_us":89858,"replication_time_us":896943,"thread_start_us":232203,"threads_started":1}]]}
I20260709 13:18:33.420212  8909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42824
I20260709 13:18:33.362610 15552 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.420840  8909 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:33.423403  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:33.425640  8909 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.427256  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:33.427475  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 141498us
I20260709 13:18:33.428772  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.401700 15716 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.433542 15697 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.437902 15635 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:33.439450 15585 raft_consensus.cc:2804] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:33.440142 15543 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.422459 15718 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.431502 15632 consensus_queue.cc:1059] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:33.423321 15586 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:33.430826 15552 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:33.445773  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 116160us
I20260709 13:18:33.449628 15330 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:33.453433 15683 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:33.463335  8807 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:33.432592 15496 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:33.465343  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45568.7us
I20260709 13:18:33.494316  8808 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.319975 15738 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.468523  8909 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.469452 15739 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:33.469992  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48578.2us
I20260709 13:18:33.418269 15717 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.426842 15740 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.479184  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.508294  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.428638 15445 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.511914  8884 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.513684  8909 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:33.509719  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.513988  8884 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.514870  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:33.507237  9432 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.518308  9432 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.498973 15635 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.499120 15695 raft_consensus.cc:2804] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:33.490754 15585 raft_consensus.cc:697] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:33.500398 15628 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:33.501811 15330 raft_consensus.cc:3055] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:33.530102  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.490914 15697 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.504185 15496 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:33.486469  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57402.9us
I20260709 13:18:33.510612 15543 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.523074  8808 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:33.545442  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.547639  8882 leader_election.cc:304] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:33.550858  8808 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.527271  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:33.520983 15716 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.528757  8883 leader_election.cc:304] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:33.522265  8911 raft_consensus.cc:2468] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:33.527483  8809 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.542078 15330 raft_consensus.cc:740] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:33.493940 15586 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:33.493077 15633 raft_consensus.cc:2764] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:33.525787 15663 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:33.575194 15479 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:33.551929  8841 raft_consensus.cc:606] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:33.528227  8843 raft_consensus.cc:3060] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.525166 15708 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.524681 15658 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.524796 15601 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.559530  8884 leader_election.cc:400] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20.
I20260709 13:18:33.601729  8884 leader_election.cc:403] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.553052 15600 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.524106 15717 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.559818  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:33.561299 15586 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:33.607174  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47450.8us
I20260709 13:18:33.608433 15400 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:33.609099 15400 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.609480 15400 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:33.610160 15585 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.570974 15543 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.570523 15496 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:33.570758 15552 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.541823 15628 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:33.571431 15330 consensus_queue.cc:260] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.546418 15478 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.553735 15516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44522 (request call id 1) took 4347 ms. Trace:
I20260709 13:18:33.555881 15598 consensus_queue.cc:1059] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:18:33.553994 15486 raft_consensus.cc:2804] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:33.547035 15530 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.558029 15373 raft_consensus.cc:2804] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:33.525437 15445 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.582558  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.584900  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.544188 15695 raft_consensus.cc:697] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:33.588783  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.624820 15541 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 19. Current term is 20.
I20260709 13:18:33.566051  8809 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.614162  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1d69638bb504813949178c6aee64727"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:33.651603  8841 raft_consensus.cc:606] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Received request to transfer leadership to TS bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.580730 15721 raft_consensus.cc:2749] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:33.617086  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 55886.4us
I20260709 13:18:33.652352  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.623212  8843 raft_consensus.cc:2468] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 23.
I20260709 13:18:33.542773 15739 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:33.660056  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 94125.6us
I20260709 13:18:33.643299  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.644155  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.644801  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:33.668092  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 216136us
I20260709 13:18:33.668242  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.668856  8732 leader_election.cc:400] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19.
I20260709 13:18:33.669191  8732 leader_election.cc:403] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.670058  8732 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.670847  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.646340 15693 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:33.646265 15695 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.652668  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:33.676337  8884 leader_election.cc:400] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:33.676654  8884 leader_election.cc:403] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:33.624632 15620 consensus_queue.cc:1059] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:18:33.679397  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:18:33.680146  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.681229  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:33.649286 15598 raft_consensus.cc:3055] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:33.677191  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.661394 15373 raft_consensus.cc:697] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:33.689692  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.690302  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:33.630144 15478 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.700595  9459 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:33.749935  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.674579 15430 raft_consensus.cc:2749] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 18. Current term is 19.
I20260709 13:18:33.675335 15693 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
W20260709 13:18:33.749032  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 47009.2us
I20260709 13:18:33.674199 15735 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.771916  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:33.676616 15486 raft_consensus.cc:697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:33.683072 15550 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.680824 15443 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:33.698740 15530 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:33.698195 15598 raft_consensus.cc:740] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:33.795675  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 45827us
I20260709 13:18:33.792626 15373 consensus_queue.cc:237] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.798336 15685 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:33.798877 15685 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:33.799211 15478 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:33.800839  8732 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.803364 15673 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.805394  8732 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.799319 15685 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.812175  8732 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.773838 15632 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.814489  8732 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.786595 15697 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.787292 15443 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:33.824331  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:33.679489 15628 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:33.831674  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 155482us
I20260709 13:18:33.839963  9459 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:33.815769 15551 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.816157 15738 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:33.815197 15642 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:33.842542  8884 leader_election.cc:304] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.861846  8884 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.823717 15633 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.829650 15443 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:33.872278  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:33.869196 15738 raft_consensus.cc:2749] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.874569 15628 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.886467 15525 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:33.880762 15739 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.895336  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.897398  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:33.897955  8914 raft_consensus.cc:1240] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:33.900936  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.901851  8769 raft_consensus.cc:2393] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 23: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:33.901533 15586 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.904850  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.911639 15445 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.627158 15516 rpcz_store.cc:276] 0709 13:18:29.196791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.197070 (+   279us) service_pool.cc:224] Handling call
0709 13:18:29.344199 (+147129us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4c00072680. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e066a20 00007fce6e077a29 00007fce6e03d644 00007fce6e064f2d 00007fce6e064b93 00007fce6fcf31af 00007fce6fcf2f3e 00007fce6fd78888 00007fce6fd9575c 00007fce6fd9676a 00007fce6fd9591b
0709 13:18:29.346605 (+  2406us) log.cc:844] Serialized 499 byte log entry
0709 13:18:30.068941 (+722336us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b180018eb00. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fcf3b0b 00007fce6fd78b63 00007fce6fda0752 00007fce74d60d29
0709 13:18:33.543711 (+3474770us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":400347,"raft.queue_time_us":425766,"raft.run_cpu_time_us":2506,"raft.run_wall_time_us":46682,"spinlock_wait_cycles":38524416,"thread_start_us":381643,"threads_started":2,"wal-append.queue_time_us":365458,"wal-append.run_cpu_time_us":2250,"wal-append.run_wall_time_us":1054354}
I20260709 13:18:33.922228 15586 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.922469 15330 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.923573  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.866554 15755 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:33.939924  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.935122  8764 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
W20260709 13:18:33.940953  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 154188us
I20260709 13:18:33.941933  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.949368  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:33.827787 15693 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.863870 15486 consensus_queue.cc:237] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.926578 15717 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:33.965638  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.864066 15598 consensus_queue.cc:260] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:33.967175  8911 raft_consensus.cc:1240] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:33.962739  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:33.968822  8918 raft_consensus.cc:1240] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:33.969018  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.976169  8917 raft_consensus.cc:2410] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:18:33.976236  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.975456  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:33.978281 15693 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.004365 15685 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.006413 15685 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.011966 15669 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:18:34.042346  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.061527  8769 raft_consensus.cc:1240] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:34.066672  8807 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.083725  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.083595  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.088411  8835 raft_consensus.cc:2393] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:34.083632  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.090024  8836 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.090466  8836 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:34.092389  8836 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.097059  8836 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:34.108698  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 139666us
I20260709 13:18:34.110486  8883 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:34.114884  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.116173  8844 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:34.117074 15606 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:34.118481 15606 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:33.996830 15443 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.123396 15606 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:34.125530 15539 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:34.126784 15539 consensus_queue.cc:1059] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:34.127918 15632 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.133311 15539 raft_consensus.cc:3055] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:34.134053 15539 raft_consensus.cc:740] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:34.110533  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.134903 15494 raft_consensus.cc:993] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:34.135999 15494 raft_consensus.cc:1081] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:34.137547 15539 consensus_queue.cc:260] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.114018  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:34.138760 15525 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.071553  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.114061  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.169564 15738 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:34.169672  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 56142.8us
W20260709 13:18:34.177794  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 67724.7us
I20260709 13:18:34.185607  8843 raft_consensus.cc:2376] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15. Re-sending same reply.
I20260709 13:18:34.189582  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:34.190826 15525 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:34.191532 15525 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:34.198192  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:34.201207 15539 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.204115 15516 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.209074  8842 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:34.220906 15761 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.227526 15443 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:34.193361 15525 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.240971 15635 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.242147 15635 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.251250  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:34.252852 15721 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.262643 15635 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.265926 15598 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:34.267416 15400 consensus_meta.cc:287] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.008s
W20260709 13:18:34.267795  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 196568us
I20260709 13:18:34.275717  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.278182  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.278578 15479 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:34.279739  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:34.280699  8764 raft_consensus.cc:2393] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:34.281750 15445 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.287104  8844 raft_consensus.cc:1240] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Rejecting Update request from peer 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:34.287168  8760 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:34.285179 15400 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:34.317620  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 66620.6us
I20260709 13:18:34.318290  8836 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
W20260709 13:18:34.320437  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 103967us
I20260709 13:18:34.320990 15400 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:34.321664  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.333191  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:34.334496  9468 raft_consensus.cc:2393] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 21: Already voted for candidate 3b34c95a175945b88b17f07fbc650abf in this term.
W20260709 13:18:34.337226  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:34.326061  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.289250 15635 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:34.347749  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.351210 15635 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.354682  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:34.355340  9468 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.357205  8760 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:34.357414 15768 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:34.361250  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:34.361775 15642 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:34.362627 15642 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.370429 15400 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:34.371016 15400 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.371639 15400 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.371799 15761 raft_consensus.cc:993] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:34.374485 15761 raft_consensus.cc:1081] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:34.374686 15516 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.383160  8884 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:34.385571  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:34.386287 15330 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:34.386902 15330 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:34.386974 15550 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:34.387682 15550 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.388049 15330 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.392760 15635 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.400722  8838 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:34.402292  8915 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:34.394906  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 146) took 1324 ms. Trace:
I20260709 13:18:34.414194  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.418612  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.430795  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:34.431679  8913 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:34.435528  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:34.435820 15758 consensus_queue.cc:1059] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:18:34.436825 15721 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:34.437363 15758 raft_consensus.cc:3055] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.437587 15721 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:34.437865 15758 raft_consensus.cc:740] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:34.438966 15721 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.445413  8836 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:34.438930 15758 consensus_queue.cc:260] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.450243 15758 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.454816  8844 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:34.404891  8665 rpcz_store.cc:276] 0709 13:18:33.069672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.074463 (+  4791us) service_pool.cc:224] Handling call
0709 13:18:33.242462 (+167999us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:34.394464 (+1152002us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:33.828807 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:33.889857 (+ 61050us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:33.889912 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:18:33.889941 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:33.890534 (+   593us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:33.890621 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:33.890667 (+    46us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:33.891099 (+   432us) tablet.cc:701] Row locks acquired
0709 13:18:33.891140 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:18:33.891339 (+   199us) write_op.cc:270] Start()
0709 13:18:33.891478 (+   139us) write_op.cc:276] Timestamp: P: 1783603113891271 usec, L: 0
0709 13:18:33.891506 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:18:33.892248 (+   742us) log.cc:844] Serialized 913 byte log entry
0709 13:18:34.201842 (+309594us) op_driver.cc:464] REPLICATION: finished
0709 13:18:34.294812 (+ 92970us) write_op.cc:301] APPLY: starting
0709 13:18:34.295235 (+   423us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:34.298061 (+  2826us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:34.298225 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:34.330582 (+ 32357us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:34.331038 (+   456us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:34.331131 (+    93us) write_op.cc:312] APPLY: finished
0709 13:18:34.331557 (+   426us) log.cc:844] Serialized 33 byte log entry
0709 13:18:34.333518 (+  1961us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:34.333744 (+   226us) write_op.cc:454] Released schema lock
0709 13:18:34.333836 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:34.336469 (+  2633us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:34.336520 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12050,"reported_tablets":3,"spinlock_wait_cycles":23658368,"child_traces":[["op",{"apply.queue_time_us":92530,"apply.run_cpu_time_us":13639,"apply.run_wall_time_us":41605,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":489535,"prepare.run_cpu_time_us":3982,"prepare.run_wall_time_us":84208,"replication_time_us":309946,"thread_start_us":429846,"threads_started":2}]]}
I20260709 13:18:34.461349 15642 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:34.470579  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:34.477383  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:34.488174  8760 raft_consensus.cc:1240] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:34.488288  8769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:34.490932  8769 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:34.491329  8769 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.495074  8766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:34.495851  8766 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:34.496430  8766 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.496977  8768 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:34.498446  8760 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:18:34.502744  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 67534.6us
I20260709 13:18:34.509703  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4b840458e6048cd9c4444bf516cf39a" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.511852 15400 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.517493  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:34.519170  8766 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.525897  8914 raft_consensus.cc:2368] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 21. Current term is 22.
I20260709 13:18:34.526194  9468 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
I20260709 13:18:34.537372  8766 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:34.541453  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:34.542127  9459 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.541319  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af7776ba20a14a499de5919550fdada6" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.542891  8840 raft_consensus.cc:3060] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.539637  8883 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:34.549435  8660 catalog_manager.cc:5697] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.551947 15410 consensus_queue.cc:1059] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:34.553155 15479 raft_consensus.cc:3055] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:34.553746 15479 raft_consensus.cc:740] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:34.551921  8660 catalog_manager.cc:5697] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.554728 15479 consensus_queue.cc:260] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.543067  8837 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:34.555286  8660 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 20, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 20 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:34.556023 15550 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.560164  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.545368  8769 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.561708  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.563076  8835 raft_consensus.cc:2393] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 20: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:34.565467  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.567798 15478 raft_consensus.cc:2804] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:34.577414 15478 raft_consensus.cc:697] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:34.570286 15539 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.571668  8914 raft_consensus.cc:1275] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:34.572288 15552 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.564949 15635 consensus_queue.cc:1059] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:34.585964 15758 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:34.586663 15635 raft_consensus.cc:3055] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:34.587108 15598 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:34.587183  8735 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.587699 15598 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:34.588732 15430 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.579716  8838 raft_consensus.cc:3055] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:34.589646  8838 raft_consensus.cc:740] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:34.579350  8840 raft_consensus.cc:2468] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
I20260709 13:18:34.575456  8660 catalog_manager.cc:5697] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 17 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.576539 15479 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.581872  8769 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.578714 15478 consensus_queue.cc:237] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.593550  8838 consensus_queue.cc:260] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.585366 15552 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.587054 15635 raft_consensus.cc:740] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:34.596312 15552 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.596421  8660 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.597697  8838 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:34.585140 15539 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.600083 15539 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.591739 15330 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:34.589357 15598 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:34.597126 15635 consensus_queue.cc:260] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.610755  9459 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
I20260709 13:18:34.599699  8660 catalog_manager.cc:5697] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.614578  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:34.622418  8735 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:34.619593 15445 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:18:34.627875  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:34.628762  8911 raft_consensus.cc:2368] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:34.635351  8807 leader_election.cc:400] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 21. Current term is 22.
I20260709 13:18:34.633658  8660 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 12 to 13, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 13 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:34.635779  8807 leader_election.cc:403] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.622707 15539 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:18:34.641706  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:34.609679 15642 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:18:34.643078  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:34.646332  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.629026  8734 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:18:34.622916 15550 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:34.652724 15550 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.652971 15598 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.653323 15550 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.654209 15400 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:34.655172 15445 raft_consensus.cc:993] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:34.655763 15445 raft_consensus.cc:1081] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Signalling peer bdb96be202c2447586477b2077b7d5bf to start an election
I20260709 13:18:34.665302 15673 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.667886  8915 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.671662 15525 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.672209 15758 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:34.647344 15632 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.673117  8760 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:18:34.681931  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 60263.5us
W20260709 13:18:34.683586  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 65107.1us
I20260709 13:18:34.684127  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:34.684571 15685 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:34.685231 15445 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 21. Current term is 22.
I20260709 13:18:34.685299 15685 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:34.686487 15685 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.680755  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.687767  8835 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.688807 15486 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:34.689544 15486 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.693112 15445 consensus_queue.cc:1048] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:34.691881 15486 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:34.709690  8913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1d69638bb504813949178c6aee64727"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
 from {username='slave'} at 127.0.0.1:42824
I20260709 13:18:34.713342  8913 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:34.713762  8913 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.714074  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:34.717244  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:34.717343  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:34.718355  8840 raft_consensus.cc:3055] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:34.718602  8839 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:18:34.718711  8840 raft_consensus.cc:740] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:34.721873  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:34.731900  8838 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 10.
W20260709 13:18:34.735090  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 112826us
I20260709 13:18:34.715962 15635 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.745023  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:34.757128 15541 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:34.757956 15541 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:34.758446 15541 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:34.738512  8840 consensus_queue.cc:260] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.780227  8840 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.788450  8913 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:34.789072  9468 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:18:34.791688  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50702.4us
I20260709 13:18:34.793884  8840 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:34.794456 15430 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:18:34.831534  8913 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:34.838794  8835 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:34.840366  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:34.843755 15330 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:34.832410  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:34.834811  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:34.862579  8760 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:34.863247  8768 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:34.813146 15756 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:34.857739  8732 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:34.872412  8915 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:34.874282  8914 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:34.878980 15632 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:34.819128 15758 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
W20260709 13:18:34.876638 15777 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:18:34.883770 15550 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.890877 15550 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:34.954630  8760 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
W20260709 13:18:34.960310  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 88350us
I20260709 13:18:34.961874 15330 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:34.987464  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 243238us
I20260709 13:18:34.981868 15330 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:34.961855 15758 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:34.965690 15400 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:34.992998  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 135379us
I20260709 13:18:34.996701  8732 leader_election.cc:400] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:34.997088  8732 leader_election.cc:403] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.998008  8732 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:35.001200 15550 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:35.009357  8911 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:35.012298  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:35.013010  8835 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.993166 15516 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.029623  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:35.029856  8842 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:35.037189  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:35.039940  9466 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.043116  8836 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.026124 15768 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:35.052475 15784 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.053201 15784 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.055629 15784 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.037503 15758 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.058651 15758 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:35.065183  8809 consensus_peers.cc:597] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 430f59d9e22342829896b185b2da7cf3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:35.042878 15685 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:35.070847  8839 raft_consensus.cc:3055] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:35.071290  8839 raft_consensus.cc:740] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:35.072126  8839 consensus_queue.cc:260] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:35.081938  8839 raft_consensus.cc:3060] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.084372  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:35.085274  8913 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:35.089308  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.089895  9466 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:35.091092  8915 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:35.093178  9459 raft_consensus.cc:1240] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:35.094655  8839 raft_consensus.cc:2468] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:35.094913  8835 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:35.093951  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.046032 15400 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.111166 15400 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:35.048048 15516 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.113899 15516 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:35.118189 15685 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:35.119398 15685 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.121308  8841 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:18:35.121337  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.136205 15539 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.137874 15539 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.138589  9466 raft_consensus.cc:1275] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:35.142922  8735 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:35.144673  8913 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:35.146618 15788 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:35.147207 15788 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:35.148087 15788 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.160807  8836 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:35.160238  8883 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:35.208279  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 48147.1us
I20260709 13:18:35.097549 15541 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.227738 15516 raft_consensus.cc:2804] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:18:35.339358 15669 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:18:35.396935  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 255771us
I20260709 13:18:35.473213 15768 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.511665 15541 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:35.513247 15711 log.cc:927] Time spent T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: Append to log took a long time: real 0.364s	user 0.006s	sys 0.005s
I20260709 13:18:35.513437  8918 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:35.228785 15486 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:18:35.514325  8810 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.531657  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 309819us
I20260709 13:18:35.319561 15785 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:35.522295  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 305677us
I20260709 13:18:35.529341  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.534045  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.533767 15768 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.538448 15516 raft_consensus.cc:697] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:35.539664 15768 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.539567 15516 consensus_queue.cc:237] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:35.525238 15758 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:18:35.513247 15539 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.521626 15552 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.542481 15552 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.545091  8840 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:35.545480 15552 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.547569 15721 consensus_queue.cc:1048] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:35.549007 15541 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.549587 15541 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.550987 15785 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.551892 15541 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:35.553224  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.553985  8766 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:35.556442 15785 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.561466  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.564810 15632 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:35.565320 15794 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.567031  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.568354  8766 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:35.569432  8768 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:18:35.524048 15598 consensus_meta.cc:287] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.011s
I20260709 13:18:35.566906  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.592387  8836 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:35.595839  8764 raft_consensus.cc:1240] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:35.609959  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.620476  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.621898  8842 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:35.625572  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.619115 15539 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.627624  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.600997 15632 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.572897 15635 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.645756  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:35.603071 15794 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.666231  8762 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 14.
I20260709 13:18:35.645520 15539 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.638818 15445 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:35.695116  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.699137  8835 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 15.
W20260709 13:18:35.701416  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 56068.8us
I20260709 13:18:35.713831 15789 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:18:35.715113  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.715921  8762 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:35.717530 15761 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:35.719733 15552 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:35.720602 15552 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.687618 15598 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.722683 15598 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.727661  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.728181 15445 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:35.728976 15445 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:35.730278 15430 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:35.730906 15430 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:35.737075  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
W20260709 13:18:35.737785 15797 log.cc:927] Time spent T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:18:35.738427  8763 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 14: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:35.655530 15635 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:35.761471 15635 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.762111  8769 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:35.745699  8765 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:35.767091 15632 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.769326 15430 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:35.784247 15791 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:35.770439  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.758431  8843 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40100 (request call id 3538) took 1059 ms. Trace:
I20260709 13:18:35.728425  8766 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:35.789585  8844 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 14.
I20260709 13:18:35.713311  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:35.786222  8762 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:35.797353  8808 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:35.798239  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:18:35.808941  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 95740.4us
I20260709 13:18:35.810367  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:35.821421  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.822479  8766 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:35.850587  8763 raft_consensus.cc:2393] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:35.851007  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:35.785262  8843 rpcz_store.cc:276] 0709 13:18:34.698818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.699003 (+   185us) service_pool.cc:224] Handling call
0709 13:18:34.710506 (+ 11503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:34.984098 (+273592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:34.984130 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.019317 (+ 35187us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.463856 (+444539us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:35.463912 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.464003 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:35.758100 (+294097us) raft_consensus.cc:1685] finished
0709 13:18:35.758135 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:35.758312 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268180,"raft.queue_time_us":276286,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":411851,"threads_started":1,"wal-append.queue_time_us":600754}
W20260709 13:18:35.859076  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 137291us
W20260709 13:18:35.859876  8809 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.845121 15400 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:35.844252 15598 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:35.879997  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:35.880453  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:35.880759  8915 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:35.882174  8911 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:35.883461  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:35.884341  8909 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 20: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:35.886390  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:35.886309  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:35.889393 15445 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.850057 15539 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:35.896430  8764 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:35.784883 15791 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:35.889786 15669 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:18:35.861629 15789 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:35.906952  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.907330  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.914646  8835 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:35.908789  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:35.903770  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:35.910328  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.911582  8838 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:18:35.911653  8844 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:35.909214  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:35.918241  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:35.915992  8843 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 14.
I20260709 13:18:35.919004  8840 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:35.921614  8917 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:35.911298 15813 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:35.905072 15552 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:35.948546  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 57695.9us
I20260709 13:18:35.914258 15789 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:35.954360  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45243.9us
I20260709 13:18:35.910619 15539 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:35.920459 15635 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:35.965543  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:35.925534  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:18:35.971494  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 75367.1us
I20260709 13:18:35.973421  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:35.922382 15813 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.967839 15635 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.949321 15673 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:18:35.925343 15445 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:35.967984 15789 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.003319  9459 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:18:36.007500  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 210262us
I20260709 13:18:35.971432 15784 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:35.978369 15550 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:36.026055  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48296.6us
I20260709 13:18:35.985463 15635 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.032727 15550 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.041285 15550 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:36.042791 15801 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:18:36.044226  8760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60048 (request call id 3690) took 1082 ms. Trace:
I20260709 13:18:36.044687  8760 rpcz_store.cc:276] 0709 13:18:34.961936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.966830 (+  4894us) service_pool.cc:224] Handling call
0709 13:18:34.982984 (+ 16154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:35.015680 (+ 32696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:35.015729 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:35.022003 (+  6274us) log.cc:844] Serialized 26 byte log entry
0709 13:18:35.221661 (+199658us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:35.221722 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:35.221818 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:36.043946 (+822128us) raft_consensus.cc:1685] finished
0709 13:18:36.043973 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:36.044129 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31864,"raft.queue_time_us":30177,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9784,"spinlock_wait_cycles":1684352,"thread_start_us":145648,"threads_started":1,"wal-append.queue_time_us":670769}
I20260709 13:18:36.003916 15642 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.046610 15642 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.046717 15791 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:36.047115 15642 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.047425 15791 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:36.048990 15445 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.025871 15784 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.050242 15784 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.984838 15813 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.048136 15791 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.052211  8808 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:36.066366 15445 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.073287 15400 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:36.087324 15400 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.090494 15794 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.093480  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.096046 15445 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:36.096493 15445 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.097455  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.098001 15807 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 13:18:36.098419  8917 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:36.099534  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.103225 15782 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.103842 15782 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:36.103955 15550 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.106416 15782 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.107071  8808 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:36.107915 15810 ts_tablet_manager.cc:933] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:36.109174 15552 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:36.109457 15829 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:36.109649 15552 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.110056 15829 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.110391 15410 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:36.104215 15494 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.111907  8841 raft_consensus.cc:1275] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:36.111815 15494 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.112480 15829 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:36.113407 15824 raft_consensus.cc:493] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.113515 15445 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:36.110069 15552 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.117238 15400 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:36.119089 15768 raft_consensus.cc:493] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.104327 15791 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.095232  8916 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:36.121354 15669 tablet_bootstrap.cc:492] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:18:36.175474  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.181363  8762 raft_consensus.cc:1240] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:36.183900  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
W20260709 13:18:36.186928  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 72095.6us
I20260709 13:18:36.194435 15784 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.194759 15642 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:36.197559  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 214611us
W20260709 13:18:36.199558  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 219087us
I20260709 13:18:36.183825 15788 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.185926 15794 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.200699  8735 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:36.207559  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.208274  8914 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:36.218781  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.220432  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:36.219511  8909 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:36.186836 15768 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.238888  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.219512 15669 ts_tablet_manager.cc:1403] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 2.208s	user 0.106s	sys 0.118s
I20260709 13:18:36.245097  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:36.216032 15788 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.247467  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.247134  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.272699  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.203462 15824 raft_consensus.cc:515] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.274909 15804 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.275408 15804 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.275727 15804 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.276331 15824 leader_election.cc:290] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.277068 15824 raft_consensus.cc:493] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.277655 15824 raft_consensus.cc:515] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.279999 15824 leader_election.cc:290] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.281800 15642 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.215814 15794 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:36.282776 15550 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.284204 15843 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:36.284932 15814 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:18:36.285790 15843 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:36.286191 15843 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:36.286621 15843 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:36.266702  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.289378  8912 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
W20260709 13:18:36.296279  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 90688.7us
I20260709 13:18:36.284611 15794 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:36.301883  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 101269us
W20260709 13:18:36.299621  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 73677.7us
I20260709 13:18:36.237519 15810 tablet_copy_client.cc:323] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:18:36.269537 15806 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.344348  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:36.349362 15794 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:18:36.353107 15598 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:36.354182 15819 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:18:36.353824 15598 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.344367  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:36.361454  8735 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:36.366559  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:36.377097  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 191136us
I20260709 13:18:36.364718  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:36.387214  9468 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:36.386411  8808 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:36.400729  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5380dc645e984447aefd4408bca2f2af" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.401317  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.404009 15832 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:36.404661 15842 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:36.405104 15842 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.405442 15842 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.375200 15410 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.384171 15794 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.412695 15494 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.422730 15784 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.425099 15794 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.428246 15794 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.360821 15806 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.431320 15806 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.431203 15789 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.432190  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.433502  8761 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:36.393466 15430 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:36.441560 15768 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.447947 15783 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.448578 15783 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:36.449082 15635 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.450511  8918 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:36.450794 15669 raft_consensus.cc:359] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 15 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.451354 15783 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:36.416641 15539 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:36.455387  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.460156 15598 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:36.473690  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:36.474870  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 110255us
I20260709 13:18:36.420589 15410 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.490721  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:36.470017  8732 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:36.476213  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:36.521479  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:36.522890  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:36.523077  8769 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:36.525777  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:18:36.527679  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 57735.7us
I20260709 13:18:36.538029  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:36.534449  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:36.543627  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7689b80937134444a5933a16f9aa7d64" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.545205  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:36.527846 15794 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.545979  8911 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.546072 15794 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.419631 15486 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:18:36.472640 15539 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:36.550566  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 59936.6us
I20260709 13:18:36.551425 15330 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:36.454224 15669 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:18:36.554349  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.561339  8917 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:36.527509 15478 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.518397 15410 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.560308 15330 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:36.540467 15806 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:36.576671 15845 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:36.577266 15845 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.577765 15845 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:36.580176  8661 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 15 to 16, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:36.518779 15541 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:18:36.582139 15811 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:36.559964 15539 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.595714  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:36.596675  8916 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:36.597484  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:36.601106  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:36.566334 15478 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:36.605373  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 108513us
I20260709 13:18:36.605710  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:36.606923  8918 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:36.613284  8835 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:36.588958 15784 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.564116 15516 consensus_queue.cc:1048] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:18:36.618281  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:36.612623 15330 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.623427  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:36.633927  8911 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 19.
I20260709 13:18:36.612087 15478 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:36.654944  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 239324us
W20260709 13:18:36.611934 15761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.014s	sys 0.014s
W20260709 13:18:36.715199  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 91870.5us
I20260709 13:18:36.716084 15642 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.716662 15642 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.716840  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.715237  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.717525  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.718045  8766 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:36.717530  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.719189  8760 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:36.717054 15642 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.720268  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.721741  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:36.722045 15794 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.722568  8761 raft_consensus.cc:2393] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:36.727897 15794 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.728503 15794 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.732663  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet 430f59d9e22342829896b185b2da7cf3 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:18:36.733582  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet 430f59d9e22342829896b185b2da7cf3 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-430f59d9e22342829896b185b2da7cf3
I20260709 13:18:36.619913 15830 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:36.593344 15806 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.740223  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:36.616990 15700 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:36.708690 15761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.015s	sys 0.014s
I20260709 13:18:36.636608 15788 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.594377 15842 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:36.656113 15486 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:36.622612 15784 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.741715 15830 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:36.786864  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 127884us
I20260709 13:18:36.749908 15794 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.609591 15669 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
W20260709 13:18:36.791953  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 230468us
I20260709 13:18:36.792227  8838 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:36.788309  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:36.781348 15789 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:36.813246 15804 consensus_meta.cc:287] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:18:36.842687  8769 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:36.779426 15858 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:36.786532 15830 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:36.813827  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:36.852919  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 64708.8us
W20260709 13:18:36.814509 15843 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.005s
I20260709 13:18:36.788992 15486 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:36.854439 15782 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:18:36.886723  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73009.1us
W20260709 13:18:36.888196 15855 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:18:36.866056 15858 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:36.860613 15804 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.979385  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
W20260709 13:18:36.994045  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 56003.7us
W20260709 13:18:36.998661  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 55822.4us
I20260709 13:18:37.001663  8842 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
W20260709 13:18:37.108937  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 109995us
W20260709 13:18:36.966883 15856 log.cc:927] Time spent T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:18:36.978685 15853 log.cc:927] Time spent T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260709 13:18:36.980095 15852 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 13:18:36.952050 15841 log.cc:927] Time spent T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.587s	user 0.004s	sys 0.003s
I20260709 13:18:36.961658 15669 ts_tablet_manager.cc:1434] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.692s	user 0.011s	sys 0.011s
W20260709 13:18:36.964396 15445 consensus_meta.cc:287] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.791s	user 0.005s	sys 0.004s
W20260709 13:18:37.113248  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 77865.4us
I20260709 13:18:37.116178 15400 consensus_queue.cc:1059] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:36.990585 15642 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:36.981272 15854 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:18:37.119133 15700 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:36.980690 15806 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.120787  8840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:36.973934 15784 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.953040 15824 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:37.124888 15635 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:36.945677 15789 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:37.126197 15804 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.127065 15858 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:36.876101 15843 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:36.953289 15850 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:36.992274 15552 consensus_meta.cc:287] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.817s	user 0.014s	sys 0.004s
I20260709 13:18:36.976899 15842 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.136420  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:36.997246 15813 consensus_meta.cc:287] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Time spent flushing consensus metadata: real 0.911s	user 0.009s	sys 0.004s
I20260709 13:18:36.974511 15486 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:18:37.121732 15845 consensus_meta.cc:287] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.003s
I20260709 13:18:37.149703  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.130424 15866 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:37.143155 15669 ts_tablet_manager.cc:1467] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Tablet startup took 896ms
I20260709 13:18:37.170372  8910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42824 (request call id 3518) took 1052 ms. Trace:
I20260709 13:18:37.171015 15787 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:37.171741 15843 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.171674 15845 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.166992 15552 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.155260 15761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40864 (request call id 0) took 2695 ms. Trace:
I20260709 13:18:37.180617  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.167157 15850 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.154397 15824 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.174674 15789 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:37.190860  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.144254 15445 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.177860  8910 rpcz_store.cc:276] 0709 13:18:36.092219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.097026 (+  4807us) service_pool.cc:224] Handling call
0709 13:18:36.097529 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:36.185607 (+ 88078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:36.185638 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:36.489752 (+304114us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b2c00125038. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6e693a11 00007fce6e6a3372 00007fce6fdd5a01 00007fce6fd9a43a 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2
0709 13:18:36.562484 (+ 72732us) log.cc:844] Serialized 26 byte log entry
0709 13:18:36.859067 (+296583us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:36.859116 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:36.859573 (+   457us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:37.141498 (+281925us) raft_consensus.cc:1685] finished
0709 13:18:37.141531 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:37.144117 (+  2586us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94124,"raft.queue_time_us":84418,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4380,"spinlock_wait_cycles":17710592,"thread_start_us":256104,"threads_started":1,"wal-append.queue_time_us":556176}
I20260709 13:18:37.152199 15700 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.183992 15486 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:37.215935  8765 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:37.168259 15813 raft_consensus.cc:515] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.210563  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.212204  8840 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 16.
I20260709 13:18:37.214200  8837 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:18:37.205462  8808 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:37.226233  8732 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:37.233342  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.213555 15828 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.182829 15866 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.240382  8835 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 15: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:37.207670 15789 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:37.244791  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.241392  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.213704 15635 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:37.241194  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.205896 15830 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:37.239135 15784 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:37.246696  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.282021  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.239676 15873 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:37.221361 15478 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.252483 15789 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:37.286285  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71443.6us
I20260709 13:18:37.291313  8807 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.292372  8768 raft_consensus.cc:2368] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17.
I20260709 13:18:37.287454 15445 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.285951 15873 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.261729 15806 raft_consensus.cc:493] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:37.275427 15870 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.282028  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.298592  8917 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:37.300063  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.285614 15784 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:37.279496 15635 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.303217 15842 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:37.304942  8836 raft_consensus.cc:1275] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:18:37.301676 15539 consensus_meta.cc:287] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.001s
I20260709 13:18:37.303309  8909 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:37.327214  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.327827 15843 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:37.328083  8917 raft_consensus.cc:2393] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 20: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:37.328416 15843 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.327461  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.329698 15845 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.315448 15700 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:37.177634 15669 ts_tablet_manager.cc:1469] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Trace:
0709 13:18:30.475921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.481374 (+  5453us) service_pool.cc:224] Handling call
0709 13:18:30.628190 (+146816us) ts_tablet_manager.cc:934] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
0709 13:18:31.866138 (+1237948us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:32.773485 (+907347us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:32.773631 (+   146us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:33.090547 (+316916us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:33.133329 (+ 42782us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:33.177542 (+ 44213us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:33.177627 (+    85us) inbound_call.cc:177] Queueing success response
0709 13:18:34.011430 (+833803us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:36.281308 (+2269878us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:36.344609 (+ 63301us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:36.438056 (+ 93447us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":99724,"mutex_wait_us":34362,"raft.queue_time_us":3667,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":5367,"tablet-copy.queue_time_us":94705,"tablet-download-pool.queue_time_us":11214,"tablet-download-pool.run_cpu_time_us":1315,"tablet-download-pool.run_wall_time_us":88470,"thread_start_us":204895,"threads_started":2}
I20260709 13:18:37.316352 15806 raft_consensus.cc:515] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.317724 15813 leader_election.cc:290] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:37.302659 15873 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.198269 15761 rpcz_store.cc:276] 0709 13:18:34.448266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.541045 (+ 92779us) service_pool.cc:224] Handling call
0709 13:18:34.559019 (+ 17974us) log.cc:844] Serialized 499 byte log entry
0709 13:18:34.812398 (+253379us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b54000cf1a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd13142 00007fce6fcf3eaa 00007fce6fcfad53 00007fce6fcfacd9 00007fce6fcfac69 00007fce6fcfac31 00007fce6fcf9dfd 000000000038f354 000000000038f199 00007fce6ccad475
0709 13:18:34.969361 (+156963us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b54000cf1a0. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd1ab26 00007fce6fd1449a 00007fce6fd13714 00007fce6fcf3eaa 00007fce6fcfad53 00007fce6fcfacd9 00007fce6fcfac69 00007fce6fcfac31 00007fce6fcf9dfd 000000000038f354
0709 13:18:34.974576 (+  5215us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b18003aff60. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce75b75de1 00007fce75b825b1 00007fce6cc27c0a 00007fce76367219 00007fce6ccafa40 00007fce6ccaa4e4 00007fce6ccaa455 00007fce6fcf3b0b 00007fce6fd78b63 00007fce6fda0752 00007fce74d60d29
0709 13:18:37.143714 (+2169138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270594,"raft.queue_time_us":349726,"raft.run_cpu_time_us":6250,"raft.run_wall_time_us":370503,"spinlock_wait_cycles":16378368,"thread_start_us":75699,"threads_started":1,"wal-append.queue_time_us":110002,"wal-append.run_cpu_time_us":1962,"wal-append.run_wall_time_us":1001987}
I20260709 13:18:37.359396 15807 raft_consensus.cc:3055] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:37.359884 15807 raft_consensus.cc:740] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:37.359915 15866 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.361270  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.362071 15478 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:37.320963 15870 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.314347  8760 raft_consensus.cc:2393] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 15: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:37.329815  8836 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:37.364784  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.314832  8767 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 19: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:37.333776  8735 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.334810  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "512bfb8ae84244418d0107564d88e5bb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.335798  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.335767  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.328197 15830 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.357019  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb4847af9abd4172bff3a603da47325c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.336436 15784 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.364363 15807 consensus_queue.cc:260] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:37.324023 15857 log.cc:927] Time spent T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.539s	user 0.003s	sys 0.009s
I20260709 13:18:37.323782 15877 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.372364  8914 raft_consensus.cc:2368] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
W20260709 13:18:37.370092  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 72149.7us
I20260709 13:18:37.324237 15828 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.371656  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.370049  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.330689 15642 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.379623  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.385607  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.365224 15870 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.390982 15794 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:37.394475  8854 tablet_copy_source_session.cc:215] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:37.377588 15785 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.395825  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.330680 15539 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.404181 15635 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.405396  8917 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
W20260709 13:18:37.406543  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 105413us
I20260709 13:18:37.408514 15843 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:37.412267  8735 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.434163  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.432344  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.414336  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:37.433645  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.434866  8837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 3951) took 1210 ms. Trace:
I20260709 13:18:37.452394  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.452744  8764 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:37.408651  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.411521  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.456439  8909 raft_consensus.cc:2393] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:37.434943  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.452996  8837 rpcz_store.cc:276] 0709 13:18:36.224572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.224688 (+   116us) service_pool.cc:224] Handling call
0709 13:18:36.225030 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:37.223997 (+998967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:37.434618 (+210621us) spinlock_profiling.cc:243] Waited 986 ms on lock 0x7b54003a6454. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9ae01 00007fce6fd9983e 00007fce74d5e419 00007fce6e2d5bd4 00007fce6e2d5b62 00007fce6e2d5a91 00007fce6e2d5a0c 00007fce6e2d4cc2 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:37.434813 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2267741056}
I20260709 13:18:37.458298  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.458746  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.459491  8909 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:37.461460  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49294.1us
I20260709 13:18:37.462426  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.463815  8764 raft_consensus.cc:2368] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17.
I20260709 13:18:37.489360  8808 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:37.491343  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.493673  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.498713  8835 raft_consensus.cc:2368] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:37.500578  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5dcaab01b5438f9054f5e8fcbd0a5c" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:37.501010  8808 leader_election.cc:400] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17.
I20260709 13:18:37.501336  8808 leader_election.cc:403] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.413033 15552 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.505082  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.506634  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.422417 15768 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:37.389662 15828 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.456405 15845 raft_consensus.cc:493] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.512264  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.514602  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.515113  8917 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.484419 15791 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:37.484781 15700 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:37.408675 15830 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 13:18:37.529623  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.498607 15847 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:37.510116 15842 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.528796  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.431988 15789 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.387195 15877 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.533797  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.533951  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.535727  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:37.540016  8917 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:37.544214  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.532115 15847 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.545593  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.554155  8911 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 20.
I20260709 13:18:37.519701 15768 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.550366  8842 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:37.523363 15845 raft_consensus.cc:515] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.557789  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:37.552150 15410 consensus_meta.cc:287] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Time spent flushing consensus metadata: real 0.952s	user 0.011s	sys 0.007s
I20260709 13:18:37.532630 15700 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.566053  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.555379 15847 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.569214  8732 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:37.571488  8881 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:37.578122  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.578361 15794 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:37.579285  8760 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf in current term 17: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:37.581009  8732 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.583851  8909 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:37.587859  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.580761  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.593128  8760 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.609030  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.610422 15700 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.610867 15783 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.611248 15877 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.617767 15785 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:37.622823 15539 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.626381 15810 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430f59d9e22342829896b185b2da7cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:37.629999  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:37.583612 15875 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 13:18:37.646147  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.599486 15794 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.648754 15868 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:37.649449 15868 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.650944 15804 raft_consensus.cc:493] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:37.651417 15850 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:37.651672 15868 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:37.654484 15845 leader_election.cc:290] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:37.655128 15785 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:37.655640 15785 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.655977 15785 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.657231  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.657979  8916 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:37.658320  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.658578 15824 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.660140 15807 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:37.568073 15410 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.662269  8844 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 19: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:37.663221  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.663408 15410 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.665323  8838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 3562) took 1128 ms. Trace:
I20260709 13:18:37.665854  8838 rpcz_store.cc:276] 0709 13:18:36.537416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.537666 (+   250us) service_pool.cc:224] Handling call
0709 13:18:37.665109 (+1127443us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540006ac54. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:18:37.665249 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":577158912}
I20260709 13:18:37.663240  8844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40100 (request call id 3561) took 1141 ms. Trace:
I20260709 13:18:37.674966  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e090a13858f439f934f3a0277b08f18" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.675846  8841 raft_consensus.cc:3060] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.671015  8732 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.673053  8844 rpcz_store.cc:276] 0709 13:18:36.521976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:36.525468 (+  3492us) service_pool.cc:224] Handling call
0709 13:18:37.663053 (+1137585us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54001e6254. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd9e2fa 00007fce74d5fb17 00007fce6e2da6d4 00007fce6e2da662 00007fce6e2da591 00007fce6e2da50c 00007fce6e2d97c2 00007fce6e0d548c 00007fce6e0d48c6 00007fce6e0d426f
0709 13:18:37.663165 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2611519872}
I20260709 13:18:37.683410  8760 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:37.681782  8732 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:37.687438 15794 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:37.688001 15794 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:37.689533 15794 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:37.691839 15768 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.698997 15525 consensus_queue.cc:1048] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 13:18:37.683233 15830 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.712216  8839 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:37.715332 15842 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17.
I20260709 13:18:37.712103  8760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.722200  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.723436 15330 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:37.680292 15789 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:37.749631  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.651604 15804 raft_consensus.cc:515] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.755168  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.756031  8765 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.762250  8807 leader_election.cc:304] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.763648  8807 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.765179 15850 raft_consensus.cc:2749] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:37.765354 15863 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:37.765192  8807 leader_election.cc:304] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.767030 15824 raft_consensus.cc:2749] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.768543  8807 leader_election.cc:400] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:18:37.768977  8807 leader_election.cc:403] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.770301  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.771270 15824 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.771334 15873 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.737780 15868 consensus_queue.cc:1059] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:37.773000  8836 raft_consensus.cc:2368] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:37.772990  8807 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.774096 15824 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:37.775435  8807 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:37.776356 15824 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:37.777226 15824 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:37.778301 15824 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:37.783211  8807 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.786551 15886 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:37.791121  8807 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.795419 15886 raft_consensus.cc:2749] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:37.797150  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.802325 15828 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:37.806275  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.807071 15886 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:37.759835 15445 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:37.812309  8928 tablet_copy_service.cc:342] P bdb96be202c2447586477b2077b7d5bf: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-e3373a354d754ec48ac0cc05829af66f received from {username='slave'} at 127.0.0.1:35822
I20260709 13:18:37.812256 15445 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:37.813198  8928 tablet_copy_service.cc:434] P bdb96be202c2447586477b2077b7d5bf: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-e3373a354d754ec48ac0cc05829af66f on tablet e3373a354d754ec48ac0cc05829af66f with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:18:37.817965  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:37.815462  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.831931  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.841554 15785 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.837114 15881 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:37.856436  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.844686 15785 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.860024  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.860858  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.847611 15494 raft_consensus.cc:493] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:37.864806  8835 raft_consensus.cc:2368] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:37.864992  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.865154  8808 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:37.865712  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 255109us
I20260709 13:18:37.869059  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:37.870708  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.872169 15868 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:37.874148 15541 raft_consensus.cc:3055] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:37.876364  8841 raft_consensus.cc:2468] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:37.876989  8808 leader_election.cc:400] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17.
I20260709 13:18:37.866778 15828 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:37.876300  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:37.875176  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:37.879737  8732 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:37.883448 15794 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:37.885602 15794 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:37.875620 15494 raft_consensus.cc:515] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.886065 15794 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.886276 15635 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:37.886902 15635 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:37.887912 15494 leader_election.cc:290] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.887817 15635 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.891215  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:37.892113  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:37.905428 15525 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:37.905922  8884 leader_election.cc:400] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:37.905987 15873 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.911857  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:37.912014  9432 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.875583 15886 raft_consensus.cc:493] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:37.878118 15870 raft_consensus.cc:2749] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883) with higher term. Message: Invalid argument: T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18.
I20260709 13:18:37.878144 15541 raft_consensus.cc:740] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:37.900027 15794 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.938042  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:37.938758  8917 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.959764 15794 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:37.961246  8769 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 21: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:37.961421 15541 consensus_queue.cc:260] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.962524 15541 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:37.918833 15700 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:37.979179  8839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:37.983462  8840 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:37.917410 15847 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:37.992805  8917 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:37.993160  8839 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 21: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:37.939944 15886 raft_consensus.cc:515] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.018286  8843 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 18: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:38.044828  8882 leader_election.cc:304] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:38.050688 15400 raft_consensus.cc:2804] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:38.051381 15400 raft_consensus.cc:697] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:38.052325 15400 consensus_queue.cc:237] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:38.046672  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 94184.7us
I20260709 13:18:38.082311 15847 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.090507 15881 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:38.091980 15410 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:38.092628 15410 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:38.093124 15842 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:38.093655 15842 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.094230  8838 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:38.094846 15870 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:38.095530 15410 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:38.095345 15870 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.095707 15842 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.098176  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:38.098968  8768 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 18: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:38.101344  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:38.102634  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:38.102792 15873 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:38.103622 15873 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:38.104286  8715 auto_rebalancer.cc:629] Failed to schedule move for tablet ef624fe5958542fa8714cedf17ca4940: Illegal state: Replica 773340b2958e4af5b2010b902b9e9c04 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:18:38.109273 15899 log.cc:927] Time spent T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:38.110406 15873 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:38.114753 15806 leader_election.cc:290] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.114478 15642 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:38.116573  8732 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:38.118618 15886 leader_election.cc:290] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.125169  8884 leader_election.cc:400] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:38.125579  8884 leader_election.cc:403] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:18:38.128386  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 208642us
I20260709 13:18:38.128715  8909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:38.129422  8909 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:38.142760  8837 raft_consensus.cc:1240] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:18:38.151917  8735 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.159789  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:38.116385 15642 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.169589  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:38.172727  8769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:38.173462  8762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:38.175609  8735 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.179689 15330 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:38.183007  8765 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:38.184384  8809 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:37.142876  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:38.188316 15400 raft_consensus.cc:3055] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:38.188727 15400 raft_consensus.cc:740] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:38.189133  8909 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:38.194175  8809 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:38.151284 15843 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:38.207984 15870 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.169600 15794 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.214226 15794 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:38.214633 15794 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:38.214998 15794 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.217633  8660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 237) took 7196 ms. Trace:
I20260709 13:18:38.218032  8660 rpcz_store.cc:276] 0709 13:18:31.021309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.021459 (+   150us) service_pool.cc:224] Handling call
0709 13:18:38.217519 (+7196060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:35.068963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:35.069752 (+   789us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:35.069951 (+   199us) write_op.cc:435] Acquired schema lock
0709 13:18:35.069983 (+    32us) tablet.cc:662] Decoding operations
0709 13:18:35.071461 (+  1478us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:35.071557 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:35.071593 (+    36us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:18:35.072409 (+   816us) tablet.cc:701] Row locks acquired
0709 13:18:35.072472 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:18:35.072734 (+   262us) write_op.cc:270] Start()
0709 13:18:35.075985 (+  3251us) write_op.cc:276] Timestamp: P: 1783603115072641 usec, L: 0
0709 13:18:35.077297 (+  1312us) op_driver.cc:348] REPLICATION: starting
0709 13:18:35.146587 (+ 69290us) log.cc:844] Serialized 2840 byte log entry
0709 13:18:35.708530 (+561943us) op_driver.cc:464] REPLICATION: finished
0709 13:18:36.015502 (+306972us) write_op.cc:301] APPLY: starting
0709 13:18:36.024385 (+  8883us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:36.068643 (+ 44258us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:36.068776 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:36.094367 (+ 25591us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:36.094582 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:18:36.094628 (+    46us) write_op.cc:312] APPLY: finished
0709 13:18:36.094908 (+   280us) log.cc:844] Serialized 73 byte log entry
0709 13:18:36.113294 (+ 18386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.113997 (+   703us) write_op.cc:454] Released schema lock
0709 13:18:36.114046 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:36.115063 (+  1017us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.115094 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":265717,"apply.run_cpu_time_us":12706,"apply.run_wall_time_us":129225,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33345,"num_ops":7,"prepare.queue_time_us":168308,"prepare.run_cpu_time_us":5759,"prepare.run_wall_time_us":116947,"replication_time_us":630997,"thread_start_us":189380,"threads_started":2}]]}
I20260709 13:18:38.157248 15785 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
W20260709 13:18:38.272909  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 47104.5us
I20260709 13:18:38.205854 15768 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.205506 15410 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.200273 15828 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
W20260709 13:18:38.270995 15897 log.cc:927] Time spent T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:18:38.227283 15843 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:38.280134 15870 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:38.300299  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:38.335804  8761 raft_consensus.cc:2368] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
W20260709 13:18:38.400120  8883 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:38.447170  8765 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:38.276422 15785 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:38.448342  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94e939be989f4d59b1983955951ab90f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:38.444667  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
W20260709 13:18:38.470512  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 294949us
W20260709 13:18:38.473019 15810 consensus_meta.cc:287] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.002s
I20260709 13:18:38.442008 15842 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:38.449088 15870 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.474141  8735 leader_election.cc:400] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:38.485064  8735 leader_election.cc:403] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:18:38.498991  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 320372us
W20260709 13:18:38.500944  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 312096us
I20260709 13:18:38.480377  8663 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
W20260709 13:18:38.518193  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45647.5us
W20260709 13:18:38.510563  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 236894us
I20260709 13:18:38.527442  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.532637  8915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d82cf960a5f4fb4acb573fe580b10ed" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:38.533629  8915 raft_consensus.cc:3060] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:38.513302  8663 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 13 to 14, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 14 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:38.538419  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8a8035ad96048ea978033b357465875" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.540055  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6f1fe9f34b9476fb981c06a43a1fb1d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.542388 15911 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843) with higher term. Message: Invalid argument: T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for earlier term 20. Current term is 21.
I20260709 13:18:38.545459  8732 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:38.545687  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1d69638bb504813949178c6aee64727" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.545706  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:38.496101 15842 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.552346  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.552122  8912 raft_consensus.cc:2393] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 19: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:38.535406 15810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:54292 (request call id 1219) took 2930 ms. Trace:
I20260709 13:18:38.557874 15810 rpcz_store.cc:276] 0709 13:18:35.590439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.600951 (+ 10512us) service_pool.cc:224] Handling call
0709 13:18:36.108360 (+507409us) ts_tablet_manager.cc:934] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
0709 13:18:37.484333 (+1375973us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:37.958889 (+474556us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:37.959031 (+   142us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:38.473571 (+514540us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:38.504287 (+ 30716us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:38.509367 (+  5080us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:38.509455 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16867,"tablet-copy.queue_time_us":318201,"thread_start_us":286166,"threads_started":2}
I20260709 13:18:38.559633 15810 tablet_copy_client.cc:806] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:38.560298 15810 tablet_copy_client.cc:670] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:38.540812 15642 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.561388  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.561996  8807 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.562587  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589fb2d6cab941e09bb87a5254bc9d48" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.563697  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.563814 15886 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:38.557663  8663 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:38.564800  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:38.568624  8918 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 18: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:38.568462  8663 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:38.569645  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:38.569952  8663 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:38.571194  8918 raft_consensus.cc:2393] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 21: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:38.567076  8915 raft_consensus.cc:2468] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:38.590180 15919 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:38.591032 15919 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:38.609575  8915 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:38.607203 15768 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:38.504941 15843 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.617749  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:38.595163 15445 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:38.620535  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.609771 15870 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.592289 15919 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.657176  8882 leader_election.cc:400] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 election: Vote denied by peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017) with higher term. Message: Invalid argument: T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate bdb96be202c2447586477b2077b7d5bf for earlier term 20. Current term is 21.
I20260709 13:18:38.660841  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:38.663925  8882 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:38.626819 15541 consensus_queue.cc:1059] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:18:38.618746 15768 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:38.678762  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 158755us
I20260709 13:18:38.665726 15789 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:38.678894 15807 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.693114  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:18:38.695734 15906 log.cc:927] Time spent T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 13:18:38.692927  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:38.708333 15768 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.709522  8807 leader_election.cc:304] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.711155  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.711927 15863 raft_consensus.cc:2749] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:38.712262  8807 leader_election.cc:304] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.712667 15863 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.684423 15785 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:38.718153  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:38.724752 15914 log.cc:927] Time spent T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:18:38.706164 15635 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:18:38.727298  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:38.701824 15842 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.721093 15804 leader_election.cc:290] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:38.755662 15784 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:38.762287 15881 raft_consensus.cc:2749] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:38.763576  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 51372.7us
I20260709 13:18:38.764518  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.766064  8807 leader_election.cc:304] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.766263  8768 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:38.766958 15410 raft_consensus.cc:2749] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.766335 15445 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:38.773422  8732 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.777936 15925 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:38.779764  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.781122  8768 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:38.787287  9468 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 15 LEARNER]: Advancing to term 17
I20260709 13:18:38.788163  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:38.729547 15794 consensus_meta.cc:287] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Time spent flushing consensus metadata: real 0.514s	user 0.012s	sys 0.000s
I20260709 13:18:38.731159  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:38.837922  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 49575.3us
I20260709 13:18:38.734050  8916 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:38.736075  8843 raft_consensus.cc:1240] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:18:38.737730  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f045ce88a76f4620ad6c717c8245982a" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.744225  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:38.744661 15400 consensus_queue.cc:260] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:38.839870  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 95750.2us
I20260709 13:18:38.840411 15400 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:38.747241 15912 log.cc:927] Time spent T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:18:38.831709 15494 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:38.833134  8835 raft_consensus.cc:1275] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:38.838382  8807 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:38.797055 15863 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:38.855496  8807 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:38.854234  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 171051us
I20260709 13:18:38.861759 15866 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:38.863210  9468 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:38.852991 15768 raft_consensus.cc:2804] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:38.869414 15768 raft_consensus.cc:697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:38.870503 15768 consensus_queue.cc:237] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.876387  8911 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:38.876715  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.877514  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:38.877403  8918 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:38.849301 15886 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:38.882758  8807 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.886082 15911 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:38.883009 15927 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:18:38.901733 15926 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:38.848984 15794 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.905826 15824 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:38.921798  8763 raft_consensus.cc:1240] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Rejecting Update request from peer bdb96be202c2447586477b2077b7d5bf for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:38.923008 15794 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:38.911523 15828 consensus_queue.cc:1048] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:38.928059 15916 consensus_queue.cc:1059] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:38.929082 15916 raft_consensus.cc:3055] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:38.929453 15916 raft_consensus.cc:740] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:38.929912  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 89417us
I20260709 13:18:38.930706  8808 leader_election.cc:304] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:38.938216  9461 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:38.930297 15916 consensus_queue.cc:260] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:38.942317 15916 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.946579 15842 consensus_queue.cc:1059] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:38.950126 15842 raft_consensus.cc:3055] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:38.947939  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:38.950714 15842 raft_consensus.cc:740] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:38.953101 15866 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:38.953626 15866 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:38.954085 15866 raft_consensus.cc:3060] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:38.959815  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49172.1us
I20260709 13:18:38.951867 15842 consensus_queue.cc:260] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:38.962157  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
W20260709 13:18:38.961839  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 95382.4us
I20260709 13:18:38.966058  8914 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:38.962744 15445 raft_consensus.cc:2749] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:38.969729 15842 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:38.977432  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:38.993881  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022d4a4680cb42e4bc9970d8a4f604f1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:39.000896  8916 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 22.
I20260709 13:18:39.002488  8732 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:39.003727  8836 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:18:39.004141  8836 pending_rounds.cc:85] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting all ops after (but not including) 10
I20260709 13:18:39.004993  8844 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:39.005781  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:39.012995 15846 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:18:39.004395  8836 pending_rounds.cc:107] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:18:39.022568  8836 raft_consensus.cc:2889] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:39.009215 15494 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:39.034842  8768 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.037317  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.041095  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.042184  8765 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:39.047538  8765 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:39.051344  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc3c0a941c84f1cb4645abc7a09b1e8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.053670 15810 tablet_copy_client.cc:538] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:39.021828 15933 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:39.059563 15933 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:39.059638  8808 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:39.060683 15933 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.061398 15928 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:39.062966 15768 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:39.064334  8735 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:39.064199  8808 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:39.087574 15791 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:39.089315 15866 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:39.090795 15936 log.cc:927] Time spent T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 13:18:39.091540 15866 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:39.097124  8808 leader_election.cc:304] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:39.072994 15937 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:18:39.070853 15928 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:39.093153 15932 log.cc:927] Time spent T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
I20260709 13:18:39.101910  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
W20260709 13:18:39.140534  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43526.5us
I20260709 13:18:39.146697  8916 raft_consensus.cc:2468] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:39.149715 15806 raft_consensus.cc:2749] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:39.143916  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:39.154776  8767 raft_consensus.cc:2393] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 16: Already voted for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in this term.
I20260709 13:18:39.139271 15831 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:39.142985 15525 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:39.209656 15873 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:39.233913  9466 raft_consensus.cc:1240] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:39.264451  8807 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:39.272809 15794 raft_consensus.cc:1064] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
W20260709 13:18:39.273419 15794 raft_consensus.cc:1068] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: Unable to promote non-voter 3b34c95a175945b88b17f07fbc650abf: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:39.178573 15831 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.210650 15525 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.302867 15525 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:39.287321 15768 raft_consensus.cc:2804] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:39.303844 15768 raft_consensus.cc:697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:39.304850 15768 consensus_queue.cc:237] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.306324  8839 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:39.308331 15933 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:39.310393 15831 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:39.316682  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:39.317973  8843 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 21: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:39.264477  8661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51808 (request call id 147) took 3515 ms. Trace:
I20260709 13:18:39.345108 15810 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:18:39.345597  8839 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:39.347275 15791 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:39.331444  8661 rpcz_store.cc:276] 0709 13:18:35.721204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:35.723926 (+  2722us) service_pool.cc:224] Handling call
0709 13:18:36.184176 (+460250us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd04090 00007fce6fda2f3a 00007fce75b591cc 00007fce75c5737e 00007fce741182a4 00007fce74118232 00007fce74118161 00007fce741180dc 00007fce74117392 00007fce6e0d548c 00007fce6e0d48c6
0709 13:18:39.236555 (+3052379us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.658238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.713778 (+ 55540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.713818 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:18:38.713839 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:38.714201 (+   362us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.714287 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.714325 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:38.714516 (+   191us) tablet.cc:701] Row locks acquired
0709 13:18:38.714541 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:18:38.714701 (+   160us) write_op.cc:270] Start()
0709 13:18:38.714832 (+   131us) write_op.cc:276] Timestamp: P: 1783603118714642 usec, L: 0
0709 13:18:38.714857 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.715557 (+   700us) log.cc:844] Serialized 533 byte log entry
0709 13:18:38.914108 (+198551us) op_driver.cc:464] REPLICATION: finished
0709 13:18:39.168389 (+254281us) write_op.cc:301] APPLY: starting
0709 13:18:39.173822 (+  5433us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:39.226099 (+ 52277us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:39.226217 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.226977 (+   760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.227172 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:39.227219 (+    47us) write_op.cc:312] APPLY: finished
0709 13:18:39.227415 (+   196us) log.cc:844] Serialized 25 byte log entry
0709 13:18:39.227583 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.227650 (+    67us) write_op.cc:454] Released schema lock
0709 13:18:39.227692 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.228096 (+   404us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.228130 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1943103,"reported_tablets":1,"spinlock_wait_cycles":276601728,"child_traces":[["op",{"apply.queue_time_us":159305,"apply.run_cpu_time_us":3735,"apply.run_wall_time_us":67839,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":331078,"prepare.run_cpu_time_us":26715,"prepare.run_wall_time_us":255880,"raft.queue_time_us":49204,"raft.run_cpu_time_us":46569,"raft.run_wall_time_us":205409,"replication_time_us":194803,"spinlock_wait_cycles":1289600,"thread_start_us":551207,"threads_started":4,"wal-append.queue_time_us":153603}]]}
I20260709 13:18:39.371518  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.377660  8916 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:39.387502  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:39.388100 15525 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:39.389045 15525 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:39.388360  8912 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:39.393229  8836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:39.425199  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:39.426352  8665 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: term changed from 16 to 17, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.415699 15525 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:39.455509  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:39.456557  8665 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a reported cstate change: config changed from index -1 to 10, term changed from 15 to 16, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to <none>, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 16 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:39.460152 15846 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:39.479287  8663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 289) took 5898 ms. Trace:
I20260709 13:18:39.476658  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:39.441049 15933 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:18:39.493458  8765 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:39.505117 15330 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:39.479954 15846 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting leader election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:39.484545  8663 rpcz_store.cc:276] 0709 13:18:33.580523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.580645 (+   122us) service_pool.cc:224] Handling call
0709 13:18:39.479196 (+5898551us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.894084 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.919971 (+ 25887us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.920003 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:18:38.920022 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:38.920713 (+   691us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.920762 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.920831 (+    69us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:18:38.921408 (+   577us) tablet.cc:701] Row locks acquired
0709 13:18:38.921429 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:38.926595 (+  5166us) write_op.cc:270] Start()
0709 13:18:38.926805 (+   210us) write_op.cc:276] Timestamp: P: 1783603118921532 usec, L: 0
0709 13:18:38.926836 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.216721 (+289885us) log.cc:844] Serialized 2079 byte log entry
0709 13:18:39.240523 (+ 23802us) op_driver.cc:464] REPLICATION: finished
0709 13:18:39.242315 (+  1792us) write_op.cc:301] APPLY: starting
0709 13:18:39.242394 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:39.246052 (+  3658us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:39.246202 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.250062 (+  3860us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.250307 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:18:39.250376 (+    69us) write_op.cc:312] APPLY: finished
0709 13:18:39.250696 (+   320us) log.cc:844] Serialized 57 byte log entry
0709 13:18:39.251699 (+  1003us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.251850 (+   151us) write_op.cc:454] Released schema lock
0709 13:18:39.251915 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.312275 (+ 60360us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400168fd4. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd95e28 00007fce737d0581 00007fce737cfd58 00007fce737d49f1 00007fce737d49a9 00007fce737d4939 00007fce737d4901 00007fce737d3b2d 000000000038f354 000000000038f199
0709 13:18:39.312541 (+   266us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.312571 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":557953,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1571,"apply.run_cpu_time_us":8540,"apply.run_wall_time_us":9969,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":306791,"prepare.run_cpu_time_us":9463,"prepare.run_wall_time_us":429592,"replication_time_us":313361,"spinlock_wait_cycles":429539712}]]}
I20260709 13:18:39.541386  8914 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:39.534138 15846 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:39.521154 15410 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:18:39.539167  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:39.559600  8837 raft_consensus.cc:606] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:39.572357  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.559482 15784 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:39.559377 15516 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.601409 15946 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:18:39.626291  8661 catalog_manager.cc:5697] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:39.627768  8661 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 9 to 10, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 10 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:39.629485  8661 catalog_manager.cc:5697] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 19 to 20, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 20 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:39.630954  8661 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 16 to 17, leader changed from <none> to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:39.638192  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:39.643162 15945 log.cc:927] Time spent T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:39.645134  8841 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:39.646045  8841 raft_consensus.cc:606] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:39.650069  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 286) took 4992 ms. Trace:
I20260709 13:18:39.581688 15516 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.661413  8843 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:39.656599 15836 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:39.660553 15847 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.663767 15847 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.665985 15847 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:39.667481 15831 raft_consensus.cc:1064] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:18:39.677484  8761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.678156  8761 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:39.679683 15516 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:39.684343 15948 log.cc:927] Time spent T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:18:39.693301 15410 raft_consensus.cc:993] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:39.694005 15410 raft_consensus.cc:1081] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:39.650656  8665 rpcz_store.cc:276] 0709 13:18:34.657985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:34.658237 (+   252us) service_pool.cc:224] Handling call
0709 13:18:39.649996 (+4991759us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:39.485720 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:39.559276 (+ 73556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:39.561363 (+  2087us) write_op.cc:435] Acquired schema lock
0709 13:18:39.561384 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:39.595403 (+ 34019us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:39.598368 (+  2965us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:39.604996 (+  6628us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:39.605386 (+   390us) tablet.cc:701] Row locks acquired
0709 13:18:39.605402 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:18:39.605589 (+   187us) write_op.cc:270] Start()
0709 13:18:39.605729 (+   140us) write_op.cc:276] Timestamp: P: 1783603119605537 usec, L: 0
0709 13:18:39.605751 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.606487 (+   736us) log.cc:844] Serialized 946 byte log entry
0709 13:18:39.608451 (+  1964us) op_driver.cc:464] REPLICATION: finished
0709 13:18:39.609024 (+   573us) write_op.cc:301] APPLY: starting
0709 13:18:39.609124 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:39.610658 (+  1534us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:39.610766 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.612026 (+  1260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.612212 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:39.612257 (+    45us) write_op.cc:312] APPLY: finished
0709 13:18:39.612447 (+   190us) log.cc:844] Serialized 33 byte log entry
0709 13:18:39.612621 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.612726 (+   105us) write_op.cc:454] Released schema lock
0709 13:18:39.612765 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.613983 (+  1218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.614012 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":90757,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":4103,"apply.run_wall_time_us":4104,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":932,"prepare.run_cpu_time_us":4006,"prepare.run_wall_time_us":121088,"replication_time_us":2547}]]}
I20260709 13:18:39.706931  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:39.708783  8910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:39.709909  8762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:39.710525  8762 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.710881  8762 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:39.709637  8910 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:39.724560  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:39.731431  8843 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:39.737179 15908 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:39.737807 15908 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:39.754011 15847 raft_consensus.cc:993] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:39.754516 15847 raft_consensus.cc:1081] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:39.765758 15831 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:39.733348 15866 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:39.767908 15866 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.768415 15866 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:39.773247  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.791011  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:39.791730  8837 raft_consensus.cc:606] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:39.795830  8913 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:39.800460 15926 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:39.810128 15926 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.812278 15926 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:39.801020  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 49779.6us
I20260709 13:18:39.818089  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:39.819116  8918 raft_consensus.cc:2410] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:39.822518 15843 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:39.830287 15836 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:39.830535  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 81797us
I20260709 13:18:39.830914 15836 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.814136  8660 catalog_manager.cc:5697] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 16 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.833467 15836 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:39.835994  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:39.837059  8837 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
I20260709 13:18:39.834051  8660 catalog_manager.cc:5697] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:39.840277  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:39.841184 15486 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:39.841741 15486 raft_consensus.cc:493] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:39.842211 15486 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.809320  8914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:39.845407  8914 raft_consensus.cc:606] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:39.847398  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.852257 15486 raft_consensus.cc:515] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.856973  8660 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 16 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:39.861896 15908 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:39.862368  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:39.863168  8837 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.865860  8660 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 20 to 23, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 23 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.867538 15486 leader_election.cc:290] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:39.872455  8837 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:39.879904  8884 leader_election.cc:304] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:39.881003 15486 raft_consensus.cc:2804] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:39.881898 15486 raft_consensus.cc:697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:39.883565 15486 consensus_queue.cc:237] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.886287 15830 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:39.891841  8660 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:39.897383  8660 catalog_manager.cc:5697] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.901593  8837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
mode: GRACEFUL
new_leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:54856
I20260709 13:18:39.902447  8837 raft_consensus.cc:606] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Received request to transfer leadership to TS 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:39.903419  8660 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:39.905319  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:39.760207 15846 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:39.909053  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:39.910116 15846 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:39.910286  8660 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 11, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:39.913908  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:39.916697  8763 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 15.
W20260709 13:18:39.906142  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 89706.3us
I20260709 13:18:39.903466  8882 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:39.933728  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef624fe5958542fa8714cedf17ca4940" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:39.934785  8763 raft_consensus.cc:3060] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:39.950081  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:39.968740  8766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:39.971426  8766 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:39.972031  8766 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:39.970083  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:39.975204 15822 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:40.005681  8766 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:40.020740  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 285501us
I20260709 13:18:40.009531  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:39.995604 15917 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:40.008414  8761 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:40.037984  8766 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:40.040599 15330 raft_consensus.cc:993] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:40.042514  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:40.043253  8912 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.045321  8913 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:40.048030  8918 raft_consensus.cc:1275] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:40.058694  8762 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.070351 15960 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:40.078411  9468 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:40.081189 15866 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.091445  8916 raft_consensus.cc:1275] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:40.042496 15829 raft_consensus.cc:1081] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:40.093717  8762 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:40.103210  8912 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:40.104776  8763 raft_consensus.cc:2468] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 16.
I20260709 13:18:40.119153  8766 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60048
I20260709 13:18:40.120178  8766 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.120549  8766 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:40.119206  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 149383us
I20260709 13:18:40.129717  8766 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:40.108042 15794 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:40.165584  8766 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:40.166810  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:40.167526  9461 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.174451  8837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4128699de59a470a9275f001cbd35515" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:40.178267  9461 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:18:40.179684  8734 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 
I20260709 13:18:40.188671  8732 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:40.191244  8732 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:40.198587  8766 raft_consensus.cc:1240] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:40.201116 15956 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:40.193485 15919 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:40.201730 15956 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:40.202090 15919 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:40.202752 15956 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.202997 15919 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.189132 15928 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:40.205515 15928 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:40.206463 15928 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:40.215857  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:40.216516  8918 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.221684  8914 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:40.222535  8843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:40.223312  8843 raft_consensus.cc:2393] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in current term 21: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:40.223984 15873 consensus_queue.cc:1059] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:40.225069 15873 raft_consensus.cc:3055] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:40.225428 15873 raft_consensus.cc:740] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:40.226336 15873 consensus_queue.cc:260] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.229043 15873 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.235564  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:40.236222  8914 raft_consensus.cc:3055] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:40.236526  8914 raft_consensus.cc:740] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:40.237260  8914 consensus_queue.cc:260] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:40.238586  8914 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:40.241859  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:40.249967  8844 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:40.250341  8844 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:40.243773  8840 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:40.244745  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:40.255190  8763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:40.255895  8763 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:40.257550  8918 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:40.266938  8763 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:40.239643 15866 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:40.251184  8844 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.276147  8735 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:40.283859  8844 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:40.314102  8844 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 18.
I20260709 13:18:40.346022  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "191959ae05ea40fd8a7fb0e027de5b86" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:40.346661  8912 raft_consensus.cc:3060] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:40.356312  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49859.3us
I20260709 13:18:40.359614  8912 raft_consensus.cc:2468] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
W20260709 13:18:40.362164  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 54107us
I20260709 13:18:40.386011  8732 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:40.396276  8808 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:40.396656 15830 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:40.336117 15954 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:18:40.404599  8763 raft_consensus.cc:1240] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:40.411693  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 50023.1us
I20260709 13:18:40.405766 15804 raft_consensus.cc:2804] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:40.420961 15804 raft_consensus.cc:697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:40.421986 15804 consensus_queue.cc:237] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.388304 15768 consensus_queue.cc:1048] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:18:40.439306 15768 consensus_queue.cc:1048] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:40.440620  8914 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 11.
I20260709 13:18:40.447911 15830 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:40.452764 15830 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:40.453744  8765 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:40.471856 15807 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:18:40.485122  8842 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 17.
I20260709 13:18:40.482319 15846 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:40.573997  8842 raft_consensus.cc:1275] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:40.575469  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 178317us
I20260709 13:18:40.547360 15831 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:40.587946 15789 consensus_queue.cc:1048] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:18:40.625881 15986 raft_consensus.cc:993] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: : Instructing follower 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:40.626410 15986 raft_consensus.cc:1081] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Signalling peer 74de73c0f36d4c3aa7a483c7fdb39e4a to start an election
I20260709 13:18:40.643493 15886 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:40.710856  8665 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:40.713002  8665 catalog_manager.cc:5697] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.715087  8665 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:40.751252  8765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
 from {username='slave'} at 127.0.0.1:60042
I20260709 13:18:40.752130  8765 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.752590  8765 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:40.759155  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 176862us
I20260709 13:18:40.721481 15886 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:40.830977  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 89974us
W20260709 13:18:40.946682  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 191673us
W20260709 13:18:40.949762  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 77447.7us
W20260709 13:18:41.067366 15989 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 13:18:41.097586  9468 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:18:41.088263 15995 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.134s	user 0.000s	sys 0.002s
I20260709 13:18:41.105485 15991 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:41.151906  8765 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:41.165306 15810 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:41.166616 15810 tablet_bootstrap.cc:492] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:18:41.168020 15810 ts_tablet_manager.cc:1403] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 1.913s	user 0.036s	sys 0.032s
W20260709 13:18:41.173817 15996 log.cc:927] Time spent T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 13:18:41.181556 16000 log.cc:927] Time spent T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:18:41.188104 15886 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:41.221108  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 94798.3us
I20260709 13:18:41.232924  8914 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:41.246758  8844 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.248484  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:41.249241  8842 raft_consensus.cc:3055] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:41.249660  8842 raft_consensus.cc:740] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:41.256783  8841 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:41.257508  8842 consensus_queue.cc:260] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:41.258948  8842 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:41.261549  8917 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:18:41.260607  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 45662.3us
I20260709 13:18:41.269155  8914 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:41.271762  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:41.274663  8917 raft_consensus.cc:2410] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:41.278988  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:41.279868  8914 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:41.295210  8842 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:41.301676  8914 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74de73c0f36d4c3aa7a483c7fdb39e4a in term 21.
I20260709 13:18:41.285730 15810 raft_consensus.cc:359] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:40.948446  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:41.324604  8665 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 15 to 19, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 19 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:41.331668  8665 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 15 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:41.311717 15810 raft_consensus.cc:740] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:18:41.355633 15810 consensus_queue.cc:260] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:41.359421 15810 ts_tablet_manager.cc:1434] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.191s	user 0.006s	sys 0.003s
I20260709 13:18:41.338439  8660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40540 (request call id 238) took 2140 ms. Trace:
I20260709 13:18:41.337944  8665 catalog_manager.cc:5697] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:41.342110 16013 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:41.396147 16013 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:41.387001  8660 rpcz_store.cc:276] 0709 13:18:39.198000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.198413 (+   413us) service_pool.cc:224] Handling call
0709 13:18:41.338370 (+2139957us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:39.944714 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:40.022752 (+ 78038us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:40.025511 (+  2759us) write_op.cc:435] Acquired schema lock
0709 13:18:40.025541 (+    30us) tablet.cc:662] Decoding operations
0709 13:18:40.052055 (+ 26514us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:40.052111 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:40.052137 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:40.052732 (+   595us) tablet.cc:701] Row locks acquired
0709 13:18:40.052745 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:18:40.052919 (+   174us) write_op.cc:270] Start()
0709 13:18:40.053033 (+   114us) write_op.cc:276] Timestamp: P: 1783603120052850 usec, L: 0
0709 13:18:40.053051 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:18:40.117607 (+ 64556us) log.cc:844] Serialized 3291 byte log entry
0709 13:18:40.146467 (+ 28860us) op_driver.cc:464] REPLICATION: finished
0709 13:18:40.147392 (+   925us) write_op.cc:301] APPLY: starting
0709 13:18:40.147478 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:40.152396 (+  4918us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:40.152519 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:40.157546 (+  5027us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:40.157764 (+   218us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:18:40.157807 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:40.158060 (+   253us) log.cc:844] Serialized 81 byte log entry
0709 13:18:40.159440 (+  1380us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.159573 (+   133us) write_op.cc:454] Released schema lock
0709 13:18:40.159631 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:40.160163 (+   532us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:40.160201 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56922,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":646,"apply.run_cpu_time_us":11448,"apply.run_wall_time_us":12750,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33392,"num_ops":8,"prepare.queue_time_us":4481,"prepare.run_cpu_time_us":5016,"prepare.run_wall_time_us":185162,"replication_time_us":93280}]]}
I20260709 13:18:41.398921 16013 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:41.346864  8765 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:41.363505  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 53582.9us
W20260709 13:18:41.337491  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 65527.5us
I20260709 13:18:41.368024  8769 raft_consensus.cc:1240] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Rejecting Update request from peer 773340b2958e4af5b2010b902b9e9c04 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:41.401583  8842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:41.369012  8767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:41.403359  8735 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:41.403908 15635 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:41.404238 15794 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:41.369704  8764 raft_consensus.cc:1275] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:41.404803 15794 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Becoming Leader. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:41.405992 15794 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:41.401417 15985 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:41.437695  8917 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:41.382548 15992 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:41.474388  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-430f59d9e22342829896b185b2da7cf3 received from {username='slave'} at 127.0.0.1:36492
I20260709 13:18:41.475140  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-430f59d9e22342829896b185b2da7cf3 on tablet 430f59d9e22342829896b185b2da7cf3 with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:18:41.483705  8837 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:41.461912  9461 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:41.495757  8839 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:41.509848  8914 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:41.531140  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:41.541090 15954 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:41.549950 15985 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:41.545637 15990 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:41.512255 15768 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:18:41.613401 15843 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:41.614818  8766 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bccdb4728c764cc0a333f593ab71c511" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:41.574363 15955 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 13:18:41.629866  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 48953.3us
W20260709 13:18:41.638140 16033 log.cc:927] Time spent T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:41.589314 15983 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
W20260709 13:18:41.629999 15997 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:18:41.576351 16014 consensus_queue.cc:1048] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:18:41.702284 15989 log.cc:927] Time spent T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
W20260709 13:18:41.706439 16039 log.cc:927] Time spent T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
I20260709 13:18:41.718549  8911 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 10 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:41.815634  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:41.858139  8915 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:41.837329 16013 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:41.908221 16019 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:18:41.978624  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 160812us
I20260709 13:18:41.988035  8839 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:42.001933 16024 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:18:42.064354 16049 log.cc:927] Time spent T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:18:42.142925  8734 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 161907us
I20260709 13:18:42.231755  9466 raft_consensus.cc:1217] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 13:18:42.270323  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 55985us
I20260709 13:18:42.274214 15768 raft_consensus.cc:1064] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:18:42.275219 15486 raft_consensus.cc:493] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:42.275787 15486 raft_consensus.cc:515] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:42.278258 15486 leader_election.cc:290] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:42.276794 15768 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:42.282415  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:42.348265  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "405e426995614183bb2a212fc38e04b0" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" is_pre_election: true
I20260709 13:18:42.350699  8660 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 11, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 11 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.355063  8660 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 10 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } attrs { replace: true } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.377188  8665 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40536 (request call id 290) took 2421 ms. Trace:
I20260709 13:18:42.386709  8665 rpcz_store.cc:276] 0709 13:18:39.955989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:39.956129 (+   140us) service_pool.cc:224] Handling call
0709 13:18:42.377117 (+2420988us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:41.537580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:41.538148 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:41.538181 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:18:41.538200 (+    19us) tablet.cc:662] Decoding operations
0709 13:18:41.538974 (+   774us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:41.539054 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:41.539094 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:41.539713 (+   619us) tablet.cc:701] Row locks acquired
0709 13:18:41.539742 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:18:41.539885 (+   143us) write_op.cc:270] Start()
0709 13:18:41.540015 (+   130us) write_op.cc:276] Timestamp: P: 1783603121539834 usec, L: 0
0709 13:18:41.540045 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:18:41.540686 (+   641us) log.cc:844] Serialized 2464 byte log entry
0709 13:18:41.609965 (+ 69279us) op_driver.cc:464] REPLICATION: finished
0709 13:18:41.840082 (+230117us) write_op.cc:301] APPLY: starting
0709 13:18:41.868984 (+ 28902us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:41.927920 (+ 58936us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:41.928077 (+   157us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:42.078082 (+150005us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:42.078387 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:18:42.078461 (+    74us) write_op.cc:312] APPLY: finished
0709 13:18:42.078873 (+   412us) log.cc:844] Serialized 65 byte log entry
0709 13:18:42.079102 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.079254 (+   152us) write_op.cc:454] Released schema lock
0709 13:18:42.079323 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:42.079813 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:42.079851 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1004233,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":203979,"apply.run_cpu_time_us":14548,"apply.run_wall_time_us":263124,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":65816,"prepare.run_cpu_time_us":12362,"prepare.run_wall_time_us":50220,"raft.queue_time_us":43493,"raft.run_cpu_time_us":5091,"raft.run_wall_time_us":66998,"replication_time_us":69707,"spinlock_wait_cycles":12672,"thread_start_us":169529,"threads_started":4,"wal-append.queue_time_us":23298}]]}
I20260709 13:18:42.412146  9468 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:42.420902  8916 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:42.423283 15866 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:42.425300 15410 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:42.407312  8882 leader_election.cc:304] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:42.430611  8769 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:42.445818 15410 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:42.456300 15917 raft_consensus.cc:2749] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:42.455497  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 48322.8us
I20260709 13:18:42.532891 15768 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.536368  8663 catalog_manager.cc:5697] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 13 to 16, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 16 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.538301  8663 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 19 to 22, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 22 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:42.543934  9461 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.546641  8916 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:18:42.573171  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45615.9us
I20260709 13:18:42.608696  8665 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 11 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.637179  8660 catalog_manager.cc:5697] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 17 to 20, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.642447  8660 catalog_manager.cc:5697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:42.643937  8660 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:42.646786  8660 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 18 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:42.651369  8769 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.648520  8660 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 20 to 21, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65). New cstate: current_term: 21 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } }
I20260709 13:18:42.840785  8661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:40530 (request call id 287) took 2239 ms. Trace:
I20260709 13:18:42.841200  8661 rpcz_store.cc:276] 0709 13:18:40.601822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:40.601970 (+   148us) service_pool.cc:224] Handling call
0709 13:18:42.840714 (+2238744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109107,"reported_tablets":18}
I20260709 13:18:42.885982  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:42.931658  8837 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:42.943178  9468 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:42.945747 15866 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:42.952888  8917 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:42.962605 15866 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:42.965535 15768 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.973132  8917 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:42.975255  9461 raft_consensus.cc:2955] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:43.009918  8660 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 12 to 13, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:43.037160  8750 tablet_service.cc:1558] Processing DeleteTablet for tablet 430f59d9e22342829896b185b2da7cf3 with delete_type TABLET_DATA_TOMBSTONED (TS 74de73c0f36d4c3aa7a483c7fdb39e4a not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60040
I20260709 13:18:43.050009  8764 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.056919  8769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "011917cac276499ba01c77d911c67d8d"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:43.056973  8917 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:43.057575  8769 raft_consensus.cc:606] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:43.058549  9461 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 74de73c0f36d4c3aa7a483c7fdb39e4a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:43.059820 15919 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:43.061007 16012 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:43.062650  8917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:33996
I20260709 13:18:43.063275  8917 raft_consensus.cc:606] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:43.067435  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:43.068050  8765 raft_consensus.cc:606] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:43.069082 16072 tablet_replica.cc:333] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:43.070313 16072 raft_consensus.cc:2243] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:43.071043  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:43.071681  8765 raft_consensus.cc:606] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:43.074301  8654 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 430f59d9e22342829896b185b2da7cf3 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:43.081156  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:43.081828  8765 raft_consensus.cc:606] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:43.100824  8765 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b"
dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
mode: GRACEFUL
new_leader_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:51968
I20260709 13:18:43.101617  8765 raft_consensus.cc:606] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Received request to transfer leadership to TS 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:43.089130 16072 raft_consensus.cc:2272] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:43.105177  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:43.107151  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:43.125149 15919 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:43.134302  9461 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:43.183961  8661 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 12 to 13, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New cstate: current_term: 17 leader_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:43.194945 16072 ts_tablet_manager.cc:1916] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:43.206967  8833 tablet_service.cc:1558] Processing DeleteTablet for tablet e3373a354d754ec48ac0cc05829af66f with delete_type TABLET_DATA_TOMBSTONED (TS 773340b2958e4af5b2010b902b9e9c04 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:55342
I20260709 13:18:43.215260 15831 raft_consensus.cc:993] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.215834 16019 raft_consensus.cc:1081] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.217300  8918 raft_consensus.cc:2955] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:43.221292  8652 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3373a354d754ec48ac0cc05829af66f with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:43.221199  8844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:43.222039  8844 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.222409  8844 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:43.235711  8844 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.240059  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:43.240664  8765 raft_consensus.cc:3055] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:43.240986  8765 raft_consensus.cc:740] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:43.241727  8765 consensus_queue.cc:260] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.242995  8765 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:43.258600  8844 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:43.258857  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76badded6ebe4972ad520c819a7fc3ae" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:43.259948  8912 raft_consensus.cc:3060] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:43.263957  8765 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:43.265264  8808 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:43.267903 15768 raft_consensus.cc:2804] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:43.268432 15768 raft_consensus.cc:697] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:43.269294 15768 consensus_queue.cc:237] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.275952  8912 raft_consensus.cc:2468] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 15.
I20260709 13:18:43.288012 16075 tablet_replica.cc:333] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:43.299474 15919 raft_consensus.cc:993] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.300052 15635 raft_consensus.cc:1081] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.301712  8844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "672045bd655a4cbea707258aa0718564"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:43.302404  8844 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.302737  8844 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.305367 16075 raft_consensus.cc:2243] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:43.300805 16072 ts_tablet_manager.cc:1929] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:18:43.306116 16072 log.cc:1199] T 430f59d9e22342829896b185b2da7cf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/wals/430f59d9e22342829896b185b2da7cf3
I20260709 13:18:43.306510 16075 raft_consensus.cc:2272] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:43.311734  8652 catalog_manager.cc:5028] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): tablet 430f59d9e22342829896b185b2da7cf3 (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:18:43.342435  8661 catalog_manager.cc:5697] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 14 to 15, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 15 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.366628 16075 ts_tablet_manager.cc:1916] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:43.327852  8844 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.387280  8844 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:43.388245  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:43.388883  8764 raft_consensus.cc:3055] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:43.389189  8764 raft_consensus.cc:740] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:43.389861  8764 consensus_queue.cc:260] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.390682  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "672045bd655a4cbea707258aa0718564" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:43.390914  8764 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.391291  8918 raft_consensus.cc:3060] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:43.400949 16019 raft_consensus.cc:993] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.401551 16019 raft_consensus.cc:1081] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.408330  8918 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:43.411327  8838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:43.411962  8838 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.412427  8838 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.411877  8807 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:43.412909  8764 raft_consensus.cc:2468] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 19.
I20260709 13:18:43.418493 15847 raft_consensus.cc:2804] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:43.419328 15847 raft_consensus.cc:697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:43.424074  8838 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.458069  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:43.460547  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:43.472162  8765 raft_consensus.cc:3055] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:43.472476  8765 raft_consensus.cc:740] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:43.473131  8765 consensus_queue.cc:260] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.475113 15917 raft_consensus.cc:993] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.475203  8765 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.475914 15486 raft_consensus.cc:1081] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.477484  8837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40104
I20260709 13:18:43.478044  8837 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.478446  8837 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.486037  8837 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.494872  8765 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:43.495105  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:43.496018  8918 raft_consensus.cc:3055] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:43.496347  8918 raft_consensus.cc:740] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:43.497095  8918 consensus_queue.cc:260] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.497869 15919 raft_consensus.cc:993] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.498307  8918 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.498458 15919 raft_consensus.cc:1081] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.500528  8844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "011917cac276499ba01c77d911c67d8d"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:43.501150  8844 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.501542  8844 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.505950  9468 raft_consensus.cc:3060] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.512948  8808 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:43.513958 15768 raft_consensus.cc:2804] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:43.514467 15768 raft_consensus.cc:697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:43.515383 15768 consensus_queue.cc:237] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.523801 16024 raft_consensus.cc:993] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: : Instructing follower 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.524335 16024 raft_consensus.cc:1081] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Signalling peer 773340b2958e4af5b2010b902b9e9c04 to start an election
I20260709 13:18:43.527921  8841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b"
dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
 from {username='slave'} at 127.0.0.1:40100
I20260709 13:18:43.528416  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:43.529215  9461 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:43.527417  8837 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:43.528472  8841 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.533401  8841 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:43.534919  8844 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.538161  8844 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:43.420313 15847 consensus_queue.cc:237] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.539145  8765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:43.542719  8765 raft_consensus.cc:3055] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:43.543063  8765 raft_consensus.cc:740] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:43.543885  8765 consensus_queue.cc:260] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.545125  8765 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.546203  8841 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.548164  8841 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:43.468884  8838 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:43.549455  8764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a"
I20260709 13:18:43.550086  8764 raft_consensus.cc:3055] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:43.550383  8764 raft_consensus.cc:740] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 74de73c0f36d4c3aa7a483c7fdb39e4a, State: Running, Role: LEADER
I20260709 13:18:43.551052  8764 consensus_queue.cc:260] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.552225  8764 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:43.553395 16075 ts_tablet_manager.cc:1929] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:18:43.553859 16075 log.cc:1199] T e3373a354d754ec48ac0cc05829af66f P 773340b2958e4af5b2010b902b9e9c04: Deleting WAL directory at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/wals/e3373a354d754ec48ac0cc05829af66f
I20260709 13:18:43.556617  9461 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:43.557374  8654 catalog_manager.cc:5028] TS 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): tablet e3373a354d754ec48ac0cc05829af66f (table test-workload [id=a1cdac957b3743c5b70c4686042fbd14]) successfully deleted
I20260709 13:18:43.558255  8809 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:43.559031 15847 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:43.559880 15847 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:43.560792 15847 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:43.562989  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "011917cac276499ba01c77d911c67d8d" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:43.563587  8912 raft_consensus.cc:3060] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:43.566852  8917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbb9c9a8b7c641fb839da3aa2a309c0b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:43.567489  8917 raft_consensus.cc:3060] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:43.572137  8661 catalog_manager.cc:5697] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 19 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.575443  8917 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 23.
I20260709 13:18:43.577354  8807 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:43.578102 15768 raft_consensus.cc:2804] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:43.578574 15768 raft_consensus.cc:697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 23 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:43.579474 15768 consensus_queue.cc:237] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.582823  8912 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:43.589478  8918 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:43.589849  8807 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:43.590593 15410 raft_consensus.cc:2804] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:43.591053 15410 raft_consensus.cc:697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:43.591807 15410 consensus_queue.cc:237] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:43.592077  8765 raft_consensus.cc:2468] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 20.
I20260709 13:18:43.599563  8764 raft_consensus.cc:2468] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 23.
I20260709 13:18:43.639285  9468 raft_consensus.cc:2468] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:43.663837  8661 catalog_manager.cc:5697] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.665843  8661 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from bdb96be202c2447586477b2077b7d5bf (127.7.122.67) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.675890  8661 catalog_manager.cc:5697] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 22 to 23, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 23 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.711035  8918 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:43.714481 15410 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:43.797876  8661 catalog_manager.cc:5697] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 19 to 20, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.813344  8765 raft_consensus.cc:1275] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:43.821249 15410 consensus_queue.cc:1048] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:43.955437  8764 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:18:43.957202 15847 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:43.969444  8912 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:43.972052 15866 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:43.983109  9468 raft_consensus.cc:1275] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:18:44.055259  8809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 69522us
I20260709 13:18:44.055601 15410 consensus_queue.cc:1048] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:44.127588  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:44.134697  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 81413us
I20260709 13:18:44.144222  9461 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:44.149446 15866 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:44.256151  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49877.2us
W20260709 13:18:44.257786  8732 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 59929.3us
W20260709 13:18:44.297353 16091 log.cc:927] Time spent T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:18:44.321868  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 71124.8us
W20260709 13:18:44.372828  8735 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 93583.9us
I20260709 13:18:44.381158  8762 raft_consensus.cc:1275] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:44.389394  8764 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:18:44.390322  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 109586us
I20260709 13:18:44.391089  8769 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:44.446985  8916 raft_consensus.cc:1275] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:44.484984  8916 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:44.487236 16104 consensus_queue.cc:1048] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:44.489825 15768 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:44.491917 15768 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:44.497753 15866 consensus_queue.cc:1048] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:44.507437  8912 raft_consensus.cc:1275] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:44.535137 16092 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:18:44.537073 15866 consensus_queue.cc:1048] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:44.809504 16114 log.cc:927] Time spent T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 4
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:18:44.972566  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
I20260709 13:18:44.998383  8836 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
W20260709 13:18:45.006950  8882 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:45.021425  8882 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.029036  8914 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:18:45.035686  8809 consensus_peers.cc:597] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 002c4018f5264a23a9d3f93713b6fffe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.040714 15768 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:45.056438  8882 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.087322  8882 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.105306  8882 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.179363  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 79322.1us
W20260709 13:18:45.192370  9432 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.204483  9432 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.179831 15866 raft_consensus.cc:2955] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:45.189848  8914 raft_consensus.cc:2955] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index -1 to 12, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:18:45.219898  9432 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.221503  8808 consensus_peers.cc:597] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.222060  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 57725.9us
W20260709 13:18:45.221131  8882 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.228214  8882 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.241422  8882 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.243738  8882 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.270466  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.271431  8808 consensus_peers.cc:597] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.275316  9432 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.275228  8808 consensus_peers.cc:597] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.286196  8808 consensus_peers.cc:597] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.291131  8665 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf reported cstate change: config changed from index -1 to 12, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
W20260709 13:18:45.302095  8808 consensus_peers.cc:597] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.313100  8882 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.331879  8882 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.337283  8882 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.341480  8808 consensus_peers.cc:597] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.344657  8808 consensus_peers.cc:597] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.345357  8808 consensus_peers.cc:597] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.359516  9432 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.381215  8882 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.385615  8882 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.391409  8808 consensus_peers.cc:597] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.399511  9432 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:45.400507  8808 consensus_peers.cc:597] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.403757  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:18:45.404955  8808 consensus_peers.cc:597] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.406168  7657 tablet_replica.cc:333] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.412971  7657 raft_consensus.cc:2243] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:45.414148  8808 consensus_peers.cc:597] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.414220  7657 raft_consensus.cc:2272] T 9d82cf960a5f4fb4acb573fe580b10ed P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.422031  7657 tablet_replica.cc:333] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.428881  7657 raft_consensus.cc:2243] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.431191  7657 raft_consensus.cc:2272] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.438634  7657 tablet_replica.cc:333] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
W20260709 13:18:45.439316  8808 consensus_peers.cc:597] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.439867  7657 raft_consensus.cc:2243] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.441665  7657 raft_consensus.cc:2272] T f095ec4c4cb343308d8bd14544fe8b4e P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.446564  7657 tablet_replica.cc:333] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.449323  7657 raft_consensus.cc:2243] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.451262  7657 raft_consensus.cc:2272] T 2e090a13858f439f934f3a0277b08f18 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:45.452631  8715 auto_rebalancer.cc:629] Failed to schedule move for tablet af46285a3b87458b8b247dc8610ab80b: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:18:45.458441  8715 auto_rebalancer.cc:629] Failed to schedule move for tablet b3f50214a4c94ba0b85876c02e10b9ac: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:45.464929  8912 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:45.478138  7657 tablet_replica.cc:333] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.479132  7657 raft_consensus.cc:2243] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.480266  7657 raft_consensus.cc:2272] T b0cebd36d7c3434a9e438125a626bf29 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.493146  8838 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:18:45.494740  8883 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973): Couldn't send request to peer 3b34c95a175945b88b17f07fbc650abf. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 022d4a4680cb42e4bc9970d8a4f604f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.496253 16095 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:18:45.497646  8882 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:45.498435  7657 tablet_replica.cc:333] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.504601  7657 raft_consensus.cc:2243] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.505894  7657 raft_consensus.cc:2272] T c6f1fe9f34b9476fb981c06a43a1fb1d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.511075  7657 tablet_replica.cc:333] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.512089  7657 raft_consensus.cc:2243] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.518025 15486 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:45.519527  7657 raft_consensus.cc:2272] T 9bd2a06b32904b5db18230a954b8d7fe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.524698  8838 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Committing config change with OpId 23.15: config changed from index -1 to 15, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:45.569954  7657 tablet_replica.cc:333] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.589246  7657 raft_consensus.cc:2243] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.597823  8661 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index -1 to 15, NON_VOTER 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) added. New cstate: current_term: 23 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } } }
I20260709 13:18:45.606742  7657 raft_consensus.cc:2272] T 405e426995614183bb2a212fc38e04b0 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.611203  7657 tablet_replica.cc:333] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.613634  7657 raft_consensus.cc:2243] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.614332  7657 raft_consensus.cc:2272] T 589fb2d6cab941e09bb87a5254bc9d48 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.637019 16133 ts_tablet_manager.cc:933] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:45.640044  7657 tablet_replica.cc:333] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.641032  7657 raft_consensus.cc:2243] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.661146 16133 tablet_copy_client.cc:323] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.66:32843
I20260709 13:18:45.665606  8854 tablet_copy_service.cc:140] P 773340b2958e4af5b2010b902b9e9c04: Received BeginTabletCopySession request for tablet 002c4018f5264a23a9d3f93713b6fffe from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:36492)
I20260709 13:18:45.666388  8854 tablet_copy_service.cc:161] P 773340b2958e4af5b2010b902b9e9c04: Beginning new tablet copy session on tablet 002c4018f5264a23a9d3f93713b6fffe from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:36492: session id = 3b34c95a175945b88b17f07fbc650abf-002c4018f5264a23a9d3f93713b6fffe
I20260709 13:18:45.675354  7657 raft_consensus.cc:2272] T 968e06ae5d2744aeb0b947873b369af8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.681042  7657 tablet_replica.cc:333] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.681962  7657 raft_consensus.cc:2243] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.682575  7657 raft_consensus.cc:2272] T 011917cac276499ba01c77d911c67d8d P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.692230  7657 tablet_replica.cc:333] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.694572  7657 raft_consensus.cc:2243] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.695196  7657 raft_consensus.cc:2272] T cbb9c9a8b7c641fb839da3aa2a309c0b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.710969  8854 tablet_copy_source_session.cc:215] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:45.727337 16133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002c4018f5264a23a9d3f93713b6fffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:45.728078  7657 tablet_replica.cc:333] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.729058  7657 raft_consensus.cc:2243] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.729637  7657 raft_consensus.cc:2272] T 282538f07daf4dcdb59352e756a62ba8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.748664  7657 tablet_replica.cc:333] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.749599  7657 raft_consensus.cc:2243] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.750614  7657 raft_consensus.cc:2272] T 9f42b63da74d4bcf8db95f4956d8d75c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.773748  7657 tablet_replica.cc:333] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.774582  7657 raft_consensus.cc:2243] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.775414  7657 raft_consensus.cc:2272] T f2fb7e71822c4226a7ee8579013bfe9f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.786512  7657 tablet_replica.cc:333] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.787406  7657 raft_consensus.cc:2243] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.788177  7657 raft_consensus.cc:2272] T 191959ae05ea40fd8a7fb0e027de5b86 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.790937  7657 tablet_replica.cc:333] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.809427  7657 raft_consensus.cc:2243] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.821533 16133 tablet_copy_client.cc:806] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:45.822290 16133 tablet_copy_client.cc:670] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:45.825201  7657 raft_consensus.cc:2272] T 2da23dcb2ee347e7a43e2150a082fe62 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.828528  7657 tablet_replica.cc:333] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.829749  7657 raft_consensus.cc:2243] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.830350  7657 raft_consensus.cc:2272] T 672045bd655a4cbea707258aa0718564 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.831866 16133 tablet_copy_client.cc:538] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:45.843228  7657 tablet_replica.cc:333] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.844185  7657 raft_consensus.cc:2243] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.844781  7657 raft_consensus.cc:2272] T 512bfb8ae84244418d0107564d88e5bb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.848027  7657 tablet_replica.cc:333] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.856905  7657 raft_consensus.cc:2243] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.857569  7657 raft_consensus.cc:2272] T 019a0cde8c994b9a83ff212e5c02437c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.860366  7657 tablet_replica.cc:333] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.861217  7657 raft_consensus.cc:2243] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.885851  7657 raft_consensus.cc:2272] T 102be8dba78c4bc998ed8bf52775bec5 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.888903  7657 tablet_replica.cc:333] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.889716  7657 raft_consensus.cc:2243] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.890542  7657 raft_consensus.cc:2272] T fb4847af9abd4172bff3a603da47325c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.897428  7657 tablet_replica.cc:333] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.881369 16133 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:18:45.898236  7657 raft_consensus.cc:2243] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.899544  7657 raft_consensus.cc:2272] T 2a15a66fec474b05b1f3ad99f61f1104 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.902731  7657 tablet_replica.cc:333] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.903843  7657 raft_consensus.cc:2243] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.916950  7657 raft_consensus.cc:2272] T af46285a3b87458b8b247dc8610ab80b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.922989  7657 tablet_replica.cc:333] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.926849  7657 raft_consensus.cc:2243] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.927528  7657 raft_consensus.cc:2272] T 76badded6ebe4972ad520c819a7fc3ae P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.938639  7657 tablet_replica.cc:333] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.940727  7657 raft_consensus.cc:2243] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:45.952412  7657 raft_consensus.cc:2272] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.956099  7657 tablet_replica.cc:333] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.957494  7657 raft_consensus.cc:2243] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.958683  7657 raft_consensus.cc:2272] T 5380dc645e984447aefd4408bca2f2af P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.961786  7657 tablet_replica.cc:333] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.967089  7657 raft_consensus.cc:2243] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:45.968050  7657 raft_consensus.cc:2272] T 94e939be989f4d59b1983955951ab90f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:45.977839 16137 ts_tablet_manager.cc:933] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: Initiating tablet copy from peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:45.982453  7657 tablet_replica.cc:333] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:45.983623  7657 raft_consensus.cc:2243] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.017189  7657 raft_consensus.cc:2272] T ba1bacaaff25445c9eccef8932f745d1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.020028  7657 tablet_replica.cc:333] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.028087  7657 raft_consensus.cc:2243] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.029202  7657 raft_consensus.cc:2272] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.033896  7657 tablet_replica.cc:333] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.034674  7657 raft_consensus.cc:2243] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.035483  7657 raft_consensus.cc:2272] T 7689b80937134444a5933a16f9aa7d64 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.039032 16137 tablet_copy_client.cc:323] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Beginning tablet copy session from remote peer at address 127.7.122.67:39883
I20260709 13:18:46.043015  8928 tablet_copy_service.cc:140] P bdb96be202c2447586477b2077b7d5bf: Received BeginTabletCopySession request for tablet 022d4a4680cb42e4bc9970d8a4f604f1 from peer 3b34c95a175945b88b17f07fbc650abf ({username='slave'} at 127.0.0.1:35822)
I20260709 13:18:46.043708  8928 tablet_copy_service.cc:161] P bdb96be202c2447586477b2077b7d5bf: Beginning new tablet copy session on tablet 022d4a4680cb42e4bc9970d8a4f604f1 from peer 3b34c95a175945b88b17f07fbc650abf at {username='slave'} at 127.0.0.1:35822: session id = 3b34c95a175945b88b17f07fbc650abf-022d4a4680cb42e4bc9970d8a4f604f1
I20260709 13:18:46.054136  7657 tablet_replica.cc:333] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.056614  7657 raft_consensus.cc:2243] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.078970 16089 raft_consensus.cc:493] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:46.079677 16089 raft_consensus.cc:515] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.086388  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.091006 16089 leader_election.cc:290] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:46.092403  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a034d186214a4f03b519e7c03f58788f" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:46.094478  8732 leader_election.cc:304] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:46.095281 16098 raft_consensus.cc:2749] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:46.096467  7657 raft_consensus.cc:2272] T ef624fe5958542fa8714cedf17ca4940 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.100652  7657 tablet_replica.cc:333] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.102571  7657 raft_consensus.cc:2243] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.103538  7657 raft_consensus.cc:2272] T 4128699de59a470a9275f001cbd35515 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.105993  8928 tablet_copy_source_session.cc:215] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:46.108237  7657 tablet_replica.cc:333] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.109205  7657 raft_consensus.cc:2243] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.113018  7657 raft_consensus.cc:2272] T c79353780ac54a25bd9999800873bbeb P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.116185  7657 tablet_replica.cc:333] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.117057  7657 raft_consensus.cc:2243] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.118297 16098 raft_consensus.cc:493] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:18:46.119027 16137 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022d4a4680cb42e4bc9970d8a4f604f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:46.118837 16098 raft_consensus.cc:515] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.127028 16098 leader_election.cc:290] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:46.127719  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:46.128782  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8447f76afbaa45b385add1219d08771c" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.130586  8735 leader_election.cc:304] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:46.131811 16098 raft_consensus.cc:2749] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:46.157239  7657 raft_consensus.cc:2272] T a034d186214a4f03b519e7c03f58788f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.162379 16133 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.164690  7657 tablet_replica.cc:333] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.164338 16133 tablet_bootstrap.cc:492] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:18:46.169824 16133 ts_tablet_manager.cc:1403] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.289s	user 0.040s	sys 0.044s
I20260709 13:18:46.171692 16098 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:46.172227 16098 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:46.174530 16098 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:46.176471  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.177174  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c65b41257e7e4b66b28805964b4e7d16" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:46.179641  8734 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:46.181063 16098 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.171130  7657 raft_consensus.cc:2243] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.205530  7657 raft_consensus.cc:2272] T a85c28eb5f2e4741b40ca8723a62f870 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.210469  7657 tablet_replica.cc:333] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.211199 16133 raft_consensus.cc:359] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:46.211627 16137 tablet_copy_client.cc:806] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:46.220659 16133 raft_consensus.cc:740] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:18:46.220963 16137 tablet_copy_client.cc:670] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:46.222746 16133 consensus_queue.cc:260] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:46.233296 16133 ts_tablet_manager.cc:1434] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 13:18:46.226962 16137 tablet_copy_client.cc:538] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:46.228562 16098 raft_consensus.cc:493] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3b34c95a175945b88b17f07fbc650abf)
I20260709 13:18:46.236513 16098 raft_consensus.cc:515] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:46.238739 16098 leader_election.cc:290] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:46.240563  8854 tablet_copy_service.cc:342] P 773340b2958e4af5b2010b902b9e9c04: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-002c4018f5264a23a9d3f93713b6fffe received from {username='slave'} at 127.0.0.1:36492
I20260709 13:18:46.241000  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:46.241346  8854 tablet_copy_service.cc:434] P 773340b2958e4af5b2010b902b9e9c04: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-002c4018f5264a23a9d3f93713b6fffe on tablet 002c4018f5264a23a9d3f93713b6fffe with peer 3b34c95a175945b88b17f07fbc650abf
I20260709 13:18:46.242708  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a7db9f466c48ccb2c5c350cb6351b3" candidate_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:46.223973  7657 raft_consensus.cc:2243] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.244182  8734 leader_election.cc:304] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 74de73c0f36d4c3aa7a483c7fdb39e4a; no voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:46.245380 16098 raft_consensus.cc:2749] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.246598  7657 raft_consensus.cc:2272] T c4b840458e6048cd9c4444bf516cf39a P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.249819  7657 tablet_replica.cc:333] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.250769  7657 raft_consensus.cc:2243] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.251803  7657 raft_consensus.cc:2272] T b3f50214a4c94ba0b85876c02e10b9ac P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.254487  7657 tablet_replica.cc:333] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.255241  7657 raft_consensus.cc:2243] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.255847  7657 raft_consensus.cc:2272] T 002c4018f5264a23a9d3f93713b6fffe P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.256031 16137 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap starting.
I20260709 13:18:46.279513  7657 tablet_replica.cc:333] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.280442  7657 raft_consensus.cc:2243] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.281311  7657 raft_consensus.cc:2272] T 8447f76afbaa45b385add1219d08771c P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.285926  7657 tablet_replica.cc:333] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.286753  7657 raft_consensus.cc:2243] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.287861  7657 raft_consensus.cc:2272] T bac07da6a99849fb8f972372c187ee7b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.290715  7657 tablet_replica.cc:333] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.291528  7657 raft_consensus.cc:2243] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.292379  7657 raft_consensus.cc:2272] T 49a7db9f466c48ccb2c5c350cb6351b3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.298792  7657 tablet_replica.cc:333] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.299657  7657 raft_consensus.cc:2243] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.301205  7657 raft_consensus.cc:2272] T e3373a354d754ec48ac0cc05829af66f P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.304287  7657 tablet_replica.cc:333] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.305078  7657 raft_consensus.cc:2243] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.306397  7657 raft_consensus.cc:2272] T 6e56e66e882c455cb86d4e08fd5555d2 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.309202  7657 tablet_replica.cc:333] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.309928  7657 raft_consensus.cc:2243] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.310547  7657 raft_consensus.cc:2272] T c65b41257e7e4b66b28805964b4e7d16 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.313164  7657 tablet_replica.cc:333] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.313961  7657 raft_consensus.cc:2243] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.315299  7657 raft_consensus.cc:2272] T 2c71888f7c2e471db00d7e83cf31ebf3 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.318398  7657 tablet_replica.cc:333] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.319191  7657 raft_consensus.cc:2243] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:18:46.320370  7657 raft_consensus.cc:2272] T e3a106d574bc4cfeaa6e7b1240430c4b P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.341876  7657 tablet_replica.cc:333] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.342921  7657 raft_consensus.cc:2243] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.355527  7657 raft_consensus.cc:2272] T bccdb4728c764cc0a333f593ab71c511 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.371304  7657 tablet_replica.cc:333] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.372170  7657 raft_consensus.cc:2243] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.382292  9466 raft_consensus.cc:1217] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 LEARNER]: Deduplicated request from leader. Original: 20.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:18:46.386770  7657 raft_consensus.cc:2272] T e8a8035ad96048ea978033b357465875 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.390295  7657 tablet_replica.cc:333] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.391058  7657 raft_consensus.cc:2243] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.391673  7657 raft_consensus.cc:2272] T aa48bba2a08c4fcdae35a029b7107f70 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.401196  7657 tablet_replica.cc:333] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a: stopping tablet replica
I20260709 13:18:46.401948  7657 raft_consensus.cc:2243] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:46.402623  7657 raft_consensus.cc:2272] T 022d4a4680cb42e4bc9970d8a4f604f1 P 74de73c0f36d4c3aa7a483c7fdb39e4a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:46.479887 16137 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:46.501140 16137 tablet_bootstrap.cc:492] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: Bootstrap complete.
I20260709 13:18:46.501983 16137 ts_tablet_manager.cc:1403] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: Time spent bootstrapping tablet: real 0.246s	user 0.053s	sys 0.011s
I20260709 13:18:46.507040 16137 raft_consensus.cc:359] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:46.507932 16137 raft_consensus.cc:740] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Initialized, Role: LEARNER
I20260709 13:18:46.508653 16137 consensus_queue.cc:260] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: NON_VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: true } }
I20260709 13:18:46.511392 16137 ts_tablet_manager.cc:1434] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:18:46.533481 16095 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.534085 16095 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.536224 16095 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:46.538543  8928 tablet_copy_service.cc:342] P bdb96be202c2447586477b2077b7d5bf: Request end of tablet copy session 3b34c95a175945b88b17f07fbc650abf-022d4a4680cb42e4bc9970d8a4f604f1 received from {username='slave'} at 127.0.0.1:35822
I20260709 13:18:46.539129  8928 tablet_copy_service.cc:434] P bdb96be202c2447586477b2077b7d5bf: ending tablet copy session 3b34c95a175945b88b17f07fbc650abf-022d4a4680cb42e4bc9970d8a4f604f1 on tablet 022d4a4680cb42e4bc9970d8a4f604f1 with peer 3b34c95a175945b88b17f07fbc650abf
W20260709 13:18:46.542678  8882 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:46.565528  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.576774  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:46.577672 16095 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:46.669054 15768 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.669584 15768 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.673588  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:46.677276  8808 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:46.678766  8807 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:46.679708 16093 raft_consensus.cc:2749] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:46.680683 15768 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:46.686990 15768 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.687508 15768 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:46.692704  8808 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:18:46.694767  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:46.696570  8807 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:46.697578 16093 raft_consensus.cc:2749] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:46.698379 15768 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:46.860214 16094 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.860843 16094 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.865126  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.865837  8838 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:46.867161  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:46.867990 16095 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:46.868402 16095 raft_consensus.cc:493] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.868790 16095 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:46.868902 16094 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:46.879943  8882 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:46.883343 16095 raft_consensus.cc:515] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.901947 16095 leader_election.cc:290] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:46.902133  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0cebd36d7c3434a9e438125a626bf29" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:46.902750  8838 raft_consensus.cc:3060] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:46.912412  8838 raft_consensus.cc:2468] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:46.925179  8884 leader_election.cc:304] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:46.926342 16094 raft_consensus.cc:2804] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:46.926774 15768 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.926892 16094 raft_consensus.cc:697] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:46.927395 15768 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.927887 16094 consensus_queue.cc:237] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.929893 15768 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:46.931279 16141 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.931957 16141 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.934373 16141 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:46.936170  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:46.936795  8916 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:46.937446  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.939625  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:46.941123 15768 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:46.941598 15768 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.942042 15768 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:46.944417 16095 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.945091 16095 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.947788 16095 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:46.949584  8882 leader_election.cc:336] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:46.950259  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:46.954360 16093 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.967366 16093 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:46.968873  8838 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:46.970103 16093 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:46.971781  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:46.972719 16095 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:46.973196 16095 raft_consensus.cc:493] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:46.973582 16095 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:46.971940  8882 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:46.978293  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:46.990125 16141 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:47.004968 16148 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.005576 16148 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.007751 16148 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.016427  9461 raft_consensus.cc:1217] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 LEARNER]: Deduplicated request from leader. Original: 23.14->[23.15-23.15]   Dedup: 23.15->[]
I20260709 13:18:47.017903 15917 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.018448 15917 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.022471  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.023105  8841 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:47.025215  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:47.030048  8882 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.030648 15768 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.020656 15917 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:47.041316  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 83893.9us
I20260709 13:18:47.045621  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.053121 15768 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.054451  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.058794  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f095ec4c4cb343308d8bd14544fe8b4e" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:47.043821 16150 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:47.059679  8914 raft_consensus.cc:3060] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.059952 16150 raft_consensus.cc:493] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.072548  8914 raft_consensus.cc:2468] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 22.
I20260709 13:18:47.080976 16141 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.081766 16141 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.084100 16141 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.077845 16150 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.094410  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.100757 16151 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.101490 16151 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.103879 16151 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.064589 16094 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.120666 16094 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.123343 16094 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.126029  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:47.128814  8808 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.136466  8808 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.141774 16095 raft_consensus.cc:515] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.142761  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.143927  8916 raft_consensus.cc:2393] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 773340b2958e4af5b2010b902b9e9c04 in current term 19: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
W20260709 13:18:47.146112  8808 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.147114  8808 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.147598  8808 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:47.148420 16153 raft_consensus.cc:2749] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:47.163247  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 100882us
I20260709 13:18:47.171562  8807 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.172370 16148 raft_consensus.cc:2804] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:47.173264  8807 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:47.177358 15768 raft_consensus.cc:3060] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.178675 16155 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.179244 16155 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.179659 16148 raft_consensus.cc:697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:47.180637 16148 consensus_queue.cc:237] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.183144 16095 leader_election.cc:290] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.183357 16155 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.190002  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da23dcb2ee347e7a43e2150a082fe62" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:47.199702 16150 raft_consensus.cc:515] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.203320 16155 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:47.205526  8808 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.208066  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.210487  8912 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:47.212469 15768 raft_consensus.cc:2749] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:47.222905  8661 catalog_manager.cc:5697] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 17 to 18, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.227617  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.233844 16095 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.234424 16095 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.236891 16095 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.217232 16155 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.238754  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.239369  8841 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
I20260709 13:18:47.239943 16155 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:47.241691  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:47.242380 16150 leader_election.cc:290] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.243045 16150 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:47.243384 16150 raft_consensus.cc:493] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.243310  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bd2a06b32904b5db18230a954b8d7fe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:47.243908 16150 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.244057  8841 raft_consensus.cc:3060] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.247467 16094 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.248008 16094 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.248920  8838 raft_consensus.cc:2468] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:47.250229 16094 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.256747  8841 raft_consensus.cc:2468] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:47.259243 16093 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.260027 16093 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:47.262259  8882 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.263160  8884 leader_election.cc:304] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:47.264698 16094 raft_consensus.cc:2804] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:47.265298  8884 leader_election.cc:304] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:47.266063 15917 raft_consensus.cc:2804] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:47.266697 15917 raft_consensus.cc:697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:47.267433 15917 consensus_queue.cc:237] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.260018  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.271909 16155 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:47.272351 16155 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.272763 16155 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:47.274029  8808 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.281378 16154 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.281992 16154 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.284121 16154 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.284760  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:18:47.287693  8882 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.288349  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:47.269232  8844 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:47.289359 16151 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:47.290830  8882 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.291453  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:47.291473  8809 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 3b34c95a175945b88b17f07fbc650abf, 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.292219 16151 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:47.293291 16146 raft_consensus.cc:2749] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:47.293715 16093 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.294170 16146 raft_consensus.cc:1064] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
W20260709 13:18:47.294267  9434 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50877.4us
W20260709 13:18:47.294555  8882 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.295234  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:47.296164 16151 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.265549 16094 raft_consensus.cc:697] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:47.298087  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:47.306766  8882 leader_election.cc:336] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.309417 16152 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:47.311085  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.311695  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.313477  8912 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:47.313298 16152 raft_consensus.cc:493] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.316885 16152 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.300915 16155 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.320158 16155 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.327888 16152 raft_consensus.cc:515] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.330022  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af46285a3b87458b8b247dc8610ab80b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:47.330044  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:47.341257  8914 raft_consensus.cc:3060] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:47.305619 16150 raft_consensus.cc:515] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.328771 16146 consensus_queue.cc:237] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 10, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.339969 16094 consensus_queue.cc:237] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.345033 16155 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:47.349979 16151 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.351960 16147 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:47.358387  8808 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.361016  8660 catalog_manager.cc:5697] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 21 to 22, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 22 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:47.362210  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 99122.3us
I20260709 13:18:47.362497 16150 leader_election.cc:290] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:47.373585  8882 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.374341  8808 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.374686  8882 leader_election.cc:336] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.374847  8808 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:47.372170  8914 raft_consensus.cc:2468] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
W20260709 13:18:47.376116  8882 leader_election.cc:336] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.373926 16155 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.377687 16155 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.384311  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "102be8dba78c4bc998ed8bf52775bec5" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:47.385258  8838 raft_consensus.cc:3060] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.387609 15768 raft_consensus.cc:2749] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:47.388525  8808 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.391410  8807 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.401552 16148 raft_consensus.cc:2804] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:47.403748 16148 raft_consensus.cc:697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:47.407099 16148 consensus_queue.cc:237] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.394784 16147 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.410629 16147 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.390442 16151 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.430553 16151 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.434136 16152 leader_election.cc:290] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:47.435386  8808 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.436933  8838 raft_consensus.cc:2468] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 23.
I20260709 13:18:47.439379  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.440049  8914 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
I20260709 13:18:47.446691  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
W20260709 13:18:47.447264  8882 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:47.447376  8841 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 22.
W20260709 13:18:47.447827  8882 leader_election.cc:336] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.448954  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f42b63da74d4bcf8db95f4956d8d75c" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:47.449142  8884 leader_election.cc:304] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.449528  8841 raft_consensus.cc:3060] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.445941 15768 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.451121 15768 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.445562 16157 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.454759  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:47.459038  8841 raft_consensus.cc:2468] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 19.
I20260709 13:18:47.460741 15768 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.461985  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.464042 15768 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.465840 16154 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:47.466295 16154 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.464596 15768 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.462177 16141 raft_consensus.cc:2804] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:47.463939 16094 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:47.473192 15768 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.468255 16154 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.471961 16094 raft_consensus.cc:493] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.475296 16094 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.453495 16157 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.479147 16157 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.474027 16141 raft_consensus.cc:697] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:47.481549 16141 consensus_queue.cc:237] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.483871  9461 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 LEARNER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:18:47.490038  9432 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.491786  8808 leader_election.cc:336] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.492168 16149 raft_consensus.cc:1064] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: attempting to promote NON_VOTER 3b34c95a175945b88b17f07fbc650abf to VOTER
I20260709 13:18:47.495146 16149 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 13, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.470752 16155 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.503417 16155 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.463563  8884 leader_election.cc:304] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
W20260709 13:18:47.505221  8808 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.505307  8882 leader_election.cc:336] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.505983  8808 consensus_peers.cc:597] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.510998 16151 raft_consensus.cc:2804] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:47.511137 16147 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:47.511709 16151 raft_consensus.cc:697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:47.512427  8841 raft_consensus.cc:1275] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:47.512624 16151 consensus_queue.cc:237] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.513896 16147 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.514426 16147 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.516372 16147 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.508312 16148 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:47.519794  8808 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.519956 16148 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.528203  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.529264  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.530246  8914 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 25.
I20260709 13:18:47.532688  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a15a66fec474b05b1f3ad99f61f1104" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:47.533540  8914 raft_consensus.cc:3060] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.535902  9468 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 LEARNER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:47.536996  8913 raft_consensus.cc:1275] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:47.538568 16148 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:47.540712  8808 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.546108 16154 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.546566  8916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.547375  8916 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
I20260709 13:18:47.549808  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.549932 16152 consensus_queue.cc:1048] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:47.550562  8912 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 21.
W20260709 13:18:47.550921  8808 consensus_peers.cc:597] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.551388  8808 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.543844 16094 raft_consensus.cc:515] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.552780  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:47.553184  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 65571.9us
W20260709 13:18:47.553892  8882 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.554211  8914 raft_consensus.cc:2468] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
W20260709 13:18:47.554746  8882 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.558990  8838 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:47.562750  8912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "273b1043e8dc4b13a6a84b35f19ff2a8" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:47.563598  8912 raft_consensus.cc:3060] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.551962 16154 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.568336  8807 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:47.556450  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.576638  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.572917 16153 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:47.584517  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.587558  9431 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:47.583110 16093 raft_consensus.cc:2749] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:47.552328 16149 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:18:47.582377 16153 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.595266 16167 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.595592 16057 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.595927 16167 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.596189 16057 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.594501 15917 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:47.587299 16155 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:47.586854 16095 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.630777 16155 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.633613 16155 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.637336  8838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.594836 16148 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:47.585111 16147 consensus_queue.cc:1048] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:18:47.638180  8838 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 10.
W20260709 13:18:47.642107  8882 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.642820  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:47.600585 16153 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:47.646159 16160 raft_consensus.cc:2749] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:47.647658 16167 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:47.649556 16176 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:47.649662  8882 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.650667  8882 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.632632 16057 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.640486 16148 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
W20260709 13:18:47.666949  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 82532.6us
I20260709 13:18:47.648751 16160 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:18:47.675324  8808 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.679451  8807 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.640471 16095 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.669965 16176 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:47.688835  8882 leader_election.cc:336] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.689517 16176 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:47.689635  8882 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.656306 16150 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.690385 16150 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.692848  8912 raft_consensus.cc:2468] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 18.
I20260709 13:18:47.692839 16150 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:47.689842 16095 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:47.672359 16148 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:47.711655  7657 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8790)
I20260709 13:18:47.712261 16057 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.716144 16057 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:47.717025  8882 leader_election.cc:336] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.718324 16057 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:47.717121  8808 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.731667  8808 consensus_peers.cc:597] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.732203  8808 consensus_peers.cc:597] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.721935  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.719722  9461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:47.734015  9461 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 11.
I20260709 13:18:47.719012  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:47.735073  9466 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 16.
I20260709 13:18:47.720398  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:47.719198 16094 leader_election.cc:290] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.675967 16160 raft_consensus.cc:493] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.736446  9468 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:47.736752 16160 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:47.704118 16167 raft_consensus.cc:2804] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:47.737645 16167 raft_consensus.cc:697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:47.739516  8841 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:47.741601  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1bacaaff25445c9eccef8932f745d1" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:47.742157  8841 raft_consensus.cc:3060] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.738922 16179 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.744776 16179 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.747517 16179 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:47.738620 16167 consensus_queue.cc:237] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.755476  8841 raft_consensus.cc:2468] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 23.
W20260709 13:18:47.759986  9432 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.763300  8882 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.765043  8882 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.765776  8882 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.768445  9432 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.771812  8809 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.771347  8883 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.779179  8807 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.789237  8883 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.789335  8841 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04" is_pre_election: true
I20260709 13:18:47.774616 16093 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:47.793977  8914 raft_consensus.cc:1275] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:47.759495 16153 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.818584  8661 catalog_manager.cc:5697] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.820613  8661 catalog_manager.cc:5697] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.821696 16147 consensus_queue.cc:1048] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:47.825457  8661 catalog_manager.cc:5697] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 22 to 23, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 23 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:47.797014 16176 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:47.804220 16182 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:47.798003 16093 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.840040  8661 catalog_manager.cc:5697] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 18 to 19, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 19 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:47.848526  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 135399us
I20260709 13:18:47.851085  8837 raft_consensus.cc:1275] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:47.845700 16093 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:47.851891 16180 raft_consensus.cc:2804] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:47.852640 16180 raft_consensus.cc:697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:47.853653 16180 consensus_queue.cc:237] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.862830  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.862957 16148 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:47.867399 16152 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:47.867888 16152 raft_consensus.cc:493] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.868265 16152 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:47.870018  8882 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.871018  9432 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:47.871227 16155 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:47.875325  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:47.875978  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.877226  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:47.879122  8884 leader_election.cc:304] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:47.834636 16176 raft_consensus.cc:493] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.887943 16176 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:47.889549 16155 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.838555 16182 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 74de73c0f36d4c3aa7a483c7fdb39e4a)
I20260709 13:18:47.860443 16093 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.902030 16153 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:47.899103 16151 raft_consensus.cc:2804] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:47.912082 16151 raft_consensus.cc:697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:47.913170  8841 raft_consensus.cc:2393] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 17: Already voted for candidate 773340b2958e4af5b2010b902b9e9c04 in this term.
I20260709 13:18:47.913744 16093 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:47.916169 16151 consensus_queue.cc:237] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:47.923878  8882 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.924621  8882 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.925926  8808 consensus_peers.cc:597] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:47.926661  8808 consensus_peers.cc:597] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:47.927239  8808 consensus_peers.cc:597] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.932925 16182 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:47.947516 16152 raft_consensus.cc:515] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:47.948385  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 49772us
I20260709 13:18:47.965695 16149 consensus_queue.cc:1048] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:47.967525 16182 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:47.968909  8913 raft_consensus.cc:2393] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b34c95a175945b88b17f07fbc650abf in current term 18: Already voted for candidate bdb96be202c2447586477b2077b7d5bf in this term.
I20260709 13:18:47.969790  8914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3f50214a4c94ba0b85876c02e10b9ac" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:47.970504  8914 raft_consensus.cc:3060] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:47.974413  9431 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:47.953663 16148 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:48.002534 16152 leader_election.cc:290] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:48.005963  8835 raft_consensus.cc:1275] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:47.975270  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c10a9719c7f4cf5a813c2dc4c5e3739" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:48.009334  8913 raft_consensus.cc:3060] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:47.976903  8916 raft_consensus.cc:1275] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:48.012158  8914 raft_consensus.cc:2468] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 22.
W20260709 13:18:47.976334  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 43958.7us
W20260709 13:18:48.017635  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 83716.3us
I20260709 13:18:48.021595  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:47.996088 16147 raft_consensus.cc:2955] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:48.042647 16184 raft_consensus.cc:3060] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.017925 16157 raft_consensus.cc:3060] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:48.057574  8918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c71888f7c2e471db00d7e83cf31ebf3" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:48.058341  8918 raft_consensus.cc:3060] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:48.076117  8913 raft_consensus.cc:2468] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 26.
W20260709 13:18:48.097802  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 73196.4us
I20260709 13:18:48.098544  8918 raft_consensus.cc:2468] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 22.
W20260709 13:18:48.111600  8882 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.112286  8882 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:47.964668 16176 raft_consensus.cc:515] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:48.113873  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bac07da6a99849fb8f972372c187ee7b" candidate_uuid: "773340b2958e4af5b2010b902b9e9c04" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:48.127918 16184 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:47.956655 16160 raft_consensus.cc:515] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:48.130853  9432 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.132210 16157 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:48.142597  9432 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.145946 16149 consensus_queue.cc:1048] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:48.146497 16141 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:18:48.148998  8808 consensus_peers.cc:597] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.146075  9468 raft_consensus.cc:2468] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 773340b2958e4af5b2010b902b9e9c04 in term 17.
W20260709 13:18:48.151482  9432 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.148852 16160 leader_election.cc:290] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:48.157742 16182 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:48.159557 16176 leader_election.cc:290] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Requested vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:18:48.180084  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 51631.4us
I20260709 13:18:48.182559  9466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3373a354d754ec48ac0cc05829af66f" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
W20260709 13:18:48.188508  8808 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:48.197422  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106d574bc4cfeaa6e7b1240430c4b" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:48.198192  9462 raft_consensus.cc:3060] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:48.206678  8844 raft_consensus.cc:1275] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:48.208263  8807 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:48.209575  8807 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:48.210551  8807 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:48.211520  8835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e56e66e882c455cb86d4e08fd5555d2" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:48.212230  8835 raft_consensus.cc:3060] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.178141  9461 raft_consensus.cc:2955] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:48.217094  8918 raft_consensus.cc:2955] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:18:48.225063  9432 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.226555  8809 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 
I20260709 13:18:48.228742 16147 raft_consensus.cc:2804] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:48.231048 16146 raft_consensus.cc:2804] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:48.231778 16167 raft_consensus.cc:2804] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:18:48.231911 16153 raft_consensus.cc:2804] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:48.232430 16167 raft_consensus.cc:697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 26 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:48.232589 16153 raft_consensus.cc:697] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:48.233566 16167 consensus_queue.cc:237] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:48.233695 16153 consensus_queue.cc:237] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:48.227775  9468 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:48.237633 16154 consensus_queue.cc:1048] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:48.240402  9462 raft_consensus.cc:2468] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 12.
I20260709 13:18:48.242738  8660 catalog_manager.cc:5697] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.248306  8660 catalog_manager.cc:5697] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 17 to 18, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 18 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.254041  8883 leader_election.cc:304] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:48.256480  8660 catalog_manager.cc:5697] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 17 to 18, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 18 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.259073  8660 catalog_manager.cc:5697] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 12 to 13, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.262730  8839 raft_consensus.cc:1275] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:48.265033 16182 raft_consensus.cc:2804] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:48.271837 16182 raft_consensus.cc:697] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:48.241381 16146 raft_consensus.cc:697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:48.282289 15917 consensus_queue.cc:1048] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:48.297214 16182 consensus_queue.cc:237] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:48.249568 16149 consensus_queue.cc:1048] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:48.313512  8835 raft_consensus.cc:2468] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 21.
I20260709 13:18:48.286916  8844 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Committing config change with OpId 23.16: config changed from index 15 to 16, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:18:48.316622  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 78372.9us
W20260709 13:18:48.320195  8882 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.320982  8882 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.321404  8882 leader_election.cc:336] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:48.324947  9432 leader_election.cc:336] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:48.293541 16147 raft_consensus.cc:697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Becoming Leader. State: Replica: 773340b2958e4af5b2010b902b9e9c04, State: Running, Role: LEADER
I20260709 13:18:48.371487  9466 raft_consensus.cc:2468] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
W20260709 13:18:48.390986  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 44910.7us
W20260709 13:18:48.395190  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 44775.5us
I20260709 13:18:48.396993  8884 leader_election.cc:304] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
I20260709 13:18:48.401516 16173 raft_consensus.cc:2804] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:48.351449 16146 consensus_queue.cc:237] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:48.402258 16173 raft_consensus.cc:697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:48.455081  8807 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 61554.1us
I20260709 13:18:48.412177 16147 consensus_queue.cc:237] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:48.432824 16173 consensus_queue.cc:237] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:48.500010  9431 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:39883, user_credentials={real_user=slave}} blocked reactor thread for 144296us
I20260709 13:18:48.526284  8844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79353780ac54a25bd9999800873bbeb" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "773340b2958e4af5b2010b902b9e9c04"
I20260709 13:18:48.527031  8844 raft_consensus.cc:3060] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:48.558269  9432 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.549958  8808 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:48.561437  8882 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.562566  8882 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.564756  8844 raft_consensus.cc:2468] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 11.
W20260709 13:18:48.565385  8808 consensus_peers.cc:597] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.616766  8808 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 51433.9us
W20260709 13:18:48.598093  8882 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:48.635905  8808 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:48.643141  8808 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:48.640970  8882 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:48.643932  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 45898.5us
W20260709 13:18:48.644564  8882 leader_election.cc:336] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:48.645718  8882 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.646570  8882 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.648671  8882 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.658906  8883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:45973, user_credentials={real_user=slave}} blocked reactor thread for 57742.3us
W20260709 13:18:48.678007  8808 consensus_peers.cc:597] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.678922  8808 consensus_peers.cc:597] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.679418  8808 consensus_peers.cc:597] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:48.690800  8835 raft_consensus.cc:1275] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:48.646134 16173 raft_consensus.cc:2804] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:48.701648  8911 raft_consensus.cc:1275] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:48.707859  8911 raft_consensus.cc:1275] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:18:48.709208  8808 consensus_peers.cc:597] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.715246  7657 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8790)
I20260709 13:18:48.718415 16173 raft_consensus.cc:697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:48.726025 16173 consensus_queue.cc:237] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:48.729662  9434 leader_election.cc:304] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a
W20260709 13:18:48.732975  8808 consensus_peers.cc:597] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.734517 16184 raft_consensus.cc:2804] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:48.735139 16184 raft_consensus.cc:697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 11 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:18:48.736076 16184 consensus_queue.cc:237] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:48.761216  8661 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf reported cstate change: config changed from index 15 to 16, 3b34c95a175945b88b17f07fbc650abf (127.7.122.68) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } attrs { replace: true } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
W20260709 13:18:48.770205  8808 consensus_peers.cc:597] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:48.770816  8808 consensus_peers.cc:597] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.771253  8808 consensus_peers.cc:597] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:48.771584  8808 consensus_peers.cc:597] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:48.775954 16178 consensus_queue.cc:1048] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:48.796252 16202 consensus_queue.cc:1048] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:48.802456 16200 consensus_queue.cc:1048] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:18:48.811717  8913 raft_consensus.cc:1275] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:18:48.818671  9462 raft_consensus.cc:1275] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:48.844336  8665 catalog_manager.cc:5697] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 11 to 12, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 12 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:48.845486 16093 consensus_queue.cc:1048] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:48.862248  8665 catalog_manager.cc:5697] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 22 to 23, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 23 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:48.887609 16093 consensus_queue.cc:1048] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:48.896755  9462 raft_consensus.cc:1275] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:18:48.935427  8661 catalog_manager.cc:5697] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 10 to 11, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 11 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:48.981577  8808 consensus_peers.cc:597] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.014591 16205 consensus_queue.cc:1048] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:18:49.018244  8837 raft_consensus.cc:1275] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:49.064440  8660 catalog_manager.cc:5697] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 25 to 26, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 26 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.086352  8660 catalog_manager.cc:5697] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 16 to 17, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 17 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.090657  8660 catalog_manager.cc:5697] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 21 to 22, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 22 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.093964  8660 catalog_manager.cc:5697] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: term changed from 21 to 22, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66). New cstate: current_term: 22 leader_uuid: "773340b2958e4af5b2010b902b9e9c04" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:49.099898  8808 consensus_peers.cc:597] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.126006  8911 raft_consensus.cc:1275] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:49.158443 16146 consensus_queue.cc:1048] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:49.163130  8911 raft_consensus.cc:1275] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Refusing update from remote peer 773340b2958e4af5b2010b902b9e9c04: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:49.177318 16167 consensus_queue.cc:1048] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:49.179171  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 47302.7us
W20260709 13:18:49.180039  8882 consensus_peers.cc:597] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.075603 16206 consensus_queue.cc:1048] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
W20260709 13:18:49.215893  8808 consensus_peers.cc:597] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:49.250838  9432 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:49.300165  8882 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.304694  9462 raft_consensus.cc:1275] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:49.306733 16206 consensus_queue.cc:1048] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:49.332592  8665 catalog_manager.cc:5697] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 20 to 21, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 21 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.339960  8665 catalog_manager.cc:5697] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 17 to 18, leader changed from 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.357915  8837 raft_consensus.cc:1275] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:49.362301 16187 consensus_queue.cc:1048] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:18:49.385440  8882 consensus_peers.cc:597] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:49.499178  8911 consensus_queue.cc:237] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:49.532680  9462 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:49.534228 16206 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:49.550549  8837 raft_consensus.cc:1275] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:49.552758 16206 consensus_queue.cc:1048] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:49.580696 16178 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:49.591801  8837 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:49.601306  9462 raft_consensus.cc:2955] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index 16 to 17, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:49.618975  8665 catalog_manager.cc:5697] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 reported cstate change: config changed from index 16 to 17, VOTER 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65) evicted. New cstate: current_term: 23 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } } }
I20260709 13:18:49.624351  8651 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 022d4a4680cb42e4bc9970d8a4f604f1 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:49.712044  8652 catalog_manager.cc:4755] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 022d4a4680cb42e4bc9970d8a4f604f1: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:49.715891  7657 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8790)
W20260709 13:18:50.017812  8882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111) [suppressed 415 similar messages]
W20260709 13:18:50.020957  8882 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.079114  8882 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.186375  8882 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.289561  8882 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.324522  9432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 50891us
W20260709 13:18:50.412907  8808 consensus_peers.cc:597] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.480481  8808 consensus_peers.cc:597] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.495859  8808 consensus_peers.cc:597] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.515736  8808 consensus_peers.cc:597] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:50.607402  8808 consensus_peers.cc:597] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.655586  8808 consensus_peers.cc:597] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.665827  9432 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.687645  8808 consensus_peers.cc:597] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.716445  7657 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8790)
W20260709 13:18:50.746558  8808 consensus_peers.cc:597] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.780035  8808 consensus_peers.cc:597] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.882434  8808 consensus_peers.cc:597] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.961789  8652 catalog_manager.cc:4755] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 022d4a4680cb42e4bc9970d8a4f604f1: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:50.995513  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:50.999034  8808 consensus_peers.cc:597] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.020882  8808 consensus_peers.cc:597] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.030730  8808 consensus_peers.cc:597] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.042776  8808 consensus_peers.cc:597] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.046236  8808 consensus_peers.cc:597] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.087514  8808 consensus_peers.cc:597] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.111207  9432 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.190033  9432 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.222003  9432 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.276250  8808 consensus_peers.cc:597] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.285498  9432 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:51.318997  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
W20260709 13:18:51.347694  8882 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.348251  8882 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.348802  8882 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.349387  8882 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.349900  8882 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.350478  8882 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.359961  8808 consensus_peers.cc:597] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.363914  8808 consensus_peers.cc:597] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.368227  8882 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.374552  8882 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.375248  8882 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.375842  8882 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.382540  9432 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.401854  8882 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.579952  8808 consensus_peers.cc:597] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.629637  8882 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:51.715479  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
W20260709 13:18:51.753239  8884 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.759380  8882 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:51.780087  8884 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.786773  8884 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.790522  8884 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.801220  8884 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.802037  8884 consensus_peers.cc:597] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.814577  8882 consensus_peers.cc:597] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.834246  8882 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.832101  8884 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.841430  8884 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.869822  8884 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.870705  8884 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.887480  8884 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.903883  9434 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.908545  8808 consensus_peers.cc:597] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.910488  9434 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.931247  8884 consensus_peers.cc:597] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.932250  8884 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.947822  8884 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.948781  8884 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.949832  8884 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.950667  8884 consensus_peers.cc:597] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.951819  8884 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:51.952646  8884 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:51.964038  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:51.966861  7657 tablet_replica.cc:333] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:51.967849  7657 raft_consensus.cc:2243] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:51.969122  7657 raft_consensus.cc:2272] T f095ec4c4cb343308d8bd14544fe8b4e P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:51.973742  7657 tablet_replica.cc:333] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:51.974660  7657 raft_consensus.cc:2243] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:51.975340  7657 raft_consensus.cc:2272] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:51.978550  7657 tablet_replica.cc:333] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:51.979374  7657 raft_consensus.cc:2243] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:51.979897  7657 raft_consensus.cc:2272] T c6f1fe9f34b9476fb981c06a43a1fb1d P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:51.990900  8882 consensus_peers.cc:597] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:51.993528  9434 consensus_peers.cc:597] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:51.995453  7657 tablet_replica.cc:333] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:51.997639  7657 raft_consensus.cc:2243] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:18:52.004577  9434 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.007084  7657 raft_consensus.cc:2272] T 9d82cf960a5f4fb4acb573fe580b10ed P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:52.031646  8884 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.034726  7657 tablet_replica.cc:333] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.039673  7657 raft_consensus.cc:2243] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.040431  7657 raft_consensus.cc:2272] T b0cebd36d7c3434a9e438125a626bf29 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:52.041847  9434 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.052917  7657 tablet_replica.cc:333] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.058584  7657 raft_consensus.cc:2243] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:52.061784  8652 catalog_manager.cc:4755] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 022d4a4680cb42e4bc9970d8a4f604f1: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:52.065541  7657 raft_consensus.cc:2272] T 2e090a13858f439f934f3a0277b08f18 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.068061  7657 tablet_replica.cc:333] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.068828  7657 raft_consensus.cc:2243] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.071770  7657 raft_consensus.cc:2272] T 589fb2d6cab941e09bb87a5254bc9d48 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.075167  7657 tablet_replica.cc:333] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.090301  7657 raft_consensus.cc:2243] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.091152  7657 raft_consensus.cc:2272] T 9bd2a06b32904b5db18230a954b8d7fe P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.107156  7657 tablet_replica.cc:333] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.108198  7657 raft_consensus.cc:2243] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.109371  7657 raft_consensus.cc:2272] T c65b41257e7e4b66b28805964b4e7d16 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.113384  7657 tablet_replica.cc:333] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.114341  7657 raft_consensus.cc:2243] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.115005  7657 raft_consensus.cc:2272] T 6e56e66e882c455cb86d4e08fd5555d2 P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.118084  7657 tablet_replica.cc:333] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.121719  7657 raft_consensus.cc:2243] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.122437  7657 raft_consensus.cc:2272] T 968e06ae5d2744aeb0b947873b369af8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.140558  7657 tablet_replica.cc:333] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.141623  7657 raft_consensus.cc:2243] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:52.134490  8884 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.157323  7657 raft_consensus.cc:2272] T 282538f07daf4dcdb59352e756a62ba8 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:52.166085  8884 consensus_peers.cc:597] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.168913  7657 tablet_replica.cc:333] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.169981  7657 raft_consensus.cc:2243] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.170644  7657 raft_consensus.cc:2272] T 9f42b63da74d4bcf8db95f4956d8d75c P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.173395  7657 tablet_replica.cc:333] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.174278  7657 raft_consensus.cc:2243] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.174896  7657 raft_consensus.cc:2272] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.177896  7657 tablet_replica.cc:333] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.178807  7657 raft_consensus.cc:2243] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.179471  7657 raft_consensus.cc:2272] T 512bfb8ae84244418d0107564d88e5bb P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.182296  7657 tablet_replica.cc:333] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.193562  7657 raft_consensus.cc:2243] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.194330  7657 raft_consensus.cc:2272] T 102be8dba78c4bc998ed8bf52775bec5 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.197104  7657 tablet_replica.cc:333] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.198060  7657 raft_consensus.cc:2243] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.199224  7657 raft_consensus.cc:2272] T 672045bd655a4cbea707258aa0718564 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.202180  7657 tablet_replica.cc:333] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.205529  7657 raft_consensus.cc:2243] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.206297  7657 raft_consensus.cc:2272] T fb4847af9abd4172bff3a603da47325c P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.212826  7657 tablet_replica.cc:333] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.217880  7657 raft_consensus.cc:2243] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:18:52.224749  8882 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:52.225728  7657 raft_consensus.cc:2272] T cbb9c9a8b7c641fb839da3aa2a309c0b P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.228770  7657 tablet_replica.cc:333] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.229660  7657 raft_consensus.cc:2243] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.230729  7657 raft_consensus.cc:2272] T 76badded6ebe4972ad520c819a7fc3ae P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.233537  7657 tablet_replica.cc:333] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.234468  7657 raft_consensus.cc:2243] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.235594  7657 raft_consensus.cc:2272] T 273b1043e8dc4b13a6a84b35f19ff2a8 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.238783  7657 tablet_replica.cc:333] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.239722  7657 raft_consensus.cc:2243] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.240996  7657 raft_consensus.cc:2272] T 51c7e309721f4da1bcd1626da407d364 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.243881  7657 tablet_replica.cc:333] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.244843  7657 raft_consensus.cc:2243] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.246040  7657 raft_consensus.cc:2272] T 94e939be989f4d59b1983955951ab90f P 773340b2958e4af5b2010b902b9e9c04 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.249109  7657 tablet_replica.cc:333] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.250204  7657 raft_consensus.cc:2243] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.250943  7657 raft_consensus.cc:2272] T ba1bacaaff25445c9eccef8932f745d1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.254230  7657 tablet_replica.cc:333] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.255185  7657 raft_consensus.cc:2243] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.256385  7657 raft_consensus.cc:2272] T 2a15a66fec474b05b1f3ad99f61f1104 P 773340b2958e4af5b2010b902b9e9c04 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.262913  7657 tablet_replica.cc:333] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.263883  7657 raft_consensus.cc:2243] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.267360  7657 raft_consensus.cc:2272] T af46285a3b87458b8b247dc8610ab80b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.270032  7657 tablet_replica.cc:333] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.271010  7657 raft_consensus.cc:2243] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.272099  7657 raft_consensus.cc:2272] T 191959ae05ea40fd8a7fb0e027de5b86 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:52.272563  9432 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:52.279080  7657 tablet_replica.cc:333] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.280038  7657 raft_consensus.cc:2243] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.280665  7657 raft_consensus.cc:2272] T 2da23dcb2ee347e7a43e2150a082fe62 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.285431  7657 tablet_replica.cc:333] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.286334  7657 raft_consensus.cc:2243] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.288244  7657 raft_consensus.cc:2272] T a034d186214a4f03b519e7c03f58788f P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.291157  7657 tablet_replica.cc:333] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.292328  7657 raft_consensus.cc:2243] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.293174  7657 raft_consensus.cc:2272] T a85c28eb5f2e4741b40ca8723a62f870 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.296100  7657 tablet_replica.cc:333] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.297067  7657 raft_consensus.cc:2243] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.298175  7657 raft_consensus.cc:2272] T c4b840458e6048cd9c4444bf516cf39a P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.301812  7657 tablet_replica.cc:333] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.302656  7657 raft_consensus.cc:2243] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.303329  7657 raft_consensus.cc:2272] T ef624fe5958542fa8714cedf17ca4940 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.306214  7657 tablet_replica.cc:333] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.307088  7657 raft_consensus.cc:2243] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.307762  7657 raft_consensus.cc:2272] T 860647fd65b141d8842fde1bd4f9a549 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.310896  7657 tablet_replica.cc:333] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.313596  7657 raft_consensus.cc:2243] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.314299  7657 raft_consensus.cc:2272] T f045ce88a76f4620ad6c717c8245982a P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.317251  7657 tablet_replica.cc:333] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.318185  7657 raft_consensus.cc:2243] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.319751  7657 raft_consensus.cc:2272] T 002c4018f5264a23a9d3f93713b6fffe P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.322631  7657 tablet_replica.cc:333] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.323513  7657 raft_consensus.cc:2243] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.324218  7657 raft_consensus.cc:2272] T 8447f76afbaa45b385add1219d08771c P 773340b2958e4af5b2010b902b9e9c04 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.327211  7657 tablet_replica.cc:333] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.328256  7657 raft_consensus.cc:2243] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.329517  7657 raft_consensus.cc:2272] T bac07da6a99849fb8f972372c187ee7b P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.334002  7657 tablet_replica.cc:333] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.336570  7657 raft_consensus.cc:2243] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.338277  7657 raft_consensus.cc:2272] T b3f50214a4c94ba0b85876c02e10b9ac P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.347492  7657 tablet_replica.cc:333] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
W20260709 13:18:52.348578  8884 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:52.348671  7657 raft_consensus.cc:2243] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.350026  7657 raft_consensus.cc:2272] T c79353780ac54a25bd9999800873bbeb P 773340b2958e4af5b2010b902b9e9c04 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.353881  7657 tablet_replica.cc:333] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.399672  7657 raft_consensus.cc:2243] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.401872  7657 raft_consensus.cc:2272] T 4128699de59a470a9275f001cbd35515 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.455490  7657 tablet_replica.cc:333] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.466353  7657 raft_consensus.cc:2243] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.504783  7657 raft_consensus.cc:2272] T 430f59d9e22342829896b185b2da7cf3 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.523481  7657 tablet_replica.cc:333] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.539285  7657 raft_consensus.cc:2243] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.541438  7657 raft_consensus.cc:2272] T 2c71888f7c2e471db00d7e83cf31ebf3 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.555516  7657 tablet_replica.cc:333] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.556470  7657 raft_consensus.cc:2243] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.557766  7657 raft_consensus.cc:2272] T 011917cac276499ba01c77d911c67d8d P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.560590  7657 tablet_replica.cc:333] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.561519  7657 raft_consensus.cc:2243] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.562242  7657 raft_consensus.cc:2272] T af7776ba20a14a499de5919550fdada6 P 773340b2958e4af5b2010b902b9e9c04 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.570385  7657 tablet_replica.cc:333] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.571255  7657 raft_consensus.cc:2243] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.572471  7657 raft_consensus.cc:2272] T bccdb4728c764cc0a333f593ab71c511 P 773340b2958e4af5b2010b902b9e9c04 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.575408  7657 tablet_replica.cc:333] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.582320  7657 raft_consensus.cc:2243] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.583700  7657 raft_consensus.cc:2272] T e8a8035ad96048ea978033b357465875 P 773340b2958e4af5b2010b902b9e9c04 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.586576  7657 tablet_replica.cc:333] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.590555  7657 raft_consensus.cc:2243] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.595129  7657 raft_consensus.cc:2272] T aa48bba2a08c4fcdae35a029b7107f70 P 773340b2958e4af5b2010b902b9e9c04 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.606431  7657 tablet_replica.cc:333] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.607317  7657 raft_consensus.cc:2243] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.608603  7657 raft_consensus.cc:2272] T 7689b80937134444a5933a16f9aa7d64 P 773340b2958e4af5b2010b902b9e9c04 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.630039  7657 tablet_replica.cc:333] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.631059  7657 raft_consensus.cc:2243] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.632408  7657 raft_consensus.cc:2272] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P 773340b2958e4af5b2010b902b9e9c04 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.637290  7657 tablet_replica.cc:333] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.638464  7657 raft_consensus.cc:2243] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:52.639806  7657 raft_consensus.cc:2272] T da988855757643ccbb2593bad676d78d P 773340b2958e4af5b2010b902b9e9c04 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.643734  7657 tablet_replica.cc:333] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.651473  7657 raft_consensus.cc:2243] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.652609  7657 raft_consensus.cc:2272] T 022d4a4680cb42e4bc9970d8a4f604f1 P 773340b2958e4af5b2010b902b9e9c04 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:52.655448  7657 tablet_replica.cc:333] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04: stopping tablet replica
I20260709 13:18:52.664218  7657 raft_consensus.cc:2243] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:52.665030  7657 raft_consensus.cc:2272] T d1d69638bb504813949178c6aee64727 P 773340b2958e4af5b2010b902b9e9c04 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:52.893546  8810 connection.cc:466] server connection from 127.0.0.1:40104 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 4599) could send its response
W20260709 13:18:52.896023  7657 connection.cc:466] server connection from 127.0.0.1:40104 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40104 (request call id 4598) could send its response
W20260709 13:18:52.895964  8884 connection.cc:573] client connection to 127.7.122.66:32843 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:18:53.037509  8882 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.095444  8882 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.149487 16271 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.150111 16271 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.152386 16271 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.163167  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:53.172250  9434 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.172716  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.175982 16271 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.178329 16275 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.179301 16275 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.183970 16275 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.188946  8882 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:53.192696  8884 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.193270  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.194450 16275 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:53.231508 16275 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.232050 16275 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.234237 16275 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.241169  8884 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.242004  8882 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.242429  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.243955 16263 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:53.249571  8882 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:53.251194 16275 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.251755 16275 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.253935 16275 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.271584  8884 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.283584  8882 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.284175  8882 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.287071 16275 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:53.321915 16275 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.322472 16275 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.324748 16275 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.335708  8884 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.352423  8882 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.353058  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.359241 16275 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:53.367584 16263 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.368237 16263 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:53.381259  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.383997 16263 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.384977 16206 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.387490 16206 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.389473 16206 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.396806 16263 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.397627 16263 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.403308 16263 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.414774 16271 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.416899 16271 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.420680 16271 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:53.424826  8882 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.428198  9434 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.441942  8884 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.450434  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
W20260709 13:18:53.452135  9432 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.452454  8882 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.453011  8882 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:53.454269  8884 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.461167 16263 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:53.462386  8882 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.464152  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.466598 16263 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:53.467792 16271 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.468761 16271 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.472949 16271 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.482154  9434 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.483284  9432 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.483982  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.484715  9432 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.485591 16271 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.497567  9431 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:53.498978 16271 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:53.500484  8884 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.515488  8882 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.516300  8882 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.519851 16263 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.524075 16271 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.524652 16271 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.526880 16271 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.523454 16263 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.528540 16263 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.531155 16263 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.532234  8882 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:53.534291  8882 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.538192  9434 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.541500  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.542029  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.543221 16271 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:53.546505  8884 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.556484 16263 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.557154 16263 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.565907 16263 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.587524  8884 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.592051  8882 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:53.594834 16206 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.595445 16206 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.597509 16206 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.594805  8882 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.599035  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.601608 16206 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:53.602730  8882 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.608243  8884 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.615897  8882 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.624320  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.627177 16206 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:53.638494 16206 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.639377 16206 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.641655 16206 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:53.664523  8884 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.666491 16206 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.668522 16206 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.670467 16206 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:53.672030  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:53.672755  9462 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
I20260709 13:18:53.674285  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:53.675084 16206 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:53.676487 16206 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.676807 16206 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:53.680124  8882 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.680639  8882 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.681026  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.689077 16206 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.692165  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c7e309721f4da1bcd1626da407d364" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:53.692783  9462 raft_consensus.cc:3060] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.696049 16278 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:53.699534 16278 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.700126 16278 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.702422 16278 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.707245  9462 raft_consensus.cc:2468] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:53.710084  8883 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:53.711155 16278 raft_consensus.cc:2804] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:53.711802  8882 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.712291  8882 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.712344 16278 raft_consensus.cc:697] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
I20260709 13:18:53.712750  8882 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.713634 16278 consensus_queue.cc:237] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:53.714250  8884 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.715961  8884 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.717353 16275 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:53.724291  9432 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.726325 16206 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:53.730626 16275 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.731218 16275 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.735175 16275 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:53.735371  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:53.737748 16275 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.738268 16275 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.740278 16275 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.742661 16206 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.743148 16206 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.744994 16206 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.752915  8665 catalog_manager.cc:5697] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:53.758594  9432 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.763746  8884 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.765916 16275 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.766476 16275 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.768757 16275 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.777842 16271 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.778613 16271 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:53.785890  9432 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.787942 16270 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.788749 16270 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.791719 16270 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:53.793128  9434 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.793815  9434 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.789252 16271 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:18:53.798689 16270 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:53.803592  8884 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.807934  9432 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.807884  8884 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.808995 16275 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:53.809890  8884 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.811079  8884 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.812167  9434 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.787719  8882 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.818861  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.819780 16275 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:53.825033 16275 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.825165  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:53.825875  8911 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 20.
I20260709 13:18:53.825709 16275 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.827231  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:53.828022 16275 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:53.829259  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
W20260709 13:18:53.833012  8884 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.833151  8882 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:53.835901  8882 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.836454  8882 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.836603 16275 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.839064 16275 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:53.841763 16275 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:53.843152 16275 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:53.844273  8882 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.845813  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.849599 16275 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:53.847833  8884 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.852967  8884 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 3b34c95a175945b88b17f07fbc650abf, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.853911  9431 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:18:53.854786 16275 raft_consensus.cc:2749] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:53.855876 16271 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:53.873378  8882 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.874985  8882 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:53.876935  8884 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:53.878350 16275 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:53.883852  8882 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:53.895375  8882 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:53.897490  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:53.900476 16275 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:53.901810  8882 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.904553 16275 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.905514 16275 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.909264  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:53.910068  9462 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 17.
W20260709 13:18:53.910789  7657 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8865)
I20260709 13:18:53.911911 16275 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:53.915025  8883 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:53.916261 16263 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:53.916721 16263 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:53.917196 16263 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.926940 16263 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:53.930428  9462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430f59d9e22342829896b185b2da7cf3" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf"
I20260709 13:18:53.931061  9462 raft_consensus.cc:3060] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:53.944989 16263 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
I20260709 13:18:53.948961  9462 raft_consensus.cc:2468] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 18.
I20260709 13:18:53.954536  8883 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 
I20260709 13:18:53.955475 16263 raft_consensus.cc:2804] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:53.955988 16263 raft_consensus.cc:697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Becoming Leader. State: Replica: bdb96be202c2447586477b2077b7d5bf, State: Running, Role: LEADER
W20260709 13:18:53.957082  8882 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.956910 16263 consensus_queue.cc:237] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:53.958156  8884 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.972738  8884 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:53.983283  8882 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:53.991752  8665 catalog_manager.cc:5697] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf reported cstate change: term changed from 17 to 18, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to bdb96be202c2447586477b2077b7d5bf (127.7.122.67). New cstate: current_term: 18 leader_uuid: "bdb96be202c2447586477b2077b7d5bf" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:54.036721  8882 consensus_peers.cc:597] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.081490  9432 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:54.082279 16271 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:54.082803 16271 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:54.085687  8884 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.089202  9434 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:54.085721  8882 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:54.090739 16271 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:54.093168  8884 consensus_peers.cc:597] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.093710 16275 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:54.098356  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:54.098376 16275 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:54.099344  8911 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 12.
I20260709 13:18:54.100978 16275 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:54.104126  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:54.105401 16271 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:54.105839 16271 raft_consensus.cc:493] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:54.106210 16271 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:54.111967  8884 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:54.117157  8882 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.117709  8882 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:54.118182  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:54.119005 16263 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:54.116366 16271 raft_consensus.cc:515] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:54.129894  9434 leader_election.cc:336] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:54.131444 16271 leader_election.cc:290] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Requested vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:54.132025  8884 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.137194  8911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da988855757643ccbb2593bad676d78d" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf"
I20260709 13:18:54.137811  8911 raft_consensus.cc:3060] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:54.143975  9462 raft_consensus.cc:1275] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:54.145759 16275 consensus_queue.cc:1048] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:54.153265  8911 raft_consensus.cc:2468] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 13.
W20260709 13:18:54.148360  8884 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.160506  8882 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.171110  8652 catalog_manager.cc:4755] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 022d4a4680cb42e4bc9970d8a4f604f1: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:54.179196  9431 leader_election.cc:304] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:54.181088  9434 consensus_peers.cc:597] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.180725 16282 raft_consensus.cc:2804] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:54.182548 16282 raft_consensus.cc:697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Becoming Leader. State: Replica: 3b34c95a175945b88b17f07fbc650abf, State: Running, Role: LEADER
I20260709 13:18:54.183635 16282 consensus_queue.cc:237] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:54.193131  8884 consensus_peers.cc:597] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.228497  8665 catalog_manager.cc:5697] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf reported cstate change: term changed from 12 to 13, leader changed from 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66) to 3b34c95a175945b88b17f07fbc650abf (127.7.122.68). New cstate: current_term: 13 leader_uuid: "3b34c95a175945b88b17f07fbc650abf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:54.250253  8882 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:54.269403  8884 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.269948  8884 consensus_peers.cc:597] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:54.270342  8884 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.289376  8884 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.306396  8884 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.333881  8884 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.334379  8884 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.346179  9466 raft_consensus.cc:1275] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Refusing update from remote peer bdb96be202c2447586477b2077b7d5bf: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:54.348030 16275 consensus_queue.cc:1048] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:18:54.390259  8884 consensus_peers.cc:597] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:54.393422  8884 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.398322  8884 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.440299  8884 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.440536  9434 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.474592  9434 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.479156  8884 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.484688  9434 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.485970  8884 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.486552  8884 consensus_peers.cc:597] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.579276  9434 consensus_peers.cc:597] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:54.625689  8884 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.636651  9434 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.649510  8882 consensus_peers.cc:597] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.693130  8884 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.704737  8913 raft_consensus.cc:1275] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Refusing update from remote peer 3b34c95a175945b88b17f07fbc650abf: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:18:54.708194 16271 consensus_queue.cc:1048] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:54.756438  8884 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.773113  8882 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:54.775043  8884 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.826182  8884 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:18:54.870939 16294 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:54.872287 16294 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:54.878460 16294 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:54.879084  8882 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:54.886433  8884 consensus_peers.cc:597] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:54.899426  8884 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:54.900007  8884 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:54.900885 16294 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:54.911454  7657 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8865)
W20260709 13:18:54.946287  9432 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:55.006546 16206 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.007251 16206 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.009559 16206 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.014456  8882 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.018122  9432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111) [suppressed 607 similar messages]
W20260709 13:18:55.018968  8884 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.019620  8884 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.022297 16206 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:55.045277 16275 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.045923 16275 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.046890 16271 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.047699 16271 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:55.048180 16275 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:55.050194 16271 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.074817  9434 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:55.077832  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.078397  9432 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.079845 16282 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:55.082585 16206 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.083578 16206 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:55.077791  8882 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.085999 16206 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.103060  8884 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.104755  8884 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:55.105469  8882 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.106098 16206 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:55.113869  8884 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.118247  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.119174 16206 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:55.219727 16271 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.220414 16271 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:55.234678 16271 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.239293  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.243309  9434 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.245345  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.248492 16271 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:55.328728 16275 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.329433 16275 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.331729 16275 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.335495  8882 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.346478 16206 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.347226 16206 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.349835 16206 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.359126  8882 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.361013  8884 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.361624  8884 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.364707 16275 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:55.369632  8884 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.370246  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.371137 16275 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:55.378750 16275 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.379544 16275 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.382030 16275 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.386413  8882 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.405508  8884 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.406607  8884 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.407621 16275 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:55.558102 16294 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.559635 16294 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.563052 16275 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.565667 16275 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.567072 16206 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.569546 16206 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.572065 16206 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:55.574542 16271 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.572435 16294 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:55.577920 16296 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.568991 16275 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:55.575196 16271 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:55.585088 16271 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:55.582472 16206 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.586303 16206 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.589643 16206 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:55.579715 16296 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:55.595058 16296 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:18:55.599426  9434 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.600296  8913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "3b34c95a175945b88b17f07fbc650abf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "bdb96be202c2447586477b2077b7d5bf" is_pre_election: true
I20260709 13:18:55.601166  8913 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b34c95a175945b88b17f07fbc650abf in term 20.
W20260709 13:18:55.602488  9434 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:55.605100  8882 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.605787  8884 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:55.605845  8882 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.607291  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:55.607586  8882 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.608212 16294 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:55.611312  8882 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.612251  8884 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.612787  8884 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.613754 16299 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.616376 16275 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
W20260709 13:18:55.619604  8884 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.620157  8884 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.621240 16299 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:55.617053 16275 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:55.630158  8882 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.632256 16275 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.636358  8882 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.638348  8884 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.638839  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.640303 16275 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:55.642712  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.642184  8884 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.643270  9432 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.643640  8884 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.644387 16275 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:55.645290 16282 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:55.645439  9432 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.646118  9432 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.646849 16282 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:55.649796  8882 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:55.653117  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.674263 16299 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.675096 16299 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.678431 16299 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.682966  8884 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:55.684754  8882 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:55.685340  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.686276 16299 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:55.848308 16299 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.849032 16299 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.851593 16299 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.858965  8882 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:55.863163  8884 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:55.882061  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:55.885895 16275 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:55.886657  8882 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:55.912007  7657 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8865)
W20260709 13:18:55.948194  8882 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:55.969301 16275 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:55.970116 16275 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:55.972210 16275 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:55.975208  9432 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.008625  8884 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:56.012056  8882 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:56.012555  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:56.017676 16299 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.021239 16294 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:56.021963 16294 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:56.024410 16294 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:56.025200 16294 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:56.025849 16294 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:56.028628 16294 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:56.032361  8882 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.033056  8882 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.061365  8884 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:56.062043  8884 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:56.110910  8882 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.147363  9432 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.158277  8882 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:56.159011  8882 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:56.168709  8882 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:56.169234  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:56.173051 16299 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:56.173940 16299 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:56.207036  8882 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.216634  9432 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.217687  8882 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.257112  9432 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.279561  8882 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.338461  8882 consensus_peers.cc:597] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.471764  9432 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.474958  8882 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.483325  8882 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.487550  8882 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.513559  8884 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.538407  9432 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.556628  8884 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.565351  8882 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.566049  8882 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.566730  8882 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.618546  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800091340 after lost signal to thread 7660
W20260709 13:18:56.619729  9489 debug-util.cc:398] Leaking SignalData structure 0x7b080035bc80 after lost signal to thread 8701
W20260709 13:18:56.621117  9489 debug-util.cc:398] Leaking SignalData structure 0x7b0800302880 after lost signal to thread 8942
W20260709 13:18:56.622354  9489 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1660 after lost signal to thread 9492
W20260709 13:18:56.635648  8884 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.654803  8884 consensus_peers.cc:597] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:56.663254  9434 consensus_peers.cc:597] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.682037  8884 consensus_peers.cc:597] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.720986  8884 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.733439  8882 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:56.778333  8884 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.784422  8884 consensus_peers.cc:597] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.788079  8884 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.814189  9434 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.853394  8884 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.854060  8884 consensus_peers.cc:597] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:56.884914  8882 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:56.910797  8884 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.912544  7657 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8865)
W20260709 13:18:56.923458  8884 consensus_peers.cc:597] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.968742  9434 consensus_peers.cc:597] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:18:56.971688  8884 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:56.972384  8884 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.010857  8884 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.071595  8884 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.091930  8884 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.114797 16298 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.115619 16298 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:57.125372  8884 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:57.127731 16298 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.129545  8882 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.130364  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.132537 16298 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:57.136257  8882 consensus_peers.cc:597] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:57.157269  9434 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.182718 16298 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.183676 16298 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:57.185961  9434 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.206624 16298 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.205998  9434 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.211369  8884 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:57.210867  8882 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:33017, user_credentials={real_user=slave}} blocked reactor thread for 62752.9us
I20260709 13:18:57.228451 16298 raft_consensus.cc:493] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.229140 16298 raft_consensus.cc:515] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:57.259704  8884 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:57.256618 16298 leader_election.cc:290] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.269099  8882 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.269593  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.274798 16294 raft_consensus.cc:2749] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:57.311022  8882 leader_election.cc:336] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.311661  8882 leader_election.cc:304] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.315516 16298 raft_consensus.cc:2749] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:57.314693  8884 consensus_peers.cc:597] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.321621  8884 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.333103  8884 consensus_peers.cc:597] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.336773 16298 raft_consensus.cc:493] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.337678 16298 raft_consensus.cc:515] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:57.342267 16298 leader_election.cc:290] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.347015  8882 consensus_peers.cc:597] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:57.352723 16301 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.353420 16301 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:57.369306  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:57.370469  9434 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:57.372028  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.371276 16301 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:57.373637 16296 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:57.377936  8882 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.397290 16301 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.398453 16301 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:18:57.408474  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.409881 16301 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.423748  9434 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:57.424422  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.426370 16301 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:57.437834  8884 leader_election.cc:336] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:57.450423 16296 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.451215 16296 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:57.454180 16296 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.467237  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.439702  8884 leader_election.cc:304] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:57.488322  8884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:32843, user_credentials={real_user=slave}} blocked reactor thread for 50522.5us
I20260709 13:18:57.488943 16298 raft_consensus.cc:2749] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.494943 16294 raft_consensus.cc:493] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.495568 16294 raft_consensus.cc:515] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:57.498330 16294 leader_election.cc:290] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.491657  9434 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:57.501406  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.510450 16301 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:57.529788  8884 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:18:57.533622  8884 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.552376 16298 raft_consensus.cc:493] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.553081 16298 raft_consensus.cc:515] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:57.562944 16298 leader_election.cc:290] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.604764  9432 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:57.606374  8884 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.606846 16294 raft_consensus.cc:493] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.611317 16294 raft_consensus.cc:515] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:57.613883 16294 leader_election.cc:290] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.616238  8884 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:57.622527  8882 leader_election.cc:336] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.625082  8882 leader_election.cc:304] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.629542 16294 raft_consensus.cc:2749] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:57.635964  8884 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:57.643225  8884 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:57.649183  8882 leader_election.cc:336] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.650774  8882 leader_election.cc:304] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.651703 16294 raft_consensus.cc:2749] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:57.656935 16294 raft_consensus.cc:493] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.657660 16294 raft_consensus.cc:515] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } attrs { replace: true } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:57.663868  9468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002c4018f5264a23a9d3f93713b6fffe" candidate_uuid: "bdb96be202c2447586477b2077b7d5bf" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "3b34c95a175945b88b17f07fbc650abf" is_pre_election: true
I20260709 13:18:57.664673  9468 raft_consensus.cc:2468] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdb96be202c2447586477b2077b7d5bf in term 20.
I20260709 13:18:57.660697 16294 leader_election.cc:290] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), 3b34c95a175945b88b17f07fbc650abf (127.7.122.68:45973)
W20260709 13:18:57.686084  8884 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:57.712128  8882 leader_election.cc:336] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.714735  8882 leader_election.cc:304] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.716504 16294 raft_consensus.cc:2749] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:57.737202  8884 consensus_peers.cc:597] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:57.743868 16298 raft_consensus.cc:493] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:57.758261 16298 raft_consensus.cc:515] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:57.760516 16298 leader_election.cc:290] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:57.775460  8882 leader_election.cc:336] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.779456  8882 leader_election.cc:304] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf, bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.782785 16294 raft_consensus.cc:2749] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:57.787627  8884 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:57.840634  8882 leader_election.cc:336] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:57.844328  8882 leader_election.cc:304] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:57.845340 16294 raft_consensus.cc:2749] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:57.919536  7657 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8865)
I20260709 13:18:58.085850 16294 raft_consensus.cc:493] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.086381 16294 raft_consensus.cc:515] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
W20260709 13:18:58.097695  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.097862  8882 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:58.088371 16294 leader_election.cc:290] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.101725  8884 leader_election.cc:336] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:58.104417  8884 leader_election.cc:304] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.105662 16294 raft_consensus.cc:2749] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:58.126204 16294 raft_consensus.cc:493] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.126753 16294 raft_consensus.cc:515] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.133381 16294 leader_election.cc:290] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:58.135804 16294 raft_consensus.cc:493] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.137251 16294 raft_consensus.cc:515] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.139889 16294 leader_election.cc:290] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.145184  8884 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:58.147923  8882 leader_election.cc:336] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:58.148375  8882 leader_election.cc:304] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:58.151227  8882 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:58.152765 16302 raft_consensus.cc:2749] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:58.155720 16302 raft_consensus.cc:493] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.159062 16302 raft_consensus.cc:515] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.163829 16275 raft_consensus.cc:493] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.164389 16275 raft_consensus.cc:515] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.169152 16302 leader_election.cc:290] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:58.171335 16275 leader_election.cc:290] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.174192  8884 leader_election.cc:336] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:58.174711  8884 leader_election.cc:304] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.176455 16275 raft_consensus.cc:2749] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:58.179524  8882 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:58.180186  8882 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:58.184823  8884 leader_election.cc:336] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:58.185356  8884 leader_election.cc:304] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.188655 16275 raft_consensus.cc:2749] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:58.189620  8884 leader_election.cc:336] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:58.190058  8884 leader_election.cc:304] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.192422 16275 raft_consensus.cc:2749] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:18:58.208065  8882 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.249470  8882 consensus_peers.cc:597] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.356665  8652 catalog_manager.cc:4755] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 022d4a4680cb42e4bc9970d8a4f604f1: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:58.400157  9432 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.430812  8882 consensus_peers.cc:597] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.450403  8882 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.487182 16294 raft_consensus.cc:493] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.487783 16294 raft_consensus.cc:515] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.489930 16294 leader_election.cc:290] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.509979  8882 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:58.513527  8884 leader_election.cc:336] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:58.515715  8884 leader_election.cc:304] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:58.516425  8882 consensus_peers.cc:597] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:58.521263 16294 raft_consensus.cc:2749] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:58.523433  8882 consensus_peers.cc:597] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:58.569058  8882 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.605494  8882 consensus_peers.cc:597] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:18:58.607396 16294 raft_consensus.cc:493] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.607949 16294 raft_consensus.cc:515] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.609938 16294 leader_election.cc:290] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.616330  8884 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:58.638352  8882 leader_election.cc:336] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:58.640776  8882 leader_election.cc:304] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.644024 16294 raft_consensus.cc:2749] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:58.655479  8882 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.672497  8882 consensus_peers.cc:597] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.695647  9432 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.698928 16294 raft_consensus.cc:493] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.699473 16294 raft_consensus.cc:515] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.701617 16294 leader_election.cc:290] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.710887  8884 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:58.723362  9432 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.726605  8882 leader_election.cc:336] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:58.727427  8882 leader_election.cc:304] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.728242 16294 raft_consensus.cc:2749] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:58.773662  8882 consensus_peers.cc:597] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:58.813848  9432 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.828078  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
W20260709 13:18:58.871718  8882 consensus_peers.cc:597] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.881225  8882 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:58.917706 16294 raft_consensus.cc:493] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:58.918210 16294 raft_consensus.cc:515] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:58.920104 16294 leader_election.cc:290] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:58.935935  8884 consensus_peers.cc:597] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:58.950735  8882 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.954579  8882 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:58.956099  8884 leader_election.cc:336] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:58.957074  8884 leader_election.cc:304] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:58.960306 16294 raft_consensus.cc:2749] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:18:58.967288  8882 consensus_peers.cc:597] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:18:58.985778  9434 consensus_peers.cc:597] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:59.059753  9432 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.082827  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
W20260709 13:18:59.140193  8884 consensus_peers.cc:597] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:59.151968  8882 consensus_peers.cc:597] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:59.164744  8882 consensus_peers.cc:597] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:59.176039  8884 consensus_peers.cc:597] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:59.188341  8882 consensus_peers.cc:597] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:18:59.204294  9432 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:18:59.216007  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:18:59.217308  7657 tablet_replica.cc:333] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.218546  7657 raft_consensus.cc:2243] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.219515  7657 raft_consensus.cc:2272] T 9d82cf960a5f4fb4acb573fe580b10ed P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.222887  7657 tablet_replica.cc:333] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.223857  7657 raft_consensus.cc:2243] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.225950  7657 raft_consensus.cc:2272] T b0cebd36d7c3434a9e438125a626bf29 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.229216  7657 tablet_replica.cc:333] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.230089  7657 raft_consensus.cc:2243] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.231326  7657 raft_consensus.cc:2272] T f095ec4c4cb343308d8bd14544fe8b4e P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.234762  7657 tablet_replica.cc:333] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.235780  7657 raft_consensus.cc:2243] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.236606  7657 raft_consensus.cc:2272] T 405e426995614183bb2a212fc38e04b0 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.239511  7657 tablet_replica.cc:333] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.240749  7657 raft_consensus.cc:2243] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.242178  7657 raft_consensus.cc:2272] T 2e090a13858f439f934f3a0277b08f18 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.248828  7657 tablet_replica.cc:333] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.250402  7657 raft_consensus.cc:2243] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.250631 16306 raft_consensus.cc:493] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:59.251196 16306 raft_consensus.cc:515] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:59.251663  7657 raft_consensus.cc:2272] T c6f1fe9f34b9476fb981c06a43a1fb1d P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.258663  7657 tablet_replica.cc:333] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.259694  7657 raft_consensus.cc:2243] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.260982  7657 raft_consensus.cc:2272] T af7776ba20a14a499de5919550fdada6 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.266309  7657 tablet_replica.cc:333] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.267190  7657 raft_consensus.cc:2243] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.267968  7657 raft_consensus.cc:2272] T 011917cac276499ba01c77d911c67d8d P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.270236  8884 consensus_peers.cc:597] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:59.270948  9432 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:59.271641  7657 tablet_replica.cc:333] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
W20260709 13:18:59.272437  9434 leader_election.cc:336] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:59.273056  7657 raft_consensus.cc:2243] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.274458  7657 raft_consensus.cc:2272] T 9bd2a06b32904b5db18230a954b8d7fe P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.272178 16306 leader_election.cc:290] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:59.272992  9434 leader_election.cc:304] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:59.278008 16306 raft_consensus.cc:2749] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:59.278800  7657 tablet_replica.cc:333] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.280776  7657 raft_consensus.cc:2243] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.282021  7657 raft_consensus.cc:2272] T 589fb2d6cab941e09bb87a5254bc9d48 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.284921  7657 tablet_replica.cc:333] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
W20260709 13:18:59.285687  8884 consensus_peers.cc:597] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.285764  7657 raft_consensus.cc:2243] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.287256  7657 raft_consensus.cc:2272] T 6e56e66e882c455cb86d4e08fd5555d2 P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.291133  7657 tablet_replica.cc:333] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.292133  7657 raft_consensus.cc:2243] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.293471  7657 raft_consensus.cc:2272] T 512bfb8ae84244418d0107564d88e5bb P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.298799  7657 tablet_replica.cc:333] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.300441  7657 raft_consensus.cc:2243] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.301458  7657 raft_consensus.cc:2272] T 672045bd655a4cbea707258aa0718564 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.306193  7657 tablet_replica.cc:333] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.307989  7657 raft_consensus.cc:2243] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.310027  7657 raft_consensus.cc:2272] T 968e06ae5d2744aeb0b947873b369af8 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.311980  8884 consensus_peers.cc:597] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.313304  7657 tablet_replica.cc:333] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.314435  7657 raft_consensus.cc:2243] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:18:59.315629  8884 consensus_peers.cc:597] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:59.315933  7657 raft_consensus.cc:2272] T 9f42b63da74d4bcf8db95f4956d8d75c P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.317826  9431 consensus_peers.cc:597] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:59.318795  9431 consensus_peers.cc:597] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.322431  7657 tablet_replica.cc:333] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.323369  7657 raft_consensus.cc:2243] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.324609  7657 raft_consensus.cc:2272] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.325261  8884 consensus_peers.cc:597] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:59.333185  7657 tablet_replica.cc:333] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
W20260709 13:18:59.333707  9431 consensus_peers.cc:597] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.334251  7657 raft_consensus.cc:2243] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.335147  7657 raft_consensus.cc:2272] T cbb9c9a8b7c641fb839da3aa2a309c0b P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.338186  7657 tablet_replica.cc:333] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.339125  7657 raft_consensus.cc:2243] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.339901  7657 raft_consensus.cc:2272] T 019a0cde8c994b9a83ff212e5c02437c P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.343308  7657 tablet_replica.cc:333] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.344435  7657 raft_consensus.cc:2243] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.346067  7657 raft_consensus.cc:2272] T 102be8dba78c4bc998ed8bf52775bec5 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.351059  8884 consensus_peers.cc:597] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.351322  7657 tablet_replica.cc:333] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.352648  7657 raft_consensus.cc:2243] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.353345  7657 raft_consensus.cc:2272] T da988855757643ccbb2593bad676d78d P bdb96be202c2447586477b2077b7d5bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.356680  7657 tablet_replica.cc:333] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.357810  7657 raft_consensus.cc:2243] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.358932  7657 raft_consensus.cc:2272] T 2a15a66fec474b05b1f3ad99f61f1104 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.361407  9431 consensus_peers.cc:597] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.361770  7657 tablet_replica.cc:333] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.362825  7657 raft_consensus.cc:2243] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.364109  7657 raft_consensus.cc:2272] T fb4847af9abd4172bff3a603da47325c P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.366844  7657 tablet_replica.cc:333] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.367726  7657 raft_consensus.cc:2243] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.368515  7657 raft_consensus.cc:2272] T 2c10a9719c7f4cf5a813c2dc4c5e3739 P bdb96be202c2447586477b2077b7d5bf [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.371140  7657 tablet_replica.cc:333] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.371951  7657 raft_consensus.cc:2243] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.372514  7657 raft_consensus.cc:2272] T 7689b80937134444a5933a16f9aa7d64 P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.375223  7657 tablet_replica.cc:333] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.376086  7657 raft_consensus.cc:2243] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:59.377120  9434 consensus_peers.cc:597] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.378304  7657 raft_consensus.cc:2272] T af46285a3b87458b8b247dc8610ab80b P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.384490  7657 tablet_replica.cc:333] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.386279  7657 raft_consensus.cc:2243] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.387248  7657 raft_consensus.cc:2272] T 860647fd65b141d8842fde1bd4f9a549 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.390798  7657 tablet_replica.cc:333] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.391604  7657 raft_consensus.cc:2243] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.393652  7657 raft_consensus.cc:2272] T e3373a354d754ec48ac0cc05829af66f P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.396449  7657 tablet_replica.cc:333] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.397277  7657 raft_consensus.cc:2243] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.398962  7657 raft_consensus.cc:2272] T f045ce88a76f4620ad6c717c8245982a P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.401667  7657 tablet_replica.cc:333] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.402510  7657 raft_consensus.cc:2243] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:18:59.402959  9431 consensus_peers.cc:597] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.403403  7657 raft_consensus.cc:2272] T 49a7db9f466c48ccb2c5c350cb6351b3 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.406749  7657 tablet_replica.cc:333] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.407532  7657 raft_consensus.cc:2243] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.409125  7657 raft_consensus.cc:2272] T 2da23dcb2ee347e7a43e2150a082fe62 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.411567 16294 raft_consensus.cc:493] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:59.412231 16294 raft_consensus.cc:515] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:59.413708  7657 tablet_replica.cc:333] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.414569  7657 raft_consensus.cc:2243] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.415125  7657 raft_consensus.cc:2272] T 191959ae05ea40fd8a7fb0e027de5b86 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.415386 16294 leader_election.cc:290] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:59.417901  7657 tablet_replica.cc:333] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.418926  7657 raft_consensus.cc:2243] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.420413  7657 raft_consensus.cc:2272] T f2fb7e71822c4226a7ee8579013bfe9f P bdb96be202c2447586477b2077b7d5bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.423420  7657 tablet_replica.cc:333] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.424196  7657 raft_consensus.cc:2243] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.425469  7657 raft_consensus.cc:2272] T a034d186214a4f03b519e7c03f58788f P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.428290  7657 tablet_replica.cc:333] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
W20260709 13:18:59.428472  8884 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:59.429203  7657 raft_consensus.cc:2243] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.431138  7657 raft_consensus.cc:2272] T 51c7e309721f4da1bcd1626da407d364 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.434093  7657 tablet_replica.cc:333] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.434929  7657 raft_consensus.cc:2243] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.436020 16308 raft_consensus.cc:493] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:59.436239  7657 raft_consensus.cc:2272] T 94e939be989f4d59b1983955951ab90f P bdb96be202c2447586477b2077b7d5bf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.436569 16308 raft_consensus.cc:515] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } }
I20260709 13:18:59.438922 16308 leader_election.cc:290] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
I20260709 13:18:59.439226  7657 tablet_replica.cc:333] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.440095  7657 raft_consensus.cc:2243] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.445787  7657 raft_consensus.cc:2272] T 5380dc645e984447aefd4408bca2f2af P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.447476  8884 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:18:59.449326  8882 leader_election.cc:336] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:59.449468  7657 tablet_replica.cc:333] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.449908  8882 leader_election.cc:304] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:59.450516  7657 raft_consensus.cc:2243] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.450664 16294 raft_consensus.cc:2749] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:59.451434  7657 raft_consensus.cc:2272] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.454548  7657 tablet_replica.cc:333] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.455356  7657 raft_consensus.cc:2243] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.456084  7657 raft_consensus.cc:2272] T 4128699de59a470a9275f001cbd35515 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.456588  8882 leader_election.cc:336] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:18:59.457206  8882 leader_election.cc:304] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bdb96be202c2447586477b2077b7d5bf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
W20260709 13:18:59.457921  8882 raft_consensus.cc:2686] T c4b840458e6048cd9c4444bf516cf39a P bdb96be202c2447586477b2077b7d5bf: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:18:59.458909  7657 tablet_replica.cc:333] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
W20260709 13:18:59.459697  9431 consensus_peers.cc:597] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf -> Peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Couldn't send request to peer bdb96be202c2447586477b2077b7d5bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:59.459853  7657 raft_consensus.cc:2243] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.467069  7657 raft_consensus.cc:2272] T 430f59d9e22342829896b185b2da7cf3 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.470311  7657 tablet_replica.cc:333] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.471252  7657 raft_consensus.cc:2243] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.472481  7657 raft_consensus.cc:2272] T ef624fe5958542fa8714cedf17ca4940 P bdb96be202c2447586477b2077b7d5bf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.475440  7657 tablet_replica.cc:333] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.476336  7657 raft_consensus.cc:2243] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.477519  7657 raft_consensus.cc:2272] T 76badded6ebe4972ad520c819a7fc3ae P bdb96be202c2447586477b2077b7d5bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.480499  7657 tablet_replica.cc:333] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.481393  7657 raft_consensus.cc:2243] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.482296  7657 raft_consensus.cc:2272] T 273b1043e8dc4b13a6a84b35f19ff2a8 P bdb96be202c2447586477b2077b7d5bf [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.484886  9434 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.484941  7657 tablet_replica.cc:333] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.486565  7657 raft_consensus.cc:2243] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.488164  7657 raft_consensus.cc:2272] T ba1bacaaff25445c9eccef8932f745d1 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.490953  7657 tablet_replica.cc:333] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.491690  7657 raft_consensus.cc:2243] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.493032  7657 raft_consensus.cc:2272] T d1d69638bb504813949178c6aee64727 P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.496788  7657 tablet_replica.cc:333] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.499722  7657 raft_consensus.cc:2243] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.500946  7657 raft_consensus.cc:2272] T e3a106d574bc4cfeaa6e7b1240430c4b P bdb96be202c2447586477b2077b7d5bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.504240  7657 tablet_replica.cc:333] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.505064  7657 raft_consensus.cc:2243] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.506235  7657 raft_consensus.cc:2272] T e8a8035ad96048ea978033b357465875 P bdb96be202c2447586477b2077b7d5bf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.509754  7657 tablet_replica.cc:333] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.510676  7657 raft_consensus.cc:2243] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.511965  7657 raft_consensus.cc:2272] T aa48bba2a08c4fcdae35a029b7107f70 P bdb96be202c2447586477b2077b7d5bf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.515040  7657 tablet_replica.cc:333] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.515875  7657 raft_consensus.cc:2243] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.517290  7657 raft_consensus.cc:2272] T 2c71888f7c2e471db00d7e83cf31ebf3 P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.518644  9434 consensus_peers.cc:597] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:18:59.519244  9434 consensus_peers.cc:597] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:18:59.520218  7657 tablet_replica.cc:333] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.521054  7657 raft_consensus.cc:2243] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.522385  7657 raft_consensus.cc:2272] T 8447f76afbaa45b385add1219d08771c P bdb96be202c2447586477b2077b7d5bf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.524943  7657 tablet_replica.cc:333] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.525601  7657 raft_consensus.cc:2243] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.526547  7657 raft_consensus.cc:2272] T 002c4018f5264a23a9d3f93713b6fffe P bdb96be202c2447586477b2077b7d5bf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.529433  7657 tablet_replica.cc:333] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.530062  7657 raft_consensus.cc:2243] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:18:59.531175  7657 raft_consensus.cc:2272] T 022d4a4680cb42e4bc9970d8a4f604f1 P bdb96be202c2447586477b2077b7d5bf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:59.533710  7657 tablet_replica.cc:333] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf: stopping tablet replica
I20260709 13:18:59.534319  7657 raft_consensus.cc:2243] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:59.534996  7657 raft_consensus.cc:2272] T b3f50214a4c94ba0b85876c02e10b9ac P bdb96be202c2447586477b2077b7d5bf [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:59.645727  9434 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Couldn't send request to peer 773340b2958e4af5b2010b902b9e9c04. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:18:59.899747 16309 raft_consensus.cc:493] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:18:59.900339 16309 raft_consensus.cc:515] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:18:59.903388 16309 leader_election.cc:290] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:18:59.906608  9432 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:18:59.907516  9434 leader_election.cc:336] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:18:59.907944  9434 leader_election.cc:304] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:18:59.908710 16309 raft_consensus.cc:2749] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:59.991600  9432 consensus_peers.cc:597] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:00.019680  9432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111) [suppressed 634 similar messages]
I20260709 13:19:00.349612 16309 raft_consensus.cc:493] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.350250 16309 raft_consensus.cc:515] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.352555 16309 leader_election.cc:290] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.374234  9431 leader_election.cc:336] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
W20260709 13:19:00.381626  9434 leader_election.cc:336] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:19:00.382220  9434 leader_election.cc:304] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.383000 16309 raft_consensus.cc:2749] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:00.500543 16309 raft_consensus.cc:493] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 773340b2958e4af5b2010b902b9e9c04)
I20260709 13:19:00.501152 16309 raft_consensus.cc:515] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.503517 16309 leader_election.cc:290] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843)
W20260709 13:19:00.510836  9432 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:19:00.511884  9434 leader_election.cc:336] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:19:00.512392  9434 leader_election.cc:304] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, 773340b2958e4af5b2010b902b9e9c04
I20260709 13:19:00.513614 16309 raft_consensus.cc:2749] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:00.516144  9432 consensus_peers.cc:597] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf -> Peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Couldn't send request to peer 74de73c0f36d4c3aa7a483c7fdb39e4a. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:00.617296 16311 raft_consensus.cc:493] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.617895 16311 raft_consensus.cc:515] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.620711 16311 leader_election.cc:290] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.624099  9431 leader_election.cc:336] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
I20260709 13:19:00.625982  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
W20260709 13:19:00.627123  9434 leader_election.cc:336] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:19:00.627653  9434 leader_election.cc:304] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.628576 16311 raft_consensus.cc:2749] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:00.655930 16311 raft_consensus.cc:493] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.656580 16311 raft_consensus.cc:515] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.661048 16311 leader_election.cc:290] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.663481  9432 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
W20260709 13:19:00.664312  9431 leader_election.cc:336] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
I20260709 13:19:00.664777  9431 leader_election.cc:304] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.665627 16311 raft_consensus.cc:2749] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.680294 16311 raft_consensus.cc:493] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.681030 16311 raft_consensus.cc:515] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "74de73c0f36d4c3aa7a483c7fdb39e4a" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 33017 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.685717 16311 leader_election.cc:290] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
I20260709 13:19:00.686058 16309 raft_consensus.cc:493] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.688711 16309 raft_consensus.cc:515] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
W20260709 13:19:00.691504  9431 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
I20260709 13:19:00.691784 16309 leader_election.cc:290] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.694939  9432 leader_election.cc:336] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:19:00.695544  9432 leader_election.cc:304] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 74de73c0f36d4c3aa7a483c7fdb39e4a, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.696933 16311 raft_consensus.cc:2749] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:00.701660  9434 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:19:00.702291  9431 leader_election.cc:336] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
I20260709 13:19:00.702793  9431 leader_election.cc:304] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.703568 16311 raft_consensus.cc:2749] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:19:00.716785 16309 raft_consensus.cc:493] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.717451 16309 raft_consensus.cc:515] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.719926 16309 leader_election.cc:290] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.725498  9431 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
W20260709 13:19:00.727699  9434 leader_election.cc:336] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
I20260709 13:19:00.728297  9434 leader_election.cc:304] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.729123 16311 raft_consensus.cc:2749] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.745434 16311 raft_consensus.cc:493] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.746163 16311 raft_consensus.cc:515] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.748904 16311 leader_election.cc:290] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.753890  9434 leader_election.cc:336] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:19:00.757110  9431 leader_election.cc:336] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
I20260709 13:19:00.758168 16309 raft_consensus.cc:493] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election (detected failure of leader bdb96be202c2447586477b2077b7d5bf)
I20260709 13:19:00.758754 16309 raft_consensus.cc:515] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "773340b2958e4af5b2010b902b9e9c04" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 32843 } } peers { permanent_uuid: "bdb96be202c2447586477b2077b7d5bf" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 39883 } } peers { permanent_uuid: "3b34c95a175945b88b17f07fbc650abf" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 45973 } attrs { promote: false } }
I20260709 13:19:00.757612  9431 leader_election.cc:304] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.760413 16311 raft_consensus.cc:2749] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:00.760635  7657 tablet_server.cc:179] TabletServer@127.7.122.68:0 shutting down...
I20260709 13:19:00.761366 16309 leader_election.cc:290] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843), bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883)
W20260709 13:19:00.769196  9434 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 773340b2958e4af5b2010b902b9e9c04 (127.7.122.66:32843): Network error: Client connection negotiation failed: client connection to 127.7.122.66:32843: connect: Connection refused (error 111)
W20260709 13:19:00.770025  9431 leader_election.cc:336] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer bdb96be202c2447586477b2077b7d5bf (127.7.122.67:39883): Network error: Client connection negotiation failed: client connection to 127.7.122.67:39883: connect: Connection refused (error 111)
I20260709 13:19:00.770386  9431 leader_election.cc:304] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b34c95a175945b88b17f07fbc650abf; no voters: 773340b2958e4af5b2010b902b9e9c04, bdb96be202c2447586477b2077b7d5bf
I20260709 13:19:00.771037 16309 raft_consensus.cc:2749] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.824826  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:00.825933  7657 tablet_replica.cc:333] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.826905  7657 raft_consensus.cc:2243] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.828100  7657 raft_consensus.cc:2272] T bac07da6a99849fb8f972372c187ee7b P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.830946  7657 tablet_replica.cc:333] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.831820  7657 raft_consensus.cc:2243] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.832613  7657 raft_consensus.cc:2272] T 002c4018f5264a23a9d3f93713b6fffe P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.835601  7657 tablet_replica.cc:333] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.836396  7657 raft_consensus.cc:2243] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.837569  7657 raft_consensus.cc:2272] T a85c28eb5f2e4741b40ca8723a62f870 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.840342  7657 tablet_replica.cc:333] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.841539  7657 raft_consensus.cc:2243] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.842214  7657 raft_consensus.cc:2272] T 51c7e309721f4da1bcd1626da407d364 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.845134  7657 tablet_replica.cc:333] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.845942  7657 raft_consensus.cc:2243] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.847065  7657 raft_consensus.cc:2272] T 430f59d9e22342829896b185b2da7cf3 P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.850291  7657 tablet_replica.cc:333] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.851058  7657 raft_consensus.cc:2243] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.852335  7657 raft_consensus.cc:2272] T c79353780ac54a25bd9999800873bbeb P 3b34c95a175945b88b17f07fbc650abf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.855327  7657 tablet_replica.cc:333] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.856184  7657 raft_consensus.cc:2243] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.857342  7657 raft_consensus.cc:2272] T da988855757643ccbb2593bad676d78d P 3b34c95a175945b88b17f07fbc650abf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.860566  7657 tablet_replica.cc:333] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.861438  7657 raft_consensus.cc:2243] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.862497  7657 raft_consensus.cc:2272] T 5380dc645e984447aefd4408bca2f2af P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.865325  7657 tablet_replica.cc:333] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.866094  7657 raft_consensus.cc:2243] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.867214  7657 raft_consensus.cc:2272] T f2fb7e71822c4226a7ee8579013bfe9f P 3b34c95a175945b88b17f07fbc650abf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.870174  7657 tablet_replica.cc:333] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.871048  7657 raft_consensus.cc:2243] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.872179  7657 raft_consensus.cc:2272] T 282538f07daf4dcdb59352e756a62ba8 P 3b34c95a175945b88b17f07fbc650abf [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.874831  7657 tablet_replica.cc:333] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.875545  7657 raft_consensus.cc:2243] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.876466  7657 raft_consensus.cc:2272] T 2c5dcaab01b5438f9054f5e8fcbd0a5c P 3b34c95a175945b88b17f07fbc650abf [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.879231  7657 tablet_replica.cc:333] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.880038  7657 raft_consensus.cc:2243] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.880929  7657 raft_consensus.cc:2272] T 022d4a4680cb42e4bc9970d8a4f604f1 P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.883868  7657 tablet_replica.cc:333] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.884588  7657 raft_consensus.cc:2243] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.885813  7657 raft_consensus.cc:2272] T 019a0cde8c994b9a83ff212e5c02437c P 3b34c95a175945b88b17f07fbc650abf [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.888597  7657 tablet_replica.cc:333] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.889389  7657 raft_consensus.cc:2243] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.890136  7657 raft_consensus.cc:2272] T c65b41257e7e4b66b28805964b4e7d16 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.892630  7657 tablet_replica.cc:333] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.893420  7657 raft_consensus.cc:2243] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.894553  7657 raft_consensus.cc:2272] T 860647fd65b141d8842fde1bd4f9a549 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.897609  7657 tablet_replica.cc:333] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.898614  7657 raft_consensus.cc:2243] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.899920  7657 raft_consensus.cc:2272] T e3373a354d754ec48ac0cc05829af66f P 3b34c95a175945b88b17f07fbc650abf [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.903878  7657 tablet_replica.cc:333] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.904940  7657 raft_consensus.cc:2243] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.906177  7657 raft_consensus.cc:2272] T 6cc3c0a941c84f1cb4645abc7a09b1e8 P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.909328  7657 tablet_replica.cc:333] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.910100  7657 raft_consensus.cc:2243] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.910903  7657 raft_consensus.cc:2272] T f045ce88a76f4620ad6c717c8245982a P 3b34c95a175945b88b17f07fbc650abf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.913803  7657 tablet_replica.cc:333] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.914561  7657 raft_consensus.cc:2243] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.915647  7657 raft_consensus.cc:2272] T 49a7db9f466c48ccb2c5c350cb6351b3 P 3b34c95a175945b88b17f07fbc650abf [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.918751  7657 tablet_replica.cc:333] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.919535  7657 raft_consensus.cc:2243] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.920184  7657 raft_consensus.cc:2272] T bccdb4728c764cc0a333f593ab71c511 P 3b34c95a175945b88b17f07fbc650abf [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.923733  7657 tablet_replica.cc:333] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.924692  7657 raft_consensus.cc:2243] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.925875  7657 raft_consensus.cc:2272] T af7776ba20a14a499de5919550fdada6 P 3b34c95a175945b88b17f07fbc650abf [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.929867  7657 tablet_replica.cc:333] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.930606  7657 raft_consensus.cc:2243] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:00.931670  7657 raft_consensus.cc:2272] T 405e426995614183bb2a212fc38e04b0 P 3b34c95a175945b88b17f07fbc650abf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.934480  7657 tablet_replica.cc:333] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.935230  7657 raft_consensus.cc:2243] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.935998  7657 raft_consensus.cc:2272] T e3a106d574bc4cfeaa6e7b1240430c4b P 3b34c95a175945b88b17f07fbc650abf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:00.939702  7657 tablet_replica.cc:333] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf: stopping tablet replica
I20260709 13:19:00.941004  7657 raft_consensus.cc:2243] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:00.942500  7657 raft_consensus.cc:2272] T d1d69638bb504813949178c6aee64727 P 3b34c95a175945b88b17f07fbc650abf [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:01.332737  7657 tablet_server.cc:196] TabletServer@127.7.122.68:0 shutdown complete.
I20260709 13:19:01.382601  7657 master.cc:562] Master@127.7.122.126:41961 shutting down...
W20260709 13:19:01.418219  8715 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:19:01.418700  8715 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:01.418954  8715 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:06.582708  8652 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111) [suppressed 51 similar messages]
W20260709 13:19:06.587438  8652 catalog_manager.cc:4755] TS 74de73c0f36d4c3aa7a483c7fdb39e4a (127.7.122.65:33017): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 022d4a4680cb42e4bc9970d8a4f604f1: Network error: Client connection negotiation failed: client connection to 127.7.122.65:33017: connect: Connection refused (error 111)
I20260709 13:19:07.021472  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:07.022555  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:07.022980  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P bea3bb54fdd140bfadbad5c24f3a0fa7: stopping tablet replica
I20260709 13:19:07.201853  7657 master.cc:584] Master@127.7.122.126:41961 shutdown complete.
I20260709 13:19:07.268353  7657 test_util.cc:182] -----------------------------------------------
I20260709 13:19:07.268800  7657 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602883560622-7657-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (239648 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:07.273084  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:36181
I20260709 13:19:07.274498  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:07.281576 16315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.281963 16316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.282665 16318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:07.284446  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:07.288589  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:07.288998  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:07.289201  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603147289185 us; error 0 us; skew 500 ppm
I20260709 13:19:07.290096  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:07.294013  7657 webserver.cc:533] Webserver started at http://127.7.122.126:33187/ using document root <none> and password file <none>
I20260709 13:19:07.294621  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:07.294798  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:07.295145  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:07.296517  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "4f56caaa066745888d5a1da07cac52dc"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.301770  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:07.305816 16323 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.307022  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:19:07.307636  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "4f56caaa066745888d5a1da07cac52dc"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.307968  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:07.347455  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:07.349022  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:07.401162  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:36181
I20260709 13:19:07.401273 16374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:36181 every 8 connection(s)
I20260709 13:19:07.406242 16375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:07.420465 16375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc: Bootstrap starting.
I20260709 13:19:07.426302 16375 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:07.431560 16375 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc: No bootstrap required, opened a new log
I20260709 13:19:07.434284 16375 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f56caaa066745888d5a1da07cac52dc" member_type: VOTER }
I20260709 13:19:07.434787 16375 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:07.435462 16375 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f56caaa066745888d5a1da07cac52dc, State: Initialized, Role: FOLLOWER
I20260709 13:19:07.436306 16375 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f56caaa066745888d5a1da07cac52dc" member_type: VOTER }
I20260709 13:19:07.436817 16375 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:07.437129 16375 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:07.437456 16375 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:07.443452 16375 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f56caaa066745888d5a1da07cac52dc" member_type: VOTER }
I20260709 13:19:07.444157 16375 leader_election.cc:304] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f56caaa066745888d5a1da07cac52dc; no voters: 
I20260709 13:19:07.446049 16375 leader_election.cc:290] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:07.446877 16378 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:07.448642 16378 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 1 LEADER]: Becoming Leader. State: Replica: 4f56caaa066745888d5a1da07cac52dc, State: Running, Role: LEADER
I20260709 13:19:07.449685 16378 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f56caaa066745888d5a1da07cac52dc" member_type: VOTER }
I20260709 13:19:07.450605 16375 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:07.458400 16380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f56caaa066745888d5a1da07cac52dc. Latest consensus state: current_term: 1 leader_uuid: "4f56caaa066745888d5a1da07cac52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f56caaa066745888d5a1da07cac52dc" member_type: VOTER } }
I20260709 13:19:07.458153 16379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f56caaa066745888d5a1da07cac52dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f56caaa066745888d5a1da07cac52dc" member_type: VOTER } }
I20260709 13:19:07.459260 16379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:07.460564 16380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:07.462987 16385 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:07.470228 16385 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:07.471884  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:07.482611 16385 catalog_manager.cc:1383] Generated new cluster ID: 521ac06c40b340f18a21f83aace1b671
I20260709 13:19:07.483115 16385 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:07.517228 16385 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:07.518823 16385 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:07.533553 16385 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc: Generated new TSK 0
I20260709 13:19:07.534268 16385 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:07.540009  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:07.547991 16396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.549263 16397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:07.555799  7657 server_base.cc:1061] running on GCE node
W20260709 13:19:07.556180 16399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:07.558923  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:07.559167  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:07.559300  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603147559288 us; error 0 us; skew 500 ppm
I20260709 13:19:07.559900  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:07.562646  7657 webserver.cc:533] Webserver started at http://127.7.122.65:39459/ using document root <none> and password file <none>
I20260709 13:19:07.563411  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:07.563620  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:07.563882  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:07.565388  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "d663b44309664a8e85e27bcc0804d088"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.572604  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:07.577183 16404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.578437  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:07.578958  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "d663b44309664a8e85e27bcc0804d088"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.579303  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:07.607045  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:07.608757  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:07.611210  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:07.614316  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:07.614554  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.614959  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:07.615149  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.678982  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:46203
I20260709 13:19:07.679416 16466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:46203 every 8 connection(s)
I20260709 13:19:07.687511  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:07.698401 16471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.699947 16472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.705295 16474 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:07.706405  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:07.706863 16467 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36181
I20260709 13:19:07.707352 16467 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:07.708804 16467 heartbeater.cc:507] Master 127.7.122.126:36181 requested a full tablet report, sending...
I20260709 13:19:07.710543  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:07.710811  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:07.710932  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603147710922 us; error 0 us; skew 500 ppm
I20260709 13:19:07.712316  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:07.713162 16340 ts_manager.cc:194] Registered new tserver with Master: d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:07.717171  7657 webserver.cc:533] Webserver started at http://127.7.122.66:37283/ using document root <none> and password file <none>
I20260709 13:19:07.717330 16340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38074
I20260709 13:19:07.717824  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:07.718117  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:07.718391  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:07.721318  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "ec4abbd5c2a54ed19180984efefd22f8"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.729754  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:19:07.735946 16479 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.737165  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:19:07.737691  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "ec4abbd5c2a54ed19180984efefd22f8"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.738118  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:07.759523  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:07.761178  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:07.763144  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:07.766284  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:07.766582  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.766892  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:07.767071  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.819669  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:38173
I20260709 13:19:07.819784 16541 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:38173 every 8 connection(s)
I20260709 13:19:07.826100  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:07.835342 16545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.837080 16546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.839020 16548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:07.839397  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:07.840543  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:19:07.840783 16542 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36181
W20260709 13:19:07.840898  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:07.841444 16542 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:07.841444  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603147841419 us; error 0 us; skew 500 ppm
I20260709 13:19:07.842463 16542 heartbeater.cc:507] Master 127.7.122.126:36181 requested a full tablet report, sending...
I20260709 13:19:07.842664  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:07.844745 16340 ts_manager.cc:194] Registered new tserver with Master: ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:07.845892  7657 webserver.cc:533] Webserver started at http://127.7.122.67:34903/ using document root <none> and password file <none>
I20260709 13:19:07.846660  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:07.846783 16340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38088
I20260709 13:19:07.846941  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:07.847396  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:07.848811  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "df1d541d9e6249978deccff88fdfe1a3"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.853991  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:07.858376 16553 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.859436  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:07.859747  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "df1d541d9e6249978deccff88fdfe1a3"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.860052  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:07.872370  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:07.873785  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:07.875257  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:07.877856  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:07.878064  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.878861  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:07.879050  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.933579  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:33429
I20260709 13:19:07.933724 16615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:33429 every 8 connection(s)
I20260709 13:19:07.938951  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:07.947453 16619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.948678 16620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:07.952139 16622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:07.952710 16616 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36181
I20260709 13:19:07.953248 16616 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:07.954102 16616 heartbeater.cc:507] Master 127.7.122.126:36181 requested a full tablet report, sending...
I20260709 13:19:07.955597  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:07.956723  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:07.957023  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:07.957084 16340 ts_manager.cc:194] Registered new tserver with Master: df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:07.957214  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603147957184 us; error 0 us; skew 500 ppm
I20260709 13:19:07.958110  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:07.958936 16340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38092
I20260709 13:19:07.961019  7657 webserver.cc:533] Webserver started at http://127.7.122.68:36827/ using document root <none> and password file <none>
I20260709 13:19:07.961900  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:07.962092  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:07.962311  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:07.963626  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-3-root/instance:
uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.968463  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:07.973129 16627 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:07.974009  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:07.974469  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-3-root
uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:07.974828  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:07.999058  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:08.000394  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:08.002095  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:08.004572  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:08.004838  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:08.005160  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:08.005347  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:08.055769  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.68:34803
I20260709 13:19:08.055871 16689 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.68:34803 every 8 connection(s)
I20260709 13:19:08.073868 16690 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36181
I20260709 13:19:08.074764 16690 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:08.075721 16690 heartbeater.cc:507] Master 127.7.122.126:36181 requested a full tablet report, sending...
I20260709 13:19:08.078418 16340 ts_manager.cc:194] Registered new tserver with Master: ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:08.079284  7657 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.020116709s
I20260709 13:19:08.079968 16340 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38108
I20260709 13:19:08.119958 16340 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38112:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:08.400214 16507 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6a4f5089ef4bae8a81840ca28efa2e (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:08.401145 16506 tablet_service.cc:1511] Processing CreateTablet for tablet c6fc1bb72e014b8ea956277bc60db8d3 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:08.401887 16507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6a4f5089ef4bae8a81840ca28efa2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.403013 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fc1bb72e014b8ea956277bc60db8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.407624 16432 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6a4f5089ef4bae8a81840ca28efa2e (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:08.409253 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6a4f5089ef4bae8a81840ca28efa2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.414270 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 23ea494524264f8186935c55c5301bd1 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:08.415966 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ea494524264f8186935c55c5301bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.418845 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 97f75167f1ed4f1dad0bb137f05f10ee (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:08.420590 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f75167f1ed4f1dad0bb137f05f10ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.426376 16431 tablet_service.cc:1511] Processing CreateTablet for tablet c6fc1bb72e014b8ea956277bc60db8d3 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:08.426810 16503 tablet_service.cc:1511] Processing CreateTablet for tablet 97929a85900c4b398c9e654088b6fb7d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:08.428156 16431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fc1bb72e014b8ea956277bc60db8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.428393 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97929a85900c4b398c9e654088b6fb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.429560 16502 tablet_service.cc:1511] Processing CreateTablet for tablet 67ba6acf4b9542a6b6578a341ba5006b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:08.431053 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ba6acf4b9542a6b6578a341ba5006b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.435068 16430 tablet_service.cc:1511] Processing CreateTablet for tablet 36c09a4594984fd897c2eca96506b208 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:08.436930 16430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c09a4594984fd897c2eca96506b208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.443161 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 7e54c35c1a9c48d6bf87b46b0f40d984 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:08.445138 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e54c35c1a9c48d6bf87b46b0f40d984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.446753 16429 tablet_service.cc:1511] Processing CreateTablet for tablet 97f75167f1ed4f1dad0bb137f05f10ee (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:08.448530 16429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f75167f1ed4f1dad0bb137f05f10ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.451424 16500 tablet_service.cc:1511] Processing CreateTablet for tablet a8e78b7c021a4e4eb0e85bcb9b573bf9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:08.455574 16499 tablet_service.cc:1511] Processing CreateTablet for tablet f66d091e1e2a4930ae11b17b39cde541 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:08.458525 16498 tablet_service.cc:1511] Processing CreateTablet for tablet e727763fa55140febaf02de70b136741 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:08.460968 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e78b7c021a4e4eb0e85bcb9b573bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.463248 16498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e727763fa55140febaf02de70b136741. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:08.468343 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:08.469662 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66d091e1e2a4930ae11b17b39cde541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.473541 16503 tablet_service.cc:1511] Processing CreateTablet for tablet f1c2736d94d445fc991f12646b12edc2 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:08.477706 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c2736d94d445fc991f12646b12edc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.485296 16428 tablet_service.cc:1511] Processing CreateTablet for tablet 97929a85900c4b398c9e654088b6fb7d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:08.486941 16428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97929a85900c4b398c9e654088b6fb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.491386 16427 tablet_service.cc:1511] Processing CreateTablet for tablet 7765fb52e7dc43a4a4ea5c29cd4ae2b5 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:08.494323 16427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7765fb52e7dc43a4a4ea5c29cd4ae2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.495170 16426 tablet_service.cc:1511] Processing CreateTablet for tablet 7e54c35c1a9c48d6bf87b46b0f40d984 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:08.497136 16426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e54c35c1a9c48d6bf87b46b0f40d984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.498282 16425 tablet_service.cc:1511] Processing CreateTablet for tablet a8e78b7c021a4e4eb0e85bcb9b573bf9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:08.500129 16425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e78b7c021a4e4eb0e85bcb9b573bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.506623 16424 tablet_service.cc:1511] Processing CreateTablet for tablet cd0e5e0193fb4247b33d41948838a10b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:08.508759 16424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0e5e0193fb4247b33d41948838a10b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.514971 16423 tablet_service.cc:1511] Processing CreateTablet for tablet e727763fa55140febaf02de70b136741 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:08.516651 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e727763fa55140febaf02de70b136741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.523658 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 7033b0b5479941d1baab89153f09dcde (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:08.531095 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7033b0b5479941d1baab89153f09dcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.536028 16502 tablet_service.cc:1511] Processing CreateTablet for tablet ae01c3ebc7e44b90bb66c407f8969381 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:08.528584 16503 tablet_service.cc:1511] Processing CreateTablet for tablet 9b55c6dbc8124cd78b036f8b92987ab1 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:08.537779 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae01c3ebc7e44b90bb66c407f8969381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.555538 16431 tablet_service.cc:1511] Processing CreateTablet for tablet f1c2736d94d445fc991f12646b12edc2 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:08.555905 16507 tablet_service.cc:1511] Processing CreateTablet for tablet 3520d3184b6a4c918fe43f5109f4914b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:08.560770 16711 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:08.560948 16431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c2736d94d445fc991f12646b12edc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.566274 16432 tablet_service.cc:1511] Processing CreateTablet for tablet d4652fa932d845a7b78a8a57edc661fd (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:08.567836 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4652fa932d845a7b78a8a57edc661fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.569589 16426 tablet_service.cc:1511] Processing CreateTablet for tablet 7033b0b5479941d1baab89153f09dcde (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:08.566332 16710 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:08.585239 16426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7033b0b5479941d1baab89153f09dcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.586437 16655 tablet_service.cc:1511] Processing CreateTablet for tablet c6fc1bb72e014b8ea956277bc60db8d3 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:08.588240 16655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fc1bb72e014b8ea956277bc60db8d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.594266 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 23ea494524264f8186935c55c5301bd1 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:08.595950 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ea494524264f8186935c55c5301bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.597448 16499 tablet_service.cc:1511] Processing CreateTablet for tablet b6b6908daa7d470d9390a5833ea96825 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:08.598245 16652 tablet_service.cc:1511] Processing CreateTablet for tablet 97929a85900c4b398c9e654088b6fb7d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:08.598856 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6a4f5089ef4bae8a81840ca28efa2e (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:08.601423 16580 tablet_service.cc:1511] Processing CreateTablet for tablet 36c09a4594984fd897c2eca96506b208 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:08.602182 16650 tablet_service.cc:1511] Processing CreateTablet for tablet 67ba6acf4b9542a6b6578a341ba5006b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:08.592398 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 36c09a4594984fd897c2eca96506b208 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:08.600178 16651 tablet_service.cc:1511] Processing CreateTablet for tablet 7765fb52e7dc43a4a4ea5c29cd4ae2b5 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:08.610627 16498 tablet_service.cc:1511] Processing CreateTablet for tablet 2a364606015a43f090b7dd314f4bdd35 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:08.611794 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ba6acf4b9542a6b6578a341ba5006b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.612563 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c09a4594984fd897c2eca96506b208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.613739 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c09a4594984fd897c2eca96506b208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.616029 16651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7765fb52e7dc43a4a4ea5c29cd4ae2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.618256 16578 tablet_service.cc:1511] Processing CreateTablet for tablet 97f75167f1ed4f1dad0bb137f05f10ee (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:08.619928 16578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f75167f1ed4f1dad0bb137f05f10ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.621690 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97929a85900c4b398c9e654088b6fb7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.623155 16506 tablet_service.cc:1511] Processing CreateTablet for tablet a4b78e2e576a46488776de50f005b8cf (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:08.625649 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6a4f5089ef4bae8a81840ca28efa2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.604377 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b55c6dbc8124cd78b036f8b92987ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.610208 16649 tablet_service.cc:1511] Processing CreateTablet for tablet a8e78b7c021a4e4eb0e85bcb9b573bf9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:08.629956 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8e78b7c021a4e4eb0e85bcb9b573bf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.632447 16574 tablet_service.cc:1511] Processing CreateTablet for tablet cd0e5e0193fb4247b33d41948838a10b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:08.634641 16574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0e5e0193fb4247b33d41948838a10b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.634991 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 7765fb52e7dc43a4a4ea5c29cd4ae2b5 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:08.637467 16498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a364606015a43f090b7dd314f4bdd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.638173 16507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3520d3184b6a4c918fe43f5109f4914b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.638687 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 67ba6acf4b9542a6b6578a341ba5006b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:08.640224 16572 tablet_service.cc:1511] Processing CreateTablet for tablet e727763fa55140febaf02de70b136741 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:08.641218 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b6908daa7d470d9390a5833ea96825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.641568 16575 tablet_service.cc:1511] Processing CreateTablet for tablet 7e54c35c1a9c48d6bf87b46b0f40d984 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:08.638695 16573 tablet_service.cc:1511] Processing CreateTablet for tablet f66d091e1e2a4930ae11b17b39cde541 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:08.643456 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 23ea494524264f8186935c55c5301bd1 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:08.647886 16648 tablet_service.cc:1511] Processing CreateTablet for tablet cd0e5e0193fb4247b33d41948838a10b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:08.651012 16647 tablet_service.cc:1511] Processing CreateTablet for tablet f66d091e1e2a4930ae11b17b39cde541 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:08.652849 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7765fb52e7dc43a4a4ea5c29cd4ae2b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.653685 16575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e54c35c1a9c48d6bf87b46b0f40d984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.655020 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67ba6acf4b9542a6b6578a341ba5006b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.655794 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ea494524264f8186935c55c5301bd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.653720 16647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66d091e1e2a4930ae11b17b39cde541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.657194 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd0e5e0193fb4247b33d41948838a10b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.656973 16431 tablet_service.cc:1511] Processing CreateTablet for tablet ae01c3ebc7e44b90bb66c407f8969381 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:08.657707 16572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e727763fa55140febaf02de70b136741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.658624 16431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae01c3ebc7e44b90bb66c407f8969381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.658715 16573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66d091e1e2a4930ae11b17b39cde541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.702651 16646 tablet_service.cc:1511] Processing CreateTablet for tablet f1c2736d94d445fc991f12646b12edc2 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:08.704355 16646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c2736d94d445fc991f12646b12edc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.719503 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b78e2e576a46488776de50f005b8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.721547 16430 tablet_service.cc:1511] Processing CreateTablet for tablet be1c7cede5d74f08be30f9213dc321fb (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:08.722491 16467 heartbeater.cc:499] Master 127.7.122.126:36181 was elected leader, sending a full tablet report...
I20260709 13:19:08.723055 16430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1c7cede5d74f08be30f9213dc321fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.727061 16425 tablet_service.cc:1511] Processing CreateTablet for tablet b6b6908daa7d470d9390a5833ea96825 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:08.728717 16425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b6908daa7d470d9390a5833ea96825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.731926 16429 tablet_service.cc:1511] Processing CreateTablet for tablet 5fff1e4985884cd4a18bde63d6ba1a9c (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:08.733572 16428 tablet_service.cc:1511] Processing CreateTablet for tablet 2a364606015a43f090b7dd314f4bdd35 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:08.761029 16711 tablet_bootstrap.cc:700] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Time spent opening tablet: real 0.141s	user 0.003s	sys 0.000s
I20260709 13:19:08.761934 16711 tablet_bootstrap.cc:654] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.773041 16426 tablet_service.cc:1511] Processing CreateTablet for tablet 22db0f6fc6e1413fb75245a35d2e4cef (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:08.777477 16651 tablet_service.cc:1511] Processing CreateTablet for tablet b6b6908daa7d470d9390a5833ea96825 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:08.779001 16651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b6908daa7d470d9390a5833ea96825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.794155 16429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fff1e4985884cd4a18bde63d6ba1a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.798323 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 3520d3184b6a4c918fe43f5109f4914b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:08.799819 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3520d3184b6a4c918fe43f5109f4914b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.803977 16428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a364606015a43f090b7dd314f4bdd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.767681 16710 tablet_bootstrap.cc:654] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:08.806088 16426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22db0f6fc6e1413fb75245a35d2e4cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.819209 16646 tablet_service.cc:1511] Processing CreateTablet for tablet ae01c3ebc7e44b90bb66c407f8969381 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:08.823006 16646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae01c3ebc7e44b90bb66c407f8969381. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.824396 16424 tablet_service.cc:1511] Processing CreateTablet for tablet e49520220f904c3eb4c608cc67bc6533 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:08.826548 16424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e49520220f904c3eb4c608cc67bc6533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.846448 16507 tablet_service.cc:1511] Processing CreateTablet for tablet e49520220f904c3eb4c608cc67bc6533 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:08.847886 16507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e49520220f904c3eb4c608cc67bc6533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.850061 16542 heartbeater.cc:499] Master 127.7.122.126:36181 was elected leader, sending a full tablet report...
I20260709 13:19:08.868995 16649 tablet_service.cc:1511] Processing CreateTablet for tablet d4652fa932d845a7b78a8a57edc661fd (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:08.871798 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4652fa932d845a7b78a8a57edc661fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.886219 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 22db0f6fc6e1413fb75245a35d2e4cef (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:08.898005 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22db0f6fc6e1413fb75245a35d2e4cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.899747 16423 tablet_service.cc:1511] Processing CreateTablet for tablet 76f0c5b50daa4f20ba7f0bb8daedee02 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:08.909821 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f0c5b50daa4f20ba7f0bb8daedee02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.924185 16425 tablet_service.cc:1511] Processing CreateTablet for tablet ccf47a28b4474e56ba716e2826c931a3 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:08.925848 16425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf47a28b4474e56ba716e2826c931a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.930552 16502 tablet_service.cc:1511] Processing CreateTablet for tablet 1c58974f33d54a1f9028ee4990d3bb18 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:08.932389 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c58974f33d54a1f9028ee4990d3bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.934083 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 9b55c6dbc8124cd78b036f8b92987ab1 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:08.898461 16652 tablet_service.cc:1511] Processing CreateTablet for tablet be1c7cede5d74f08be30f9213dc321fb (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:08.903335 16575 tablet_service.cc:1511] Processing CreateTablet for tablet d4652fa932d845a7b78a8a57edc661fd (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:08.903934 16428 tablet_service.cc:1511] Processing CreateTablet for tablet 6e667d5b79d2444a91b6666d783dc895 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:08.942845 16428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e667d5b79d2444a91b6666d783dc895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.950048 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b55c6dbc8124cd78b036f8b92987ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.967645 16616 heartbeater.cc:499] Master 127.7.122.126:36181 was elected leader, sending a full tablet report...
I20260709 13:19:08.960150 16655 tablet_service.cc:1511] Processing CreateTablet for tablet 5fff1e4985884cd4a18bde63d6ba1a9c (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:08.974646 16711 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:08.975237 16711 ts_tablet_manager.cc:1403] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.415s	user 0.014s	sys 0.007s
I20260709 13:19:08.976390 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 3520d3184b6a4c918fe43f5109f4914b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:08.978686 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 5fff1e4985884cd4a18bde63d6ba1a9c (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:08.942588 16506 tablet_service.cc:1511] Processing CreateTablet for tablet 6e667d5b79d2444a91b6666d783dc895 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:08.981523 16575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4652fa932d845a7b78a8a57edc661fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.993770 16715 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:08.994745 16430 tablet_service.cc:1511] Processing CreateTablet for tablet f44d7f44495e443684c23f4af9192b0b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:08.996145 16430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44d7f44495e443684c23f4af9192b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:08.996560 16646 tablet_service.cc:1511] Processing CreateTablet for tablet a4b78e2e576a46488776de50f005b8cf (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:09.003361 16580 tablet_service.cc:1511] Processing CreateTablet for tablet 9b55c6dbc8124cd78b036f8b92987ab1 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:09.005115 16712 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:09.006922 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1c7cede5d74f08be30f9213dc321fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.008471 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 7033b0b5479941d1baab89153f09dcde (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:09.009359 16710 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:09.009956 16710 ts_tablet_manager.cc:1403] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.444s	user 0.023s	sys 0.016s
I20260709 13:19:09.011849 16500 tablet_service.cc:1511] Processing CreateTablet for tablet 6e444695debf458f83b39578e6b6d31d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:09.013238 16655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fff1e4985884cd4a18bde63d6ba1a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.014950 16498 tablet_service.cc:1511] Processing CreateTablet for tablet ccf47a28b4474e56ba716e2826c931a3 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:09.018213 16499 tablet_service.cc:1511] Processing CreateTablet for tablet 67d82bece8c0482f890496c02af54926 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:09.015575 16646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b78e2e576a46488776de50f005b8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.020848 16424 tablet_service.cc:1511] Processing CreateTablet for tablet 67d82bece8c0482f890496c02af54926 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:09.025813 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e667d5b79d2444a91b6666d783dc895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.025498 16432 tablet_service.cc:1511] Processing CreateTablet for tablet ab608fbd45fe408b9eb49f4fabeb9aef (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:09.041075 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab608fbd45fe408b9eb49f4fabeb9aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.043758 16712 tablet_bootstrap.cc:654] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.030143 16507 tablet_service.cc:1511] Processing CreateTablet for tablet ab608fbd45fe408b9eb49f4fabeb9aef (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:09.046267 16648 tablet_service.cc:1511] Processing CreateTablet for tablet e49520220f904c3eb4c608cc67bc6533 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:09.048038 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e49520220f904c3eb4c608cc67bc6533. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.048460 16424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d82bece8c0482f890496c02af54926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.052831 16503 tablet_service.cc:1511] Processing CreateTablet for tablet 401e752e0f07412eb1f2506a3d7e942a (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:09.054687 16573 tablet_service.cc:1511] Processing CreateTablet for tablet a4b78e2e576a46488776de50f005b8cf (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:09.038450 16710 raft_consensus.cc:359] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.065418 16710 raft_consensus.cc:385] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.065505 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3520d3184b6a4c918fe43f5109f4914b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.069567 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fff1e4985884cd4a18bde63d6ba1a9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.071661 16650 tablet_service.cc:1511] Processing CreateTablet for tablet 76f0c5b50daa4f20ba7f0bb8daedee02 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:09.073262 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7033b0b5479941d1baab89153f09dcde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.075309 16505 tablet_service.cc:1511] Processing CreateTablet for tablet e64cf57688fb4b35b7754c1f3083ba13 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:09.076797 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64cf57688fb4b35b7754c1f3083ba13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.077422 16573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b78e2e576a46488776de50f005b8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.078401 16423 tablet_service.cc:1511] Processing CreateTablet for tablet e64cf57688fb4b35b7754c1f3083ba13 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:09.082604 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64cf57688fb4b35b7754c1f3083ba13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.083178 16710 raft_consensus.cc:740] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.090006 16710 consensus_queue.cc:260] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.093427 16578 tablet_service.cc:1511] Processing CreateTablet for tablet 76f0c5b50daa4f20ba7f0bb8daedee02 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:09.095589 16574 tablet_service.cc:1511] Processing CreateTablet for tablet be1c7cede5d74f08be30f9213dc321fb (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:09.102201 16426 tablet_service.cc:1511] Processing CreateTablet for tablet 52a6c0c65b0142fb8554a775fa3f87c6 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:09.103973 16426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a6c0c65b0142fb8554a775fa3f87c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.106493 16429 tablet_service.cc:1511] Processing CreateTablet for tablet 72af2df1d2c54a47a37d3f35a497d2c9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:09.108040 16429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72af2df1d2c54a47a37d3f35a497d2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.111797 16647 tablet_service.cc:1511] Processing CreateTablet for tablet 1c58974f33d54a1f9028ee4990d3bb18 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:09.121232 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f0c5b50daa4f20ba7f0bb8daedee02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.130012 16710 ts_tablet_manager.cc:1434] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.117s	user 0.009s	sys 0.001s
I20260709 13:19:09.132550 16710 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:09.136473 16652 tablet_service.cc:1511] Processing CreateTablet for tablet ccf47a28b4474e56ba716e2826c931a3 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:09.138002 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf47a28b4474e56ba716e2826c931a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.079252 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 22db0f6fc6e1413fb75245a35d2e4cef (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:09.084208 16690 heartbeater.cc:499] Master 127.7.122.126:36181 was elected leader, sending a full tablet report...
I20260709 13:19:09.079380 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401e752e0f07412eb1f2506a3d7e942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.149618 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d82bece8c0482f890496c02af54926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.153316 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e444695debf458f83b39578e6b6d31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.018667 16711 raft_consensus.cc:359] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:09.157106 16711 raft_consensus.cc:385] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.157490 16711 raft_consensus.cc:740] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.158687 16654 tablet_service.cc:1511] Processing CreateTablet for tablet f44d7f44495e443684c23f4af9192b0b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:09.158592 16711 consensus_queue.cc:260] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:08.972420 16572 tablet_service.cc:1511] Processing CreateTablet for tablet 2a364606015a43f090b7dd314f4bdd35 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:09.085325 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b55c6dbc8124cd78b036f8b92987ab1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.162663 16578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f0c5b50daa4f20ba7f0bb8daedee02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.166302 16572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a364606015a43f090b7dd314f4bdd35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.167991 16647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c58974f33d54a1f9028ee4990d3bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.173321 16498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf47a28b4474e56ba716e2826c931a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.177544 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22db0f6fc6e1413fb75245a35d2e4cef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.182538 16712 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:09.183277 16712 ts_tablet_manager.cc:1403] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.202s	user 0.018s	sys 0.008s
I20260709 13:19:09.189353 16574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be1c7cede5d74f08be30f9213dc321fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.176743 16507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab608fbd45fe408b9eb49f4fabeb9aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.198503 16712 raft_consensus.cc:359] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:09.199705 16712 raft_consensus.cc:385] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.200070 16712 raft_consensus.cc:740] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.204317 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 52a6c0c65b0142fb8554a775fa3f87c6 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:09.205827 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a6c0c65b0142fb8554a775fa3f87c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.215111 16430 tablet_service.cc:1511] Processing CreateTablet for tablet 7370e1984b694aa99dce543ee5fffbad (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:09.220755 16430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7370e1984b694aa99dce543ee5fffbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.216109 16712 consensus_queue.cc:260] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:09.233615 16649 tablet_service.cc:1511] Processing CreateTablet for tablet ab608fbd45fe408b9eb49f4fabeb9aef (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:09.235469 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab608fbd45fe408b9eb49f4fabeb9aef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.247795 16426 tablet_service.cc:1511] Processing CreateTablet for tablet 7036dbae781d42c997f89fb211d4da89 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:09.249384 16426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7036dbae781d42c997f89fb211d4da89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.250902 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 07fd7d385a584bb7b88bfc35cd380c4e (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:09.253983 16506 tablet_service.cc:1511] Processing CreateTablet for tablet 7036dbae781d42c997f89fb211d4da89 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:09.176528 16651 tablet_service.cc:1511] Processing CreateTablet for tablet 6e444695debf458f83b39578e6b6d31d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:09.271970 16504 tablet_service.cc:1511] Processing CreateTablet for tablet ad9f159848bf47c0bb6f68a580087fcc (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:09.256801 16710 tablet_bootstrap.cc:654] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.307024 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44d7f44495e443684c23f4af9192b0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.275178 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fd7d385a584bb7b88bfc35cd380c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.307924 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9f159848bf47c0bb6f68a580087fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.311687 16647 tablet_service.cc:1511] Processing CreateTablet for tablet 72af2df1d2c54a47a37d3f35a497d2c9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:09.294189 16715 tablet_bootstrap.cc:654] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.314168 16651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e444695debf458f83b39578e6b6d31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.314168 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7036dbae781d42c997f89fb211d4da89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.273027 16432 tablet_service.cc:1511] Processing CreateTablet for tablet ad9f159848bf47c0bb6f68a580087fcc (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:09.324352 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9f159848bf47c0bb6f68a580087fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.324522 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 1c58974f33d54a1f9028ee4990d3bb18 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:09.326330 16424 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed35d652d57432dad826fd2eb756c7b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 13:19:09.327253 16543 tablet.cc:2406] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:09.327852 16646 tablet_service.cc:1511] Processing CreateTablet for tablet 401e752e0f07412eb1f2506a3d7e942a (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:09.331727 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 6e667d5b79d2444a91b6666d783dc895 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:09.345435 16503 tablet_service.cc:1511] Processing CreateTablet for tablet cfedb410dfa649a4a8f9436fffc8994c (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:09.346982 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfedb410dfa649a4a8f9436fffc8994c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.349967 16712 ts_tablet_manager.cc:1434] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.166s	user 0.020s	sys 0.003s
I20260709 13:19:09.351128 16712 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:09.326347 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c58974f33d54a1f9028ee4990d3bb18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.327876 16424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed35d652d57432dad826fd2eb756c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.357360 16647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72af2df1d2c54a47a37d3f35a497d2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.366459 16655 tablet_service.cc:1511] Processing CreateTablet for tablet 52a6c0c65b0142fb8554a775fa3f87c6 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:09.381178 16646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401e752e0f07412eb1f2506a3d7e942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.385484 16655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52a6c0c65b0142fb8554a775fa3f87c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.385141 16647 tablet_service.cc:1511] Processing CreateTablet for tablet 07fd7d385a584bb7b88bfc35cd380c4e (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:09.385561 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 7370e1984b694aa99dce543ee5fffbad (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:09.386811 16647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fd7d385a584bb7b88bfc35cd380c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.397887 16711 ts_tablet_manager.cc:1434] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.422s	user 0.012s	sys 0.012s
I20260709 13:19:09.399791 16652 tablet_service.cc:1511] Processing CreateTablet for tablet ad9f159848bf47c0bb6f68a580087fcc (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:09.366851 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e667d5b79d2444a91b6666d783dc895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.405194 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7370e1984b694aa99dce543ee5fffbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.406033 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed35d652d57432dad826fd2eb756c7b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:09.407562 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed35d652d57432dad826fd2eb756c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.409614 16647 tablet_service.cc:1511] Processing CreateTablet for tablet cfedb410dfa649a4a8f9436fffc8994c (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:09.413611 16711 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:09.423593 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 6e444695debf458f83b39578e6b6d31d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:09.425482 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e444695debf458f83b39578e6b6d31d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.409741 16423 tablet_service.cc:1511] Processing CreateTablet for tablet 37783a4d91d641869b5677b3fab1a0ee (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:09.428722 16574 tablet_service.cc:1511] Processing CreateTablet for tablet 67d82bece8c0482f890496c02af54926 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:09.432451 16574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d82bece8c0482f890496c02af54926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.433277 16647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfedb410dfa649a4a8f9436fffc8994c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.446610 16575 tablet_service.cc:1511] Processing CreateTablet for tablet 401e752e0f07412eb1f2506a3d7e942a (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:09.420188 16580 tablet_service.cc:1511] Processing CreateTablet for tablet f44d7f44495e443684c23f4af9192b0b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:09.441211 16717 raft_consensus.cc:493] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.448659 16575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 401e752e0f07412eb1f2506a3d7e942a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.451261 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37783a4d91d641869b5677b3fab1a0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.468338 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9f159848bf47c0bb6f68a580087fcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.465596 16717 raft_consensus.cc:515] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.469449 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44d7f44495e443684c23f4af9192b0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:09.475520 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:09.428661 16572 tablet_service.cc:1511] Processing CreateTablet for tablet 72af2df1d2c54a47a37d3f35a497d2c9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:09.476651 16715 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:09.477380 16715 ts_tablet_manager.cc:1403] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.484s	user 0.020s	sys 0.015s
I20260709 13:19:09.477705 16572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72af2df1d2c54a47a37d3f35a497d2c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.478721 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 7370e1984b694aa99dce543ee5fffbad (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:09.480171 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7370e1984b694aa99dce543ee5fffbad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.482111 16715 raft_consensus.cc:359] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.483119 16715 raft_consensus.cc:385] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.482712 16711 tablet_bootstrap.cc:654] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.495682 16715 raft_consensus.cc:740] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.503122 16498 tablet_service.cc:1511] Processing CreateTablet for tablet 37783a4d91d641869b5677b3fab1a0ee (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:09.515267 16498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37783a4d91d641869b5677b3fab1a0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.448472 16573 tablet_service.cc:1511] Processing CreateTablet for tablet e64cf57688fb4b35b7754c1f3083ba13 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:09.499217 16717 leader_election.cc:290] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:09.531775 16650 tablet_service.cc:1511] Processing CreateTablet for tablet a68f1fff79c4430e881d7b675d2d5541 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:09.533273 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68f1fff79c4430e881d7b675d2d5541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.497887 16715 consensus_queue.cc:260] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.540033 16426 tablet_service.cc:1511] Processing CreateTablet for tablet a68f1fff79c4430e881d7b675d2d5541 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:09.541567 16426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68f1fff79c4430e881d7b675d2d5541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.557418 16719 raft_consensus.cc:493] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.558113 16719 raft_consensus.cc:515] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:09.560393 16710 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:09.561058 16710 ts_tablet_manager.cc:1403] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.429s	user 0.007s	sys 0.018s
I20260709 13:19:09.577075 16719 leader_election.cc:290] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:09.576148 16573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64cf57688fb4b35b7754c1f3083ba13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.589766 16429 tablet_service.cc:1511] Processing CreateTablet for tablet 41ef175e12f7452e9bced9499cd84b9f (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:09.606850 16429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ef175e12f7452e9bced9499cd84b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.593428 16655 tablet_service.cc:1511] Processing CreateTablet for tablet 41ef175e12f7452e9bced9499cd84b9f (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:09.620523 16655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ef175e12f7452e9bced9499cd84b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.625085 16503 tablet_service.cc:1511] Processing CreateTablet for tablet a68f1fff79c4430e881d7b675d2d5541 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:09.626580 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a68f1fff79c4430e881d7b675d2d5541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.598668 16578 tablet_service.cc:1511] Processing CreateTablet for tablet 07fd7d385a584bb7b88bfc35cd380c4e (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:09.660097 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf203eb6e6f4850899481145884643a (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:09.666688 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf203eb6e6f4850899481145884643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.679157 16710 raft_consensus.cc:359] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:09.698866 16710 raft_consensus.cc:385] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.699254 16710 raft_consensus.cc:740] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.700030 16710 consensus_queue.cc:260] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:09.705754 16712 tablet_bootstrap.cc:654] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:09.690873 16326 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 69097.5us
I20260709 13:19:09.737016 16432 tablet_service.cc:1511] Processing CreateTablet for tablet e322abcf02184f63b716976eecccf24f (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:09.738574 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e322abcf02184f63b716976eecccf24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.739089 16498 tablet_service.cc:1511] Processing CreateTablet for tablet e322abcf02184f63b716976eecccf24f (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:09.741274 16498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e322abcf02184f63b716976eecccf24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.748093 16710 ts_tablet_manager.cc:1434] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.187s	user 0.009s	sys 0.000s
I20260709 13:19:09.753322 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:09.754513 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:09.762455 16710 tablet_bootstrap.cc:492] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
W20260709 13:19:09.765019 16631 leader_election.cc:343] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.757627 16578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fd7d385a584bb7b88bfc35cd380c4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:09.766956 16629 leader_election.cc:343] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.767539 16718 raft_consensus.cc:493] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.767468 16629 leader_election.cc:304] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:09.758251 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:09.768546 16718 raft_consensus.cc:515] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:09.770998 16482 leader_election.cc:343] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.759305 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf203eb6e6f4850899481145884643a (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:09.772379 16718 leader_election.cc:290] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:09.760406 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 7036dbae781d42c997f89fb211d4da89 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:09.776432 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7036dbae781d42c997f89fb211d4da89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.777057 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf203eb6e6f4850899481145884643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.778499 16711 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:09.779559 16711 ts_tablet_manager.cc:1403] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.366s	user 0.021s	sys 0.014s
I20260709 13:19:09.773479 16719 raft_consensus.cc:2749] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:09.791105 16715 ts_tablet_manager.cc:1434] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.313s	user 0.018s	sys 0.048s
I20260709 13:19:09.806417 16715 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:09.809782 16575 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed35d652d57432dad826fd2eb756c7b (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:09.811915 16711 raft_consensus.cc:359] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.838558 16423 tablet_service.cc:1511] Processing CreateTablet for tablet b817e005d140481c9f6ad4b49f1f0837 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:09.841465 16572 tablet_service.cc:1511] Processing CreateTablet for tablet 37783a4d91d641869b5677b3fab1a0ee (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:09.843045 16572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37783a4d91d641869b5677b3fab1a0ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.846809 16575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed35d652d57432dad826fd2eb756c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.847432 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 41ef175e12f7452e9bced9499cd84b9f (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:09.850697 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 3cf203eb6e6f4850899481145884643a (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:09.826598 16711 raft_consensus.cc:385] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.852725 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ef175e12f7452e9bced9499cd84b9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.861063 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b817e005d140481c9f6ad4b49f1f0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.855104 16711 raft_consensus.cc:740] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:09.884509 16646 tablet_service.cc:1511] Processing CreateTablet for tablet b817e005d140481c9f6ad4b49f1f0837 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:09.886059 16646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b817e005d140481c9f6ad4b49f1f0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.887953 16580 tablet_service.cc:1511] Processing CreateTablet for tablet e322abcf02184f63b716976eecccf24f (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:09.897917 16712 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:09.899183 16712 ts_tablet_manager.cc:1403] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.548s	user 0.040s	sys 0.041s
I20260709 13:19:09.883031 16715 tablet_bootstrap.cc:654] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.898608 16424 tablet_service.cc:1511] Processing CreateTablet for tablet b7a75e87ed0b40428fb757740988a196 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:09.906024 16424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a75e87ed0b40428fb757740988a196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.910913 16576 tablet_service.cc:1511] Processing CreateTablet for tablet cfedb410dfa649a4a8f9436fffc8994c (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:09.909906 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cf203eb6e6f4850899481145884643a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.912813 16503 tablet_service.cc:1511] Processing CreateTablet for tablet b817e005d140481c9f6ad4b49f1f0837 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:09.935316 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:09.937836 16655 tablet_service.cc:1511] Processing CreateTablet for tablet b7a75e87ed0b40428fb757740988a196 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:09.941864 16726 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.938038 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fc1bb72e014b8ea956277bc60db8d3" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:09.964131 16406 leader_election.cc:343] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:09.935364 16711 consensus_queue.cc:260] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.962080 16726 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:09.966288 16655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a75e87ed0b40428fb757740988a196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.966022 16442 raft_consensus.cc:2468] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:09.937681 16652 tablet_service.cc:1511] Processing CreateTablet for tablet 44e3f3c16d034dc983fcc6fd01ce72e9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:09.969000 16711 ts_tablet_manager.cc:1434] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.189s	user 0.011s	sys 0.011s
I20260709 13:19:09.970393 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b817e005d140481c9f6ad4b49f1f0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.971263 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fc1bb72e014b8ea956277bc60db8d3" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:09.971302 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfedb410dfa649a4a8f9436fffc8994c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.973071 16574 tablet_service.cc:1511] Processing CreateTablet for tablet b7a75e87ed0b40428fb757740988a196 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:09.925861 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 44e3f3c16d034dc983fcc6fd01ce72e9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:09.973433 16573 tablet_service.cc:1511] Processing CreateTablet for tablet 44e3f3c16d034dc983fcc6fd01ce72e9 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:09.912024 16710 tablet_bootstrap.cc:654] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:09.985380 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e3f3c16d034dc983fcc6fd01ce72e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:09.937366 16712 raft_consensus.cc:359] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.002688 16432 tablet_service.cc:1511] Processing CreateTablet for tablet 526828ba85d1408a8004f848e12da611 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:09.999279 16712 raft_consensus.cc:385] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:09.982059 16726 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.014585 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526828ba85d1408a8004f848e12da611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.014640 16717 raft_consensus.cc:493] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.029209 16717 raft_consensus.cc:515] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.030179 16506 tablet_service.cc:1511] Processing CreateTablet for tablet 526828ba85d1408a8004f848e12da611 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:10.032233 16717 leader_election.cc:290] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.035063 16710 tablet_bootstrap.cc:492] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:10.021451 16711 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:10.009117 16712 raft_consensus.cc:740] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
W20260709 13:19:10.025048 16407 leader_election.cc:343] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.017369 16574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7a75e87ed0b40428fb757740988a196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.039492 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e3f3c16d034dc983fcc6fd01ce72e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.048172 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e322abcf02184f63b716976eecccf24f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.051409 16573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44e3f3c16d034dc983fcc6fd01ce72e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.050400 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526828ba85d1408a8004f848e12da611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.057013 16572 tablet_service.cc:1511] Processing CreateTablet for tablet 526828ba85d1408a8004f848e12da611 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:10.057003 16710 ts_tablet_manager.cc:1403] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.295s	user 0.020s	sys 0.008s
I20260709 13:19:10.057657 16407 leader_election.cc:304] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:10.066756 16718 raft_consensus.cc:2749] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.067060 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 04e92af3acfe4273bd9e0652d59ccc68 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:19:10.067781 16407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 64150.6us
I20260709 13:19:10.069792 16483 leader_election.cc:304] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:10.072391 16717 raft_consensus.cc:2804] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.072842 16717 raft_consensus.cc:493] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.073498 16717 raft_consensus.cc:3060] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.077284 16712 consensus_queue.cc:260] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.078410 16719 raft_consensus.cc:493] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.079370 16719 raft_consensus.cc:515] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.068781 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e92af3acfe4273bd9e0652d59ccc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.085265 16719 leader_election.cc:290] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.087111 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:10.091235 16631 leader_election.cc:343] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.094868 16715 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:10.095808 16715 ts_tablet_manager.cc:1403] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.303s	user 0.024s	sys 0.014s
I20260709 13:19:10.102807 16710 raft_consensus.cc:359] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.104133 16710 raft_consensus.cc:385] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.108421 16572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 526828ba85d1408a8004f848e12da611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.108834 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:10.110703 16429 tablet_service.cc:1511] Processing CreateTablet for tablet 04e92af3acfe4273bd9e0652d59ccc68 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:19:10.111527 16630 leader_election.cc:343] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.112035 16630 leader_election.cc:304] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:10.112673 16429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e92af3acfe4273bd9e0652d59ccc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.100124 16715 raft_consensus.cc:359] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.118767 16715 raft_consensus.cc:385] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.126989 16715 raft_consensus.cc:740] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.104640 16710 raft_consensus.cc:740] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.129920 16710 consensus_queue.cc:260] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.121563 16719 raft_consensus.cc:2749] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.124394 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:10.121205 16712 ts_tablet_manager.cc:1434] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.221s	user 0.015s	sys 0.000s
W20260709 13:19:10.135254 16483 leader_election.cc:343] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.141297 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:10.143710 16557 leader_election.cc:343] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.148550 16712 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:10.160532 16711 tablet_bootstrap.cc:654] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.128621 16715 consensus_queue.cc:260] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.165274 16717 raft_consensus.cc:515] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.169842 16715 ts_tablet_manager.cc:1434] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.074s	user 0.013s	sys 0.000s
I20260709 13:19:10.171046 16715 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:10.171219 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
W20260709 13:19:10.173519 16482 leader_election.cc:343] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.174957 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:10.177369 16579 tablet_service.cc:1511] Processing CreateTablet for tablet d4f64336673a45d99ebe7cc4736fb411 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:10.179361 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f64336673a45d99ebe7cc4736fb411. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:10.186491 16482 leader_election.cc:343] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.187062 16482 leader_election.cc:304] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:10.190490 16432 tablet_service.cc:1511] Processing CreateTablet for tablet d4f64336673a45d99ebe7cc4736fb411 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:10.192094 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f64336673a45d99ebe7cc4736fb411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.190804 16503 tablet_service.cc:1511] Processing CreateTablet for tablet ce763dbd25fa427992454c176ec757c4 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:10.196589 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce763dbd25fa427992454c176ec757c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.204954 16712 tablet_bootstrap.cc:654] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.212724 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:10.213203 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 101879us
W20260709 13:19:10.214659 16556 leader_election.cc:343] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.215170 16556 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:10.216004 16726 raft_consensus.cc:2749] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.215624 16646 tablet_service.cc:1511] Processing CreateTablet for tablet d4f64336673a45d99ebe7cc4736fb411 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:10.217402 16646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4f64336673a45d99ebe7cc4736fb411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.220347 16715 tablet_bootstrap.cc:654] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.227078 16743 raft_consensus.cc:2749] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.229377 16710 ts_tablet_manager.cc:1434] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.006s
I20260709 13:19:10.230651 16710 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:10.231328 16423 tablet_service.cc:1511] Processing CreateTablet for tablet 9bac8634695c48d1b6f03da70c4a02e5 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:10.231873 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 9bac8634695c48d1b6f03da70c4a02e5 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:10.233227 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bac8634695c48d1b6f03da70c4a02e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.233363 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bac8634695c48d1b6f03da70c4a02e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.242592 16506 tablet_service.cc:1511] Processing CreateTablet for tablet 04e92af3acfe4273bd9e0652d59ccc68 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:10.244603 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e92af3acfe4273bd9e0652d59ccc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.248131 16573 tablet_service.cc:1511] Processing CreateTablet for tablet ce763dbd25fa427992454c176ec757c4 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:10.249006 16648 tablet_service.cc:1511] Processing CreateTablet for tablet ce763dbd25fa427992454c176ec757c4 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:10.249532 16717 leader_election.cc:290] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.250007 16573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce763dbd25fa427992454c176ec757c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.250298 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce763dbd25fa427992454c176ec757c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.273772 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:10.274490 16442 raft_consensus.cc:3060] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.278298 16710 tablet_bootstrap.cc:654] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.287155 16580 tablet_service.cc:1511] Processing CreateTablet for tablet 9bac8634695c48d1b6f03da70c4a02e5 (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:10.313211 16712 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:10.313987 16712 ts_tablet_manager.cc:1403] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.177s	user 0.030s	sys 0.006s
I20260709 13:19:10.320015 16711 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:10.320979 16711 ts_tablet_manager.cc:1403] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.013s
I20260709 13:19:10.329128 16423 tablet_service.cc:1511] Processing CreateTablet for tablet 3b250f340b854e90816317511b46db7d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:10.330587 16442 raft_consensus.cc:2468] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:10.331511 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bac8634695c48d1b6f03da70c4a02e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.331888 16483 leader_election.cc:304] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:10.333367 16742 raft_consensus.cc:2804] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.333892 16742 raft_consensus.cc:697] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:10.334757 16742 consensus_queue.cc:237] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.331708 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 3b250f340b854e90816317511b46db7d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:10.337689 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b250f340b854e90816317511b46db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.330605 16423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b250f340b854e90816317511b46db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.341075 16503 tablet_service.cc:1511] Processing CreateTablet for tablet 3b250f340b854e90816317511b46db7d (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:10.338573 16712 raft_consensus.cc:359] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.342338 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b250f340b854e90816317511b46db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.342223 16712 raft_consensus.cc:385] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.343010 16712 raft_consensus.cc:740] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.360687 16573 tablet_service.cc:1511] Processing CreateTablet for tablet fa3e8e73054842b9ad74a252019d99eb (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:10.376134 16573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3e8e73054842b9ad74a252019d99eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.378350 16715 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:10.378940 16715 ts_tablet_manager.cc:1403] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.208s	user 0.020s	sys 0.004s
I20260709 13:19:10.381357 16338 catalog_manager.cc:5697] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.382313 16715 raft_consensus.cc:359] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.383095 16715 raft_consensus.cc:385] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.383395 16715 raft_consensus.cc:740] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.357417 16711 raft_consensus.cc:359] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.384171 16711 raft_consensus.cc:385] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.384495 16711 raft_consensus.cc:740] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.384783 16652 tablet_service.cc:1511] Processing CreateTablet for tablet fa3e8e73054842b9ad74a252019d99eb (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:10.386312 16711 consensus_queue.cc:260] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.390523 16432 tablet_service.cc:1511] Processing CreateTablet for tablet fa3e8e73054842b9ad74a252019d99eb (DEFAULT_TABLE table=test-workload [id=1100b73b0aaa4dbeac838519ee9617e6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:10.389998 16712 consensus_queue.cc:260] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.392437 16432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3e8e73054842b9ad74a252019d99eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.387593 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3e8e73054842b9ad74a252019d99eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:10.394934 16711 ts_tablet_manager.cc:1434] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.000s
I20260709 13:19:10.412349 16711 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:10.401436 16712 ts_tablet_manager.cc:1434] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.087s	user 0.010s	sys 0.001s
I20260709 13:19:10.413751 16712 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:10.386669 16715 consensus_queue.cc:260] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.417225 16715 ts_tablet_manager.cc:1434] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.005s
I20260709 13:19:10.401764 16710 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:10.419404 16710 ts_tablet_manager.cc:1403] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.189s	user 0.036s	sys 0.027s
I20260709 13:19:10.424203 16715 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:10.426075 16710 raft_consensus.cc:359] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.431510 16711 tablet_bootstrap.cc:654] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.435585 16710 raft_consensus.cc:385] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.438827 16710 raft_consensus.cc:740] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.441754 16712 tablet_bootstrap.cc:654] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.441645 16710 consensus_queue.cc:260] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.445896 16715 tablet_bootstrap.cc:654] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.446478 16710 ts_tablet_manager.cc:1434] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:19:10.447937 16710 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:10.460021 16742 raft_consensus.cc:493] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.460639 16742 raft_consensus.cc:515] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.463104 16742 leader_election.cc:290] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:10.465540 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ba6acf4b9542a6b6578a341ba5006b" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:10.466459 16710 tablet_bootstrap.cc:654] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.467746 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ba6acf4b9542a6b6578a341ba5006b" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:10.473178 16718 raft_consensus.cc:493] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.473752 16718 raft_consensus.cc:515] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.476794 16718 leader_election.cc:290] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:10.470235 16482 leader_election.cc:343] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:10.480080 16482 leader_election.cc:343] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.480784 16482 leader_election.cc:304] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:10.484812 16711 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:10.484896 16715 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:10.485788 16711 ts_tablet_manager.cc:1403] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.001s
I20260709 13:19:10.485795 16715 ts_tablet_manager.cc:1403] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.016s
I20260709 13:19:10.491374 16742 raft_consensus.cc:2749] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:10.492838 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:10.493956 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:10.496912 16406 leader_election.cc:343] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.496903 16715 raft_consensus.cc:359] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.498005 16715 raft_consensus.cc:385] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.498413 16715 raft_consensus.cc:740] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.492913 16711 raft_consensus.cc:359] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.499554 16715 consensus_queue.cc:260] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.501384 16711 raft_consensus.cc:385] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.502931 16711 raft_consensus.cc:740] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.504072 16715 ts_tablet_manager.cc:1434] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:19:10.503769 16711 consensus_queue.cc:260] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.506795 16712 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:10.507305 16711 ts_tablet_manager.cc:1434] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:19:10.506811 16742 raft_consensus.cc:493] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.507956 16742 raft_consensus.cc:515] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.508518 16711 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:10.509321 16710 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:10.509903 16710 ts_tablet_manager.cc:1403] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.062s	user 0.026s	sys 0.015s
I20260709 13:19:10.511255 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:10.513401 16482 leader_election.cc:343] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.513831 16710 raft_consensus.cc:359] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.514684 16710 raft_consensus.cc:385] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.515087 16710 raft_consensus.cc:740] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.514847 16742 leader_election.cc:290] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.515285 16712 ts_tablet_manager.cc:1403] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.004s
I20260709 13:19:10.516052 16710 consensus_queue.cc:260] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.518553 16710 ts_tablet_manager.cc:1434] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:10.519397 16715 tablet_bootstrap.cc:492] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:10.519780 16710 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:10.521973 16712 raft_consensus.cc:359] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.529189 16712 raft_consensus.cc:385] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.529744 16712 raft_consensus.cc:740] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.529958 16715 tablet_bootstrap.cc:654] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.530608 16712 consensus_queue.cc:260] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.516812 16711 tablet_bootstrap.cc:654] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.525354 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:10.516003 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:10.534577 16591 raft_consensus.cc:2468] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:10.536584 16407 leader_election.cc:304] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:10.538435 16483 leader_election.cc:343] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.527064 16710 tablet_bootstrap.cc:654] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.539417 16712 ts_tablet_manager.cc:1434] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:19:10.539202 16483 leader_election.cc:304] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:10.540900 16718 raft_consensus.cc:2804] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.550945 16718 raft_consensus.cc:493] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.551559 16718 raft_consensus.cc:3060] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.541109 16712 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:10.541404 16742 raft_consensus.cc:2749] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.567459 16711 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:10.568361 16711 ts_tablet_manager.cc:1403] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.015s
I20260709 13:19:10.573554 16712 tablet_bootstrap.cc:654] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.574044 16718 raft_consensus.cc:515] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.572361 16711 raft_consensus.cc:359] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.577505 16711 raft_consensus.cc:385] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.577896 16711 raft_consensus.cc:740] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.578997 16711 consensus_queue.cc:260] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.579756 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:10.580052 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:10.580313 16718 leader_election.cc:290] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:10.588161 16591 raft_consensus.cc:3060] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.596014 16718 raft_consensus.cc:493] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.601042 16406 leader_election.cc:343] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.602242 16715 tablet_bootstrap.cc:492] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:10.603036 16715 ts_tablet_manager.cc:1403] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.029s
I20260709 13:19:10.596901 16718 raft_consensus.cc:515] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.608793 16715 raft_consensus.cc:359] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.610320 16715 raft_consensus.cc:385] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.610946 16715 raft_consensus.cc:740] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.612283 16715 consensus_queue.cc:260] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.614445 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:10.615257 16590 raft_consensus.cc:2468] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:10.615908 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:10.616999 16407 leader_election.cc:304] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:10.621025 16665 raft_consensus.cc:2468] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:10.624078 16715 ts_tablet_manager.cc:1434] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.008s
I20260709 13:19:10.630221 16715 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:10.633042 16712 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:10.633701 16712 ts_tablet_manager.cc:1403] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.012s
I20260709 13:19:10.626449 16718 leader_election.cc:290] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:10.640276 16718 raft_consensus.cc:2804] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.640273 16712 raft_consensus.cc:359] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.641038 16718 raft_consensus.cc:493] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.641350 16712 raft_consensus.cc:385] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.642859 16712 raft_consensus.cc:740] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.643476 16591 raft_consensus.cc:2468] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:10.643738 16712 consensus_queue.cc:260] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.646318 16710 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:10.648792 16710 ts_tablet_manager.cc:1403] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.129s	user 0.035s	sys 0.025s
I20260709 13:19:10.646507 16407 leader_election.cc:304] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:10.642102 16718 raft_consensus.cc:3060] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.655597 16710 raft_consensus.cc:359] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.656461 16710 raft_consensus.cc:385] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.650666 16762 raft_consensus.cc:2804] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.656783 16710 raft_consensus.cc:740] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.657720 16762 raft_consensus.cc:697] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:10.658174 16710 consensus_queue.cc:260] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.659876 16762 consensus_queue.cc:237] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.663553 16715 tablet_bootstrap.cc:654] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.663591 16710 ts_tablet_manager.cc:1434] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:19:10.666827 16710 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:10.663033 16712 ts_tablet_manager.cc:1434] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:19:10.674908 16712 tablet_bootstrap.cc:492] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:10.678035 16710 tablet_bootstrap.cc:654] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.672565 16711 ts_tablet_manager.cc:1434] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.104s	user 0.015s	sys 0.010s
I20260709 13:19:10.684043 16742 raft_consensus.cc:493] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.691463 16742 raft_consensus.cc:515] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.696156 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f75167f1ed4f1dad0bb137f05f10ee" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:10.697352 16742 leader_election.cc:290] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:10.681260 16711 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:10.699049 16483 leader_election.cc:343] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.699506 16715 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:10.697683 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f75167f1ed4f1dad0bb137f05f10ee" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:10.700044 16715 ts_tablet_manager.cc:1403] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.015s
W20260709 13:19:10.701067 16482 leader_election.cc:343] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.701639 16482 leader_election.cc:304] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:10.702873 16742 raft_consensus.cc:2749] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.703653 16741 raft_consensus.cc:493] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.704205 16741 raft_consensus.cc:515] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.708371 16712 tablet_bootstrap.cc:654] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.709517 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:10.709882 16339 catalog_manager.cc:5697] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.708300 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:10.712514 16517 raft_consensus.cc:2468] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:10.713238 16710 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:10.713852 16710 ts_tablet_manager.cc:1403] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.047s	user 0.029s	sys 0.008s
I20260709 13:19:10.714080 16629 leader_election.cc:304] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:10.715721 16631 leader_election.cc:343] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.710062 16741 leader_election.cc:290] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:10.716610 16741 raft_consensus.cc:2804] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:10.717106 16741 raft_consensus.cc:493] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.717545 16741 raft_consensus.cc:3060] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.717845 16710 raft_consensus.cc:359] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.719033 16710 raft_consensus.cc:385] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.719517 16710 raft_consensus.cc:740] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.720466 16710 consensus_queue.cc:260] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.709939 16718 raft_consensus.cc:515] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.728830 16718 leader_election.cc:290] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:10.730851 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:10.731632 16591 raft_consensus.cc:3060] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.710985 16715 raft_consensus.cc:359] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.734886 16715 raft_consensus.cc:385] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.735397 16715 raft_consensus.cc:740] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.736151 16711 tablet_bootstrap.cc:654] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.737332 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:10.737993 16665 raft_consensus.cc:3060] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.739035 16715 consensus_queue.cc:260] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:10.748076 16715 ts_tablet_manager.cc:1434] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 13:19:10.730904 16710 ts_tablet_manager.cc:1434] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:19:10.758733 16710 tablet_bootstrap.cc:492] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:10.770237 16712 tablet_bootstrap.cc:492] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:10.770954 16712 ts_tablet_manager.cc:1403] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.096s	user 0.026s	sys 0.015s
I20260709 13:19:10.777927 16591 raft_consensus.cc:2468] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
W20260709 13:19:10.781984 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 67960.6us
I20260709 13:19:10.774605 16665 raft_consensus.cc:2468] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:10.784967 16407 leader_election.cc:304] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:10.785037 16741 raft_consensus.cc:515] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.786708 16718 raft_consensus.cc:2804] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.786589 16712 raft_consensus.cc:359] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.787289 16718 raft_consensus.cc:697] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:10.787957 16715 tablet_bootstrap.cc:492] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:10.788271 16718 consensus_queue.cc:237] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.789395 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
W20260709 13:19:10.792984 16631 leader_election.cc:343] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.787516 16712 raft_consensus.cc:385] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.793885 16712 raft_consensus.cc:740] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.794456 16711 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:10.795202 16712 consensus_queue.cc:260] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.795459 16711 ts_tablet_manager.cc:1403] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.115s	user 0.034s	sys 0.015s
I20260709 13:19:10.795930 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:10.788033 16741 leader_election.cc:290] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:10.796739 16517 raft_consensus.cc:3060] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.795228 16767 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.797863 16741 raft_consensus.cc:493] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.798565 16741 raft_consensus.cc:515] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.802134 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:10.803128 16715 tablet_bootstrap.cc:654] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.802999 16442 raft_consensus.cc:2468] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:10.803956 16710 tablet_bootstrap.cc:654] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.805509 16631 leader_election.cc:304] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:10.805495 16711 raft_consensus.cc:359] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.798579 16767 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.806432 16711 raft_consensus.cc:385] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.812647 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:10.813469 16711 raft_consensus.cc:740] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.813743 16516 raft_consensus.cc:2468] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:10.814709 16711 consensus_queue.cc:260] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.815582 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:10.816303 16741 leader_election.cc:290] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:10.824203 16711 ts_tablet_manager.cc:1434] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:19:10.829452 16711 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:10.831982 16742 consensus_queue.cc:1048] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:10.833809 16726 raft_consensus.cc:493] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.821475 16741 raft_consensus.cc:2804] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:10.824062 16630 leader_election.cc:343] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.835978 16741 raft_consensus.cc:493] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.838073 16741 raft_consensus.cc:3060] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.837544 16712 ts_tablet_manager.cc:1434] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.066s	user 0.020s	sys 0.006s
I20260709 13:19:10.833230 16517 raft_consensus.cc:2468] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:10.841193 16712 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:10.835336 16726 raft_consensus.cc:515] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:10.841359 16629 leader_election.cc:304] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:10.865097 16710 tablet_bootstrap.cc:492] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:10.866062 16710 ts_tablet_manager.cc:1403] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.016s
I20260709 13:19:10.853888 16771 raft_consensus.cc:2804] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.868108 16726 leader_election.cc:290] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.868602 16771 raft_consensus.cc:697] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:10.869704 16771 consensus_queue.cc:237] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.870131 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:10.873070 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:10.874714 16631 leader_election.cc:343] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:10.875226 16631 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:10.874740 16711 tablet_bootstrap.cc:654] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.876165 16770 raft_consensus.cc:2749] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.876554 16337 catalog_manager.cc:5697] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:10.877753 16741 raft_consensus.cc:515] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.878984 16715 tablet_bootstrap.cc:492] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:10.892831 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:10.893893 16442 raft_consensus.cc:3060] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.894752 16712 tablet_bootstrap.cc:654] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.895023 16339 catalog_manager.cc:5697] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:10.883266 16715 ts_tablet_manager.cc:1403] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.100s	user 0.023s	sys 0.015s
I20260709 13:19:10.879670 16767 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:10.909368 16741 leader_election.cc:290] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:10.915205 16710 raft_consensus.cc:359] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.916114 16710 raft_consensus.cc:385] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.916486 16710 raft_consensus.cc:740] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.916642 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:10.917368 16517 raft_consensus.cc:3060] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.917383 16710 consensus_queue.cc:260] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.917738 16711 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:10.919795 16711 ts_tablet_manager.cc:1403] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.008s
I20260709 13:19:10.927654 16591 raft_consensus.cc:3060] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:10.929644 16715 raft_consensus.cc:359] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.930472 16715 raft_consensus.cc:385] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.930773 16715 raft_consensus.cc:740] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.931732 16715 consensus_queue.cc:260] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.934855 16710 ts_tablet_manager.cc:1434] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.003s
I20260709 13:19:10.918560 16442 raft_consensus.cc:2468] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:10.938882 16710 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:10.944093 16517 raft_consensus.cc:2468] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:10.944661 16715 ts_tablet_manager.cc:1434] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.040s	user 0.001s	sys 0.005s
I20260709 13:19:10.952608 16629 leader_election.cc:304] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:10.953804 16767 raft_consensus.cc:2804] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:10.954324 16767 raft_consensus.cc:697] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:10.955173 16715 tablet_bootstrap.cc:492] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:10.955168 16767 consensus_queue.cc:237] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.967459 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:10.968453 16715 tablet_bootstrap.cc:654] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.969489 16555 leader_election.cc:304] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:10.945909 16711 raft_consensus.cc:359] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:10.972014 16711 raft_consensus.cc:385] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:10.972445 16711 raft_consensus.cc:740] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:10.981096 16726 raft_consensus.cc:2749] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:10.983106 16712 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:10.984015 16710 tablet_bootstrap.cc:654] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:10.990963 16742 consensus_queue.cc:1048] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:10.993124 16726 raft_consensus.cc:493] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.995582 16726 raft_consensus.cc:515] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:10.984102 16712 ts_tablet_manager.cc:1403] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.143s	user 0.013s	sys 0.010s
I20260709 13:19:10.979061 16711 consensus_queue.cc:260] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.000515 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66d091e1e2a4930ae11b17b39cde541" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.001111 16726 leader_election.cc:290] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.002367 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66d091e1e2a4930ae11b17b39cde541" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.003283 16340 catalog_manager.cc:5697] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.005232 16715 tablet_bootstrap.cc:492] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.010212 16715 ts_tablet_manager.cc:1403] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.006s
I20260709 13:19:11.009963 16742 raft_consensus.cc:493] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.014546 16742 raft_consensus.cc:515] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.010937 16517 raft_consensus.cc:2468] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.017685 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fc1bb72e014b8ea956277bc60db8d3" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.020924 16711 ts_tablet_manager.cc:1434] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.005s
I20260709 13:19:11.022235 16711 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:11.022553 16780 raft_consensus.cc:493] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.023020 16556 leader_election.cc:343] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.023116 16780 raft_consensus.cc:515] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.024322 16555 leader_election.cc:304] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:11.026544 16780 leader_election.cc:290] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.027570 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e727763fa55140febaf02de70b136741" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:11.029481 16483 leader_election.cc:343] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.029872 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e727763fa55140febaf02de70b136741" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:11.030963 16590 raft_consensus.cc:2468] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:11.031159 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fc1bb72e014b8ea956277bc60db8d3" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.016709 16742 leader_election.cc:290] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.033264 16441 raft_consensus.cc:2468] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:11.033757 16482 leader_election.cc:304] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:11.036145 16726 raft_consensus.cc:2804] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.036927 16710 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:11.038549 16742 raft_consensus.cc:2804] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.038893 16715 raft_consensus.cc:359] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.040035 16742 raft_consensus.cc:493] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.040371 16715 raft_consensus.cc:385] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.040478 16742 raft_consensus.cc:3060] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.040915 16715 raft_consensus.cc:740] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.041957 16715 consensus_queue.cc:260] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.040473 16726 raft_consensus.cc:493] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.044402 16715 ts_tablet_manager.cc:1434] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
W20260709 13:19:11.037989 16482 leader_election.cc:343] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.035522 16712 raft_consensus.cc:359] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.045704 16712 raft_consensus.cc:385] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.045815 16715 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:11.044564 16726 raft_consensus.cc:3060] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.046046 16712 raft_consensus.cc:740] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.053546 16712 consensus_queue.cc:260] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.054401 16715 tablet_bootstrap.cc:654] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.040165 16710 ts_tablet_manager.cc:1403] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.015s
I20260709 13:19:11.067361 16712 ts_tablet_manager.cc:1434] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 13:19:11.068447 16483 leader_election.cc:304] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:11.070043 16780 raft_consensus.cc:2804] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.069180 16710 raft_consensus.cc:359] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.071270 16710 raft_consensus.cc:385] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.071588 16710 raft_consensus.cc:740] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.070554 16780 raft_consensus.cc:493] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.072288 16710 consensus_queue.cc:260] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.072733 16780 raft_consensus.cc:3060] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.051429 16742 raft_consensus.cc:515] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.075421 16710 ts_tablet_manager.cc:1434] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:11.077662 16712 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:11.078368 16762 consensus_queue.cc:1048] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.096927 16712 tablet_bootstrap.cc:654] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.099167 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e727763fa55140febaf02de70b136741" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
W20260709 13:19:11.102682 16483 leader_election.cc:343] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.103219 16780 raft_consensus.cc:515] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.103973 16715 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.104665 16715 ts_tablet_manager.cc:1403] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.005s
I20260709 13:19:11.105432 16711 tablet_bootstrap.cc:654] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.106737 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fc1bb72e014b8ea956277bc60db8d3" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:11.107668 16665 raft_consensus.cc:3060] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.108175 16715 raft_consensus.cc:359] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.109216 16715 raft_consensus.cc:385] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.109493 16715 raft_consensus.cc:740] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.110957 16715 consensus_queue.cc:260] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.113830 16715 ts_tablet_manager.cc:1434] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:11.113883 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e727763fa55140febaf02de70b136741" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:11.114789 16589 raft_consensus.cc:3060] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.115311 16715 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:11.120154 16665 raft_consensus.cc:2468] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:11.134939 16482 leader_election.cc:304] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.136404 16781 raft_consensus.cc:2804] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.136945 16781 raft_consensus.cc:697] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:11.137909 16712 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:11.137784 16781 consensus_queue.cc:237] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.138505 16712 ts_tablet_manager.cc:1403] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.003s
I20260709 13:19:11.123337 16710 tablet_bootstrap.cc:492] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:11.142239 16712 raft_consensus.cc:359] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.143136 16712 raft_consensus.cc:385] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.143488 16712 raft_consensus.cc:740] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.144845 16780 leader_election.cc:290] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.130492 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fc1bb72e014b8ea956277bc60db8d3" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:11.155257 16710 tablet_bootstrap.cc:654] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.156119 16441 raft_consensus.cc:3060] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.111771 16742 leader_election.cc:290] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.167130 16337 catalog_manager.cc:5697] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.171880 16710 tablet_bootstrap.cc:492] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:11.172428 16710 ts_tablet_manager.cc:1403] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.002s
I20260709 13:19:11.175057 16589 raft_consensus.cc:2468] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:11.145763 16517 raft_consensus.cc:3060] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.146873 16715 tablet_bootstrap.cc:654] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.183254 16441 raft_consensus.cc:2468] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:11.183853 16711 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:11.147357 16712 consensus_queue.cc:260] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.184439 16711 ts_tablet_manager.cc:1403] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.162s	user 0.007s	sys 0.008s
I20260709 13:19:11.126025 16726 raft_consensus.cc:515] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.196549 16726 leader_election.cc:290] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.175431 16710 raft_consensus.cc:359] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.197309 16710 raft_consensus.cc:385] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.197404 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66d091e1e2a4930ae11b17b39cde541" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.197685 16710 raft_consensus.cc:740] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.198127 16517 raft_consensus.cc:3060] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.192490 16715 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.185950 16712 ts_tablet_manager.cc:1434] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:19:11.198992 16715 ts_tablet_manager.cc:1403] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.003s
I20260709 13:19:11.199678 16712 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:11.193082 16482 leader_election.cc:304] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:11.202482 16742 raft_consensus.cc:2804] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.202142 16715 raft_consensus.cc:359] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.203025 16742 raft_consensus.cc:697] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:11.203815 16710 consensus_queue.cc:260] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.204064 16742 consensus_queue.cc:237] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.206257 16517 raft_consensus.cc:2468] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.207630 16555 leader_election.cc:304] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.189128 16762 consensus_queue.cc:1048] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.206277 16710 ts_tablet_manager.cc:1434] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:19:11.209369 16718 raft_consensus.cc:493] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.210134 16710 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:11.209928 16718 raft_consensus.cc:515] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.212487 16718 leader_election.cc:290] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:11.214457 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.203064 16715 raft_consensus.cc:385] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.218068 16710 tablet_bootstrap.cc:654] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.218353 16715 raft_consensus.cc:740] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.208703 16784 raft_consensus.cc:493] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.222110 16784 raft_consensus.cc:515] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.216776 16726 raft_consensus.cc:2804] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.223528 16715 consensus_queue.cc:260] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.224803 16784 leader_election.cc:290] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.225953 16726 raft_consensus.cc:697] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:11.230984 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:11.231870 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.231895 16726 consensus_queue.cc:237] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.233049 16517 raft_consensus.cc:2393] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:11.234406 16406 leader_election.cc:304] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:11.235910 16718 raft_consensus.cc:3060] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.227634 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.239794 16767 raft_consensus.cc:493] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.239548 16337 catalog_manager.cc:5697] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.239923 16483 leader_election.cc:304] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:11.240356 16767 raft_consensus.cc:515] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.243117 16767 leader_election.cc:290] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.244702 16715 ts_tablet_manager.cc:1434] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:19:11.245738 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ea494524264f8186935c55c5301bd1" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.246739 16715 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:11.246688 16515 raft_consensus.cc:2468] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:11.248765 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ea494524264f8186935c55c5301bd1" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:11.249009 16629 leader_election.cc:304] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.249760 16591 raft_consensus.cc:2468] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:11.251713 16767 raft_consensus.cc:2804] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.252377 16767 raft_consensus.cc:493] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.252933 16767 raft_consensus.cc:3060] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.255234 16710 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:11.255801 16710 ts_tablet_manager.cc:1403] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.020s
I20260709 13:19:11.256362 16715 tablet_bootstrap.cc:654] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.257117 16742 raft_consensus.cc:2749] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:11.260528 16710 raft_consensus.cc:359] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.261477 16710 raft_consensus.cc:385] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.261906 16710 raft_consensus.cc:740] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.197844 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66d091e1e2a4930ae11b17b39cde541" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:11.263011 16710 consensus_queue.cc:260] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:11.263934 16556 leader_election.cc:343] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.266760 16710 ts_tablet_manager.cc:1434] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:19:11.268132 16710 tablet_bootstrap.cc:492] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:11.272151 16718 raft_consensus.cc:2749] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.261686 16711 raft_consensus.cc:359] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.274835 16339 catalog_manager.cc:5697] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.275933 16711 raft_consensus.cc:385] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.280582 16711 raft_consensus.cc:740] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.281461 16711 consensus_queue.cc:260] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.282109 16715 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.282042 16741 consensus_queue.cc:1048] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.283001 16715 ts_tablet_manager.cc:1403] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.008s
I20260709 13:19:11.283885 16711 ts_tablet_manager.cc:1434] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 13:19:11.275131 16712 tablet_bootstrap.cc:654] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.287901 16718 consensus_queue.cc:1048] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.295121 16711 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:11.297019 16715 raft_consensus.cc:359] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.297971 16715 raft_consensus.cc:385] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.298274 16715 raft_consensus.cc:740] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.299193 16715 consensus_queue.cc:260] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.278259 16767 raft_consensus.cc:515] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.276697 16710 tablet_bootstrap.cc:654] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.301708 16715 ts_tablet_manager.cc:1434] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:11.301996 16767 leader_election.cc:290] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.304553 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ea494524264f8186935c55c5301bd1" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.305378 16516 raft_consensus.cc:3060] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.309497 16711 tablet_bootstrap.cc:654] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.312430 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ea494524264f8186935c55c5301bd1" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:11.313350 16591 raft_consensus.cc:3060] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.314908 16516 raft_consensus.cc:2468] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:11.316185 16629 leader_election.cc:304] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.317127 16767 raft_consensus.cc:2804] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.317596 16767 raft_consensus.cc:697] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:11.317832 16711 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:11.318352 16711 ts_tablet_manager.cc:1403] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.001s
I20260709 13:19:11.318444 16767 consensus_queue.cc:237] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.326013 16711 raft_consensus.cc:359] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.327148 16711 raft_consensus.cc:385] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.327507 16711 raft_consensus.cc:740] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.331771 16711 consensus_queue.cc:260] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.332229 16718 consensus_queue.cc:1048] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.335063 16711 ts_tablet_manager.cc:1434] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:19:11.336362 16711 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:11.350044 16712 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:11.350036 16591 raft_consensus.cc:2468] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:11.350836 16712 ts_tablet_manager.cc:1403] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.005s
I20260709 13:19:11.352061 16715 tablet_bootstrap.cc:492] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:11.354427 16712 raft_consensus.cc:359] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.355396 16712 raft_consensus.cc:385] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.355640 16712 raft_consensus.cc:740] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.356452 16712 consensus_queue.cc:260] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.358819 16742 raft_consensus.cc:493] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.359438 16742 raft_consensus.cc:515] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.361976 16712 ts_tablet_manager.cc:1434] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:19:11.363771 16710 tablet_bootstrap.cc:492] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:11.364367 16710 ts_tablet_manager.cc:1403] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.096s	user 0.024s	sys 0.002s
I20260709 13:19:11.363864 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7033b0b5479941d1baab89153f09dcde" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.365173 16441 raft_consensus.cc:2468] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:11.368495 16483 leader_election.cc:304] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.369613 16784 raft_consensus.cc:2804] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.370002 16784 raft_consensus.cc:493] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.370378 16784 raft_consensus.cc:3060] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.372798 16742 leader_election.cc:290] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.373885 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7033b0b5479941d1baab89153f09dcde" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:11.374702 16336 catalog_manager.cc:5697] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.370309 16712 tablet_bootstrap.cc:492] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:11.388976 16710 raft_consensus.cc:359] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.389680 16767 consensus_queue.cc:1048] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.376075 16715 tablet_bootstrap.cc:654] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:11.376173 16482 leader_election.cc:343] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.401466 16712 tablet_bootstrap.cc:654] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.402679 16784 raft_consensus.cc:515] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.389783 16710 raft_consensus.cc:385] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.405092 16767 raft_consensus.cc:493] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.406378 16710 raft_consensus.cc:740] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.406777 16767 raft_consensus.cc:515] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.407171 16710 consensus_queue.cc:260] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.409195 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7033b0b5479941d1baab89153f09dcde" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:11.409813 16784 leader_election.cc:290] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:11.410290 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.410871 16711 tablet_bootstrap.cc:654] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.409922 16442 raft_consensus.cc:3060] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.411026 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7033b0b5479941d1baab89153f09dcde" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
W20260709 13:19:11.413262 16482 leader_election.cc:343] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.411010 16440 raft_consensus.cc:2468] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:11.413697 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.415086 16631 leader_election.cc:304] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:11.415434 16767 leader_election.cc:290] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:11.416234 16771 raft_consensus.cc:2804] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.416625 16771 raft_consensus.cc:493] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.416999 16771 raft_consensus.cc:3060] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.418401 16710 ts_tablet_manager.cc:1434] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.002s
I20260709 13:19:11.422050 16710 tablet_bootstrap.cc:492] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:11.418836 16726 raft_consensus.cc:493] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.422608 16726 raft_consensus.cc:515] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:11.415946 16629 leader_election.cc:343] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.426153 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ba6acf4b9542a6b6578a341ba5006b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.427134 16517 raft_consensus.cc:2468] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.428682 16555 leader_election.cc:304] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.430626 16789 raft_consensus.cc:2804] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.431018 16789 raft_consensus.cc:493] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.431313 16789 raft_consensus.cc:3060] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.432544 16771 raft_consensus.cc:515] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.442797 16442 raft_consensus.cc:2468] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:11.449055 16483 leader_election.cc:304] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:11.451529 16742 raft_consensus.cc:2804] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.452558 16742 raft_consensus.cc:697] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:11.462919 16710 tablet_bootstrap.cc:654] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.469551 16771 leader_election.cc:290] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:11.471375 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:11.472103 16440 raft_consensus.cc:3060] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.472545 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.473099 16742 consensus_queue.cc:237] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:11.478500 16629 leader_election.cc:343] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.477811 16789 raft_consensus.cc:515] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.478216 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ba6acf4b9542a6b6578a341ba5006b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.481355 16715 tablet_bootstrap.cc:492] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.481951 16715 ts_tablet_manager.cc:1403] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.130s	user 0.005s	sys 0.026s
I20260709 13:19:11.472599 16726 leader_election.cc:290] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.484931 16726 raft_consensus.cc:493] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.485617 16556 leader_election.cc:343] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.486099 16771 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.485643 16726 raft_consensus.cc:515] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.486630 16771 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.490509 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.491494 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f75167f1ed4f1dad0bb137f05f10ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.492188 16517 raft_consensus.cc:2468] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.493887 16440 raft_consensus.cc:2468] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:11.494199 16555 leader_election.cc:304] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:11.494338 16631 leader_election.cc:343] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.495074 16711 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:11.496613 16711 ts_tablet_manager.cc:1403] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.160s	user 0.022s	sys 0.019s
I20260709 13:19:11.499189 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.500545 16631 leader_election.cc:304] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:11.501529 16629 leader_election.cc:343] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.501691 16767 raft_consensus.cc:2804] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.502231 16629 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:11.502384 16767 raft_consensus.cc:697] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:11.503335 16767 consensus_queue.cc:237] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.485764 16712 tablet_bootstrap.cc:492] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:11.508235 16712 ts_tablet_manager.cc:1403] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.014s
I20260709 13:19:11.489387 16726 leader_election.cc:290] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:11.514027 16715 raft_consensus.cc:359] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.516397 16715 raft_consensus.cc:385] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:11.516793 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:11.517053 16715 raft_consensus.cc:740] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.506718 16741 raft_consensus.cc:2749] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.506979 16771 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:11.518543 16715 consensus_queue.cc:260] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.521234 16715 ts_tablet_manager.cc:1434] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.003s
I20260709 13:19:11.519471 16711 raft_consensus.cc:359] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.521797 16711 raft_consensus.cc:385] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.522150 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f75167f1ed4f1dad0bb137f05f10ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.523003 16440 raft_consensus.cc:2468] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.521678 16726 raft_consensus.cc:2804] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.524550 16726 raft_consensus.cc:493] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.526719 16715 tablet_bootstrap.cc:492] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:11.522318 16711 raft_consensus.cc:740] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.525183 16712 raft_consensus.cc:359] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.528031 16712 raft_consensus.cc:385] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.528455 16712 raft_consensus.cc:740] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.525192 16726 raft_consensus.cc:3060] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.533051 16711 consensus_queue.cc:260] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.520671 16771 consensus_queue.cc:1048] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:19:11.542874 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ba6acf4b9542a6b6578a341ba5006b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.543918 16517 raft_consensus.cc:3060] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.546222 16715 tablet_bootstrap.cc:654] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.546929 16336 catalog_manager.cc:5697] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.548503 16335 catalog_manager.cc:5697] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.541240 16712 consensus_queue.cc:260] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.557312 16781 raft_consensus.cc:493] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.559837 16781 raft_consensus.cc:515] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.560559 16784 consensus_queue.cc:1048] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.562182 16781 leader_election.cc:290] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.565259 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:11.572134 16711 ts_tablet_manager.cc:1434] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.002s
W20260709 13:19:11.573612 16482 leader_election.cc:343] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.578966 16711 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:11.586136 16712 ts_tablet_manager.cc:1434] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.003s
I20260709 13:19:11.586464 16711 tablet_bootstrap.cc:654] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.587283 16712 tablet_bootstrap.cc:492] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:11.590211 16771 consensus_queue.cc:1048] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.593910 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.596098 16767 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.597098 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67ba6acf4b9542a6b6578a341ba5006b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:11.597317 16767 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.597729 16664 raft_consensus.cc:3060] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.567736 16789 leader_election.cc:290] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.567056 16726 raft_consensus.cc:515] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:11.611518 16789 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.612376 16789 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.612967 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:11.613878 16589 raft_consensus.cc:2468] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
W20260709 13:19:11.604188 16482 leader_election.cc:343] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.615537 16482 leader_election.cc:304] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:11.617108 16781 consensus_queue.cc:1048] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.618347 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.612968 16767 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.619709 16630 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:11.617584 16742 raft_consensus.cc:2749] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.625609 16710 tablet_bootstrap.cc:492] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:11.626184 16710 ts_tablet_manager.cc:1403] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.204s	user 0.022s	sys 0.006s
W20260709 13:19:11.621134 16631 leader_election.cc:343] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.629215 16789 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.631230 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.621770 16767 raft_consensus.cc:2804] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.631924 16767 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.631987 16665 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.632246 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f75167f1ed4f1dad0bb137f05f10ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.632793 16767 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.633011 16515 raft_consensus.cc:3060] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.633535 16715 tablet_bootstrap.cc:492] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.634047 16715 ts_tablet_manager.cc:1403] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.036s
I20260709 13:19:11.638835 16556 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:11.633229 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.641026 16441 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.641717 16715 raft_consensus.cc:359] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.642545 16715 raft_consensus.cc:385] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.642812 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f75167f1ed4f1dad0bb137f05f10ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:11.643435 16517 raft_consensus.cc:2468] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.640493 16710 raft_consensus.cc:359] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.631024 16726 leader_election.cc:290] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:11.643594 16439 raft_consensus.cc:3060] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.642861 16715 raft_consensus.cc:740] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.645571 16710 raft_consensus.cc:385] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.649971 16710 raft_consensus.cc:740] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.652762 16555 leader_election.cc:304] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.653048 16818 raft_consensus.cc:2804] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.653460 16818 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.653823 16818 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.658812 16515 raft_consensus.cc:2468] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.659149 16439 raft_consensus.cc:2468] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.660308 16555 leader_election.cc:304] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.651434 16715 consensus_queue.cc:260] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.652205 16710 consensus_queue.cc:260] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.643466 16767 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:11.665097 16483 consensus_peers.cc:597] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.667791 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:11.661118 16789 raft_consensus.cc:493] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.669790 16631 leader_election.cc:343] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.665102 16710 ts_tablet_manager.cc:1434] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:19:11.668519 16818 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.672163 16710 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:11.673543 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:11.674207 16663 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.669380 16789 raft_consensus.cc:515] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.678869 16726 raft_consensus.cc:2804] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.685235 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:11.682089 16818 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.697417 16439 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.667876 16767 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.702836 16715 ts_tablet_manager.cc:1434] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.068s	user 0.013s	sys 0.007s
I20260709 13:19:11.707007 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:11.708518 16556 leader_election.cc:343] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.716472 16710 tablet_bootstrap.cc:654] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.701712 16789 leader_election.cc:290] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.717206 16711 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:11.717427 16789 raft_consensus.cc:2804] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.717947 16711 ts_tablet_manager.cc:1403] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.139s	user 0.020s	sys 0.003s
I20260709 13:19:11.718015 16789 raft_consensus.cc:697] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:11.719143 16789 consensus_queue.cc:237] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:11.723812 16555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 63615.6us
I20260709 13:19:11.722591 16711 raft_consensus.cc:359] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.725324 16711 raft_consensus.cc:385] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.725648 16711 raft_consensus.cc:740] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.726897 16712 tablet_bootstrap.cc:654] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.726738 16663 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.729396 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:11.730173 16589 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.730129 16556 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:11.732290 16715 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:11.747404 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.748154 16664 raft_consensus.cc:2468] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.748234 16515 raft_consensus.cc:2468] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.753168 16742 consensus_queue.cc:1048] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:11.747610 16829 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.755402 16711 consensus_queue.cc:260] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.739477 16589 raft_consensus.cc:2468] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:11.751799 16555 leader_election.cc:304] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:11.761456 16630 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:11.761720 16818 raft_consensus.cc:2804] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.762281 16818 raft_consensus.cc:697] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:11.763073 16767 raft_consensus.cc:2804] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:11.763273 16818 consensus_queue.cc:237] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.764202 16767 raft_consensus.cc:697] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:11.769371 16711 ts_tablet_manager.cc:1434] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:19:11.755478 16829 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.765998 16726 raft_consensus.cc:697] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:11.770854 16711 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:11.783845 16715 tablet_bootstrap.cc:654] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.772414 16830 raft_consensus.cc:2804] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.780834 16767 consensus_queue.cc:237] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.787236 16830 raft_consensus.cc:493] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.787631 16830 raft_consensus.cc:3060] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:11.785704 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 55683.4us
I20260709 13:19:11.788955 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:11.795212 16831 consensus_queue.cc:1048] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.798427 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:11.789815 16439 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:11.776404 16829 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:11.783651 16726 consensus_queue.cc:237] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:11.814786 16556 consensus_peers.cc:597] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 -> Peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Couldn't send request to peer ccb9eea20c4f4b309b2b16f8edb35d4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.817214 16829 raft_consensus.cc:493] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.817837 16829 raft_consensus.cc:515] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.821163 16829 leader_election.cc:290] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
W20260709 13:19:11.799240 16557 leader_election.cc:343] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.821972 16339 catalog_manager.cc:5697] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.822911 16830 raft_consensus.cc:515] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.823751 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:11.825668 16516 raft_consensus.cc:2468] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:11.826108 16830 leader_election.cc:290] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
W20260709 13:19:11.834656 16556 leader_election.cc:343] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.823887 16339 catalog_manager.cc:5697] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.840734 16555 leader_election.cc:304] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:11.843286 16711 tablet_bootstrap.cc:654] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.844204 16710 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:11.848564 16710 ts_tablet_manager.cc:1403] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.177s	user 0.015s	sys 0.001s
I20260709 13:19:11.854439 16556 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:11.855700 16726 raft_consensus.cc:2749] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:11.863047 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:11.866297 16482 consensus_peers.cc:597] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:11.869225 16771 consensus_queue.cc:1048] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.873286 16833 raft_consensus.cc:2804] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:11.873910 16833 raft_consensus.cc:493] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.874379 16833 raft_consensus.cc:3060] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.867568 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.881593 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
W20260709 13:19:11.879029 16556 leader_election.cc:343] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.891304 16741 consensus_queue.cc:1048] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:11.894418 16712 tablet_bootstrap.cc:492] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:11.894104 16710 raft_consensus.cc:359] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.895170 16712 ts_tablet_manager.cc:1403] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.308s	user 0.015s	sys 0.005s
I20260709 13:19:11.881062 16516 raft_consensus.cc:3060] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.895187 16710 raft_consensus.cc:385] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.913563 16710 raft_consensus.cc:740] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.914278 16710 consensus_queue.cc:260] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:11.915380 16833 raft_consensus.cc:515] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.915989 16710 ts_tablet_manager.cc:1434] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 13:19:11.917337 16715 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:11.917900 16833 leader_election.cc:290] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:11.918988 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:11.919723 16514 raft_consensus.cc:3060] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:11.919255 16339 catalog_manager.cc:5697] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.917909 16715 ts_tablet_manager.cc:1403] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.186s	user 0.010s	sys 0.024s
I20260709 13:19:11.923266 16710 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:11.927565 16712 raft_consensus.cc:359] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.928825 16712 raft_consensus.cc:385] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.929272 16712 raft_consensus.cc:740] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.931028 16712 consensus_queue.cc:260] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:11.936271 16712 ts_tablet_manager.cc:1434] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.003s
I20260709 13:19:11.937808 16712 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:11.943123 16711 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:11.883195 16340 catalog_manager.cc:5697] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.951606 16711 ts_tablet_manager.cc:1403] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.181s	user 0.019s	sys 0.008s
W20260709 13:19:11.890692 16556 leader_election.cc:343] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:11.970396 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 79753.2us
I20260709 13:19:11.979285 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
W20260709 13:19:11.981176 16556 leader_election.cc:343] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:11.986614 16712 tablet_bootstrap.cc:654] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:11.996441 16711 raft_consensus.cc:359] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:11.997288 16711 raft_consensus.cc:385] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:11.997565 16711 raft_consensus.cc:740] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:11.998579 16711 consensus_queue.cc:260] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.001710 16711 ts_tablet_manager.cc:1434] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 13:19:12.003050 16711 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:12.011582 16514 raft_consensus.cc:2468] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:12.014531 16555 leader_election.cc:304] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:12.021718 16517 raft_consensus.cc:3060] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.022821 16726 raft_consensus.cc:2804] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.023150 16715 raft_consensus.cc:359] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.023624 16726 raft_consensus.cc:697] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:12.024044 16715 raft_consensus.cc:385] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.024421 16715 raft_consensus.cc:740] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.024722 16726 consensus_queue.cc:237] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.025267 16715 consensus_queue.cc:260] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.027742 16715 ts_tablet_manager.cc:1434] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.002s
I20260709 13:19:12.030498 16715 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:12.037727 16715 tablet_bootstrap.cc:654] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.040925 16516 raft_consensus.cc:2468] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:12.044760 16710 tablet_bootstrap.cc:654] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.045660 16711 tablet_bootstrap.cc:654] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.060832 16712 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:12.062155 16712 ts_tablet_manager.cc:1403] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.125s	user 0.018s	sys 0.001s
I20260709 13:19:12.047125 16555 leader_election.cc:304] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:12.071122 16818 raft_consensus.cc:2804] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.072961 16818 raft_consensus.cc:697] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:12.074600 16818 consensus_queue.cc:237] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.085623 16712 raft_consensus.cc:359] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.086525 16712 raft_consensus.cc:385] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.086781 16712 raft_consensus.cc:740] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.088763 16712 consensus_queue.cc:260] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.098634 16712 ts_tablet_manager.cc:1434] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:19:12.102185 16712 tablet_bootstrap.cc:492] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:12.095031 16763 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.110430 16763 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.114288 16767 consensus_queue.cc:1048] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:12.130878 16712 tablet_bootstrap.cc:654] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.133683 16771 consensus_queue.cc:1048] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:12.135706 16742 consensus_queue.cc:1048] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:12.184235 16711 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:12.184837 16711 ts_tablet_manager.cc:1403] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.182s	user 0.030s	sys 0.012s
I20260709 13:19:12.187466 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.189893 16715 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:12.190425 16715 ts_tablet_manager.cc:1403] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.160s	user 0.027s	sys 0.051s
I20260709 13:19:12.190641 16830 consensus_queue.cc:1048] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.193063 16712 tablet_bootstrap.cc:492] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:12.193801 16712 ts_tablet_manager.cc:1403] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.093s	user 0.011s	sys 0.015s
I20260709 13:19:12.176647 16763 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:12.202158 16715 raft_consensus.cc:359] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.203482 16715 raft_consensus.cc:385] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.203905 16715 raft_consensus.cc:740] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.200910 16767 raft_consensus.cc:493] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.205380 16715 consensus_queue.cc:260] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:12.207996 16406 leader_election.cc:343] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.208755 16715 ts_tablet_manager.cc:1434] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:19:12.210510 16715 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:12.221324 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:12.222123 16663 raft_consensus.cc:2468] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:12.223202 16710 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:12.223711 16407 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:12.224102 16710 ts_tablet_manager.cc:1403] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.307s	user 0.034s	sys 0.029s
I20260709 13:19:12.206504 16767 raft_consensus.cc:515] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.228150 16763 raft_consensus.cc:2804] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.237072 16763 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.237360 16726 consensus_queue.cc:1048] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.238018 16763 raft_consensus.cc:3060] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.239202 16711 raft_consensus.cc:359] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.239928 16711 raft_consensus.cc:385] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.240296 16711 raft_consensus.cc:740] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.241906 16711 consensus_queue.cc:260] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.245700 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66d091e1e2a4930ae11b17b39cde541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.246402 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66d091e1e2a4930ae11b17b39cde541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.247138 16830 consensus_queue.cc:1048] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.249094 16771 consensus_queue.cc:1048] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.250451 16712 raft_consensus.cc:359] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.251164 16712 raft_consensus.cc:385] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.251492 16712 raft_consensus.cc:740] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.252207 16712 consensus_queue.cc:260] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.260423 16712 ts_tablet_manager.cc:1434] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.002s
I20260709 13:19:12.263046 16711 ts_tablet_manager.cc:1434] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.001s
I20260709 13:19:12.264050 16711 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:12.253232 16767 leader_election.cc:290] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:12.251101 16630 leader_election.cc:304] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:12.256520 16710 raft_consensus.cc:359] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.266360 16741 raft_consensus.cc:2749] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.266835 16710 raft_consensus.cc:385] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.267204 16710 raft_consensus.cc:740] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.268141 16710 consensus_queue.cc:260] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.269500 16712 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:12.281534 16710 ts_tablet_manager.cc:1434] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 13:19:12.290086 16710 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:12.277681 16830 raft_consensus.cc:493] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:12.310596 16856 log.cc:927] Time spent T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:19:12.304540 16830 raft_consensus.cc:515] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.327664 16741 raft_consensus.cc:493] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.337392 16741 raft_consensus.cc:515] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.348031 16741 leader_election.cc:290] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:12.356745 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7033b0b5479941d1baab89153f09dcde" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.358459 16711 tablet_bootstrap.cc:654] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.359501 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.346179 16715 tablet_bootstrap.cc:654] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.361655 16710 tablet_bootstrap.cc:654] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.369002 16712 tablet_bootstrap.cc:654] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.371829 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.373597 16517 raft_consensus.cc:2393] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
I20260709 13:19:12.353467 16830 leader_election.cc:290] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:12.374766 16830 consensus_queue.cc:1048] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.351027 16663 raft_consensus.cc:3060] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.377381 16741 raft_consensus.cc:493] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.398504 16710 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:12.386004 16865 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.401595 16710 ts_tablet_manager.cc:1403] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.013s
I20260709 13:19:12.388410 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7033b0b5479941d1baab89153f09dcde" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:12.377715 16763 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.422869 16340 catalog_manager.cc:5697] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.424250 16588 raft_consensus.cc:3060] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.410593 16830 raft_consensus.cc:493] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.429239 16711 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:12.401222 16741 raft_consensus.cc:515] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.435858 16557 leader_election.cc:304] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:12.408668 16726 consensus_queue.cc:1048] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:19:12.425547 16340 catalog_manager.cc:5697] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.415170 16629 leader_election.cc:304] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:12.409150 16865 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.436127 16741 leader_election.cc:290] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:12.430006 16711 ts_tablet_manager.cc:1403] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.166s	user 0.018s	sys 0.034s
I20260709 13:19:12.449961 16440 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.450589 16715 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:12.451247 16715 ts_tablet_manager.cc:1403] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.241s	user 0.017s	sys 0.006s
I20260709 13:19:12.456560 16712 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:12.457165 16712 ts_tablet_manager.cc:1403] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.015s
I20260709 13:19:12.457857 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.445679 16767 raft_consensus.cc:3060] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.428000 16830 raft_consensus.cc:515] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.460405 16712 raft_consensus.cc:359] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.461432 16712 raft_consensus.cc:385] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.461726 16712 raft_consensus.cc:740] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.462339 16589 raft_consensus.cc:2468] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:12.462476 16712 consensus_queue.cc:260] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.464826 16712 ts_tablet_manager.cc:1434] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:12.465943 16712 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:12.466775 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:12.469095 16631 leader_election.cc:343] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.471426 16726 consensus_queue.cc:1048] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:12.482213 16715 raft_consensus.cc:359] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.483002 16715 raft_consensus.cc:385] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.483419 16715 raft_consensus.cc:740] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.483839 16630 leader_election.cc:304] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:12.485154 16741 raft_consensus.cc:2804] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.485344 16710 raft_consensus.cc:359] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.487160 16710 raft_consensus.cc:385] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.487469 16710 raft_consensus.cc:740] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.488195 16710 consensus_queue.cc:260] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.489292 16715 consensus_queue.cc:260] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.485565 16741 raft_consensus.cc:493] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.494165 16741 raft_consensus.cc:3060] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.495478 16763 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:12.497411 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
W20260709 13:19:12.497726 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 95076us
W20260709 13:19:12.499944 16406 leader_election.cc:343] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.497545 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:12.501256 16661 raft_consensus.cc:3060] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.501555 16710 ts_tablet_manager.cc:1434] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 13:19:12.502662 16710 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:12.507005 16830 leader_election.cc:290] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:12.509994 16711 raft_consensus.cc:359] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.513748 16711 raft_consensus.cc:385] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.514146 16711 raft_consensus.cc:740] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.510196 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:12.510854 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:12.511593 16870 log.cc:927] Time spent T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:12.510859 16715 ts_tablet_manager.cc:1434] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.008s
I20260709 13:19:12.519241 16715 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:12.521315 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.521905 16771 consensus_queue.cc:1048] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:12.525859 16557 leader_election.cc:343] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.529438 16865 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:12.515151 16711 consensus_queue.cc:260] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.538828 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:12.553732 16711 ts_tablet_manager.cc:1434] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.002s
I20260709 13:19:12.554811 16711 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:12.560925 16865 raft_consensus.cc:493] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.561751 16865 raft_consensus.cc:515] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.565567 16407 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:12.566164 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.566895 16515 raft_consensus.cc:2468] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:12.570107 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:12.571074 16659 raft_consensus.cc:2468] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:12.572952 16767 raft_consensus.cc:2749] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.575644 16712 tablet_bootstrap.cc:654] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.572583 16406 leader_election.cc:304] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:12.576483 16863 raft_consensus.cc:2804] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.502525 16741 raft_consensus.cc:515] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.576934 16863 raft_consensus.cc:493] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.577387 16863 raft_consensus.cc:3060] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.578820 16741 leader_election.cc:290] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:12.580889 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:12.581606 16591 raft_consensus.cc:3060] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.581526 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
W20260709 13:19:12.583628 16631 leader_election.cc:343] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.585376 16660 raft_consensus.cc:2393] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:12.586311 16863 raft_consensus.cc:515] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.587476 16715 tablet_bootstrap.cc:654] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.564745 16865 leader_election.cc:290] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:12.590667 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:12.591535 16515 raft_consensus.cc:3060] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.607815 16556 leader_election.cc:304] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:12.609500 16830 consensus_queue.cc:1048] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.608599 16710 tablet_bootstrap.cc:654] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.619858 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:12.620843 16664 raft_consensus.cc:3060] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:12.629953 16556 consensus_peers.cc:597] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 -> Peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Couldn't send request to peer ccb9eea20c4f4b309b2b16f8edb35d4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:12.619833 16661 raft_consensus.cc:2468] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:12.632694 16833 raft_consensus.cc:2749] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.632400 16763 raft_consensus.cc:2749] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.638790 16407 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:12.605304 16863 leader_election.cc:290] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:12.656330 16711 tablet_bootstrap.cc:654] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:12.646525 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:12.658617 16515 raft_consensus.cc:2468] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:12.667038 16833 consensus_queue.cc:1048] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:12.668744 16833 consensus_queue.cc:1048] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:12.669528 16710 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:12.670059 16710 ts_tablet_manager.cc:1403] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.168s	user 0.025s	sys 0.015s
I20260709 13:19:12.650358 16763 raft_consensus.cc:2804] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.675679 16781 raft_consensus.cc:493] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.677697 16406 leader_election.cc:304] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:12.678833 16712 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:12.679389 16712 ts_tablet_manager.cc:1403] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.214s	user 0.006s	sys 0.015s
I20260709 13:19:12.680676 16763 raft_consensus.cc:697] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:12.681631 16763 consensus_queue.cc:237] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.681881 16781 raft_consensus.cc:515] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.683998 16863 raft_consensus.cc:2804] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.684221 16781 leader_election.cc:290] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:12.684633 16863 raft_consensus.cc:697] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:12.684979 16591 raft_consensus.cc:2468] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:12.685647 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a364606015a43f090b7dd314f4bdd35" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.685570 16863 consensus_queue.cc:237] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.686440 16589 raft_consensus.cc:2468] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:12.686064 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a364606015a43f090b7dd314f4bdd35" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:12.687086 16630 leader_election.cc:304] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:12.687203 16439 raft_consensus.cc:2468] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:12.688645 16741 raft_consensus.cc:2804] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.689356 16726 raft_consensus.cc:2749] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.689459 16741 raft_consensus.cc:697] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:12.690402 16741 consensus_queue.cc:237] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.695811 16482 leader_election.cc:304] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:12.697939 16742 raft_consensus.cc:2804] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.695986 16710 raft_consensus.cc:359] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.699820 16710 raft_consensus.cc:385] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.700205 16710 raft_consensus.cc:740] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.698014 16664 raft_consensus.cc:2468] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:12.698660 16742 raft_consensus.cc:493] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.700871 16710 consensus_queue.cc:260] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.701529 16742 raft_consensus.cc:3060] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.703850 16712 raft_consensus.cc:359] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.705596 16712 raft_consensus.cc:385] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.705894 16712 raft_consensus.cc:740] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.712251 16710 ts_tablet_manager.cc:1434] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.001s
I20260709 13:19:12.715701 16710 tablet_bootstrap.cc:492] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:12.715855 16712 consensus_queue.cc:260] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.721098 16715 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:12.721715 16715 ts_tablet_manager.cc:1403] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.203s	user 0.013s	sys 0.016s
I20260709 13:19:12.725327 16712 ts_tablet_manager.cc:1434] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.003s
I20260709 13:19:12.728475 16712 tablet_bootstrap.cc:492] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:12.733378 16710 tablet_bootstrap.cc:654] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.753908 16847 raft_consensus.cc:493] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.754570 16847 raft_consensus.cc:515] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.758581 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4652fa932d845a7b78a8a57edc661fd" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.771107 16742 raft_consensus.cc:515] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.771759 16847 leader_election.cc:290] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:12.773856 16630 leader_election.cc:343] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.774848 16742 leader_election.cc:290] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:12.776072 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a364606015a43f090b7dd314f4bdd35" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:12.776829 16588 raft_consensus.cc:3060] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.776690 16715 raft_consensus.cc:359] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.778820 16712 tablet_bootstrap.cc:654] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.779033 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4652fa932d845a7b78a8a57edc661fd" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:12.777520 16715 raft_consensus.cc:385] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.785617 16715 raft_consensus.cc:740] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
W20260709 13:19:12.787309 16631 leader_election.cc:343] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.787878 16631 leader_election.cc:304] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:12.789228 16767 raft_consensus.cc:2749] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.789021 16715 consensus_queue.cc:260] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:12.789883 16711 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:12.790413 16711 ts_tablet_manager.cc:1403] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.236s	user 0.010s	sys 0.013s
I20260709 13:19:12.790771 16339 catalog_manager.cc:5697] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.791683 16715 ts_tablet_manager.cc:1434] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:19:12.793205 16711 raft_consensus.cc:359] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.795157 16711 raft_consensus.cc:385] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.795686 16711 raft_consensus.cc:740] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.798918 16715 tablet_bootstrap.cc:492] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:12.799151 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a364606015a43f090b7dd314f4bdd35" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:12.799793 16439 raft_consensus.cc:3060] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.798025 16711 consensus_queue.cc:260] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.809113 16711 ts_tablet_manager.cc:1434] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:19:12.811962 16715 tablet_bootstrap.cc:654] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.813055 16588 raft_consensus.cc:2468] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:12.820189 16482 leader_election.cc:304] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:12.821112 16710 tablet_bootstrap.cc:492] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:12.821786 16710 ts_tablet_manager.cc:1403] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.108s	user 0.010s	sys 0.009s
I20260709 13:19:12.823438 16742 raft_consensus.cc:2804] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:12.824122 16711 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:12.824288 16742 raft_consensus.cc:697] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:12.825120 16439 raft_consensus.cc:2468] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:12.825240 16742 consensus_queue.cc:237] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.830067 16710 raft_consensus.cc:359] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.830924 16710 raft_consensus.cc:385] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.831220 16710 raft_consensus.cc:740] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.831465 16711 tablet_bootstrap.cc:654] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.831930 16710 consensus_queue.cc:260] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.833823 16339 catalog_manager.cc:5697] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.839874 16715 tablet_bootstrap.cc:492] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:12.840435 16715 ts_tablet_manager.cc:1403] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.042s	user 0.005s	sys 0.005s
I20260709 13:19:12.843573 16715 raft_consensus.cc:359] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.844378 16715 raft_consensus.cc:385] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.846426 16710 ts_tablet_manager.cc:1434] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 13:19:12.847561 16710 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:12.850513 16712 tablet_bootstrap.cc:492] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:12.851399 16712 ts_tablet_manager.cc:1403] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.001s
I20260709 13:19:12.836620 16339 catalog_manager.cc:5697] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.844650 16715 raft_consensus.cc:740] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.857939 16712 raft_consensus.cc:359] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.858695 16712 raft_consensus.cc:385] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.858963 16712 raft_consensus.cc:740] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.859684 16712 consensus_queue.cc:260] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.857939 16715 consensus_queue.cc:260] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.869083 16712 ts_tablet_manager.cc:1434] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:12.871061 16715 ts_tablet_manager.cc:1434] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.002s
I20260709 13:19:12.872889 16715 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:12.876513 16712 tablet_bootstrap.cc:492] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:12.878549 16710 tablet_bootstrap.cc:654] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.895216 16712 tablet_bootstrap.cc:654] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.899806 16715 tablet_bootstrap.cc:654] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:12.930699 16710 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:12.931434 16710 ts_tablet_manager.cc:1403] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.010s
I20260709 13:19:12.935739 16767 raft_consensus.cc:493] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.936599 16767 raft_consensus.cc:515] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.943552 16767 leader_election.cc:290] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:12.943832 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.944590 16588 raft_consensus.cc:2468] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:12.944957 16710 raft_consensus.cc:359] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.945677 16710 raft_consensus.cc:385] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.945940 16710 raft_consensus.cc:740] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.946237 16630 leader_election.cc:304] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:12.947391 16767 raft_consensus.cc:2804] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:12.946671 16710 consensus_queue.cc:260] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.948299 16767 raft_consensus.cc:493] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.948843 16767 raft_consensus.cc:3060] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:12.950558 16710 ts_tablet_manager.cc:1434] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:19:12.951719 16710 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:12.955107 16763 raft_consensus.cc:493] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.958542 16763 raft_consensus.cc:515] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.961756 16763 leader_election.cc:290] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:12.963989 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e727763fa55140febaf02de70b136741" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.964202 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:12.970247 16517 raft_consensus.cc:2468] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:12.971823 16742 raft_consensus.cc:493] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.972620 16715 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:12.973243 16715 ts_tablet_manager.cc:1403] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.036s
I20260709 13:19:12.972333 16742 raft_consensus.cc:515] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:12.976678 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e727763fa55140febaf02de70b136741" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:12.977128 16715 raft_consensus.cc:359] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.978034 16715 raft_consensus.cc:385] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.978308 16715 raft_consensus.cc:740] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.978928 16407 leader_election.cc:304] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:12.979144 16715 consensus_queue.cc:260] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:12.981277 16763 raft_consensus.cc:2749] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.981808 16712 tablet_bootstrap.cc:492] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:12.982290 16712 ts_tablet_manager.cc:1403] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.111s	user 0.022s	sys 0.031s
I20260709 13:19:12.980084 16742 leader_election.cc:290] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:12.982872 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:12.986824 16711 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:12.987414 16711 ts_tablet_manager.cc:1403] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.172s	user 0.044s	sys 0.061s
I20260709 13:19:12.986488 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:12.990449 16483 leader_election.cc:343] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.991231 16712 raft_consensus.cc:359] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:12.992072 16712 raft_consensus.cc:385] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:12.992352 16712 raft_consensus.cc:740] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:12.993126 16712 consensus_queue.cc:260] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:12.991297 16482 leader_election.cc:343] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:12.994270 16482 leader_election.cc:304] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:12.995404 16712 ts_tablet_manager.cc:1434] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:19:12.995911 16742 raft_consensus.cc:2749] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:12.992684 16335 catalog_manager.cc:5697] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:12.997995 16712 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:12.999476 16715 ts_tablet_manager.cc:1434] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 13:19:12.999166 16767 raft_consensus.cc:515] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.000492 16715 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:13.002604 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:13.005002 16712 tablet_bootstrap.cc:654] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.004170 16588 raft_consensus.cc:3060] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.016563 16767 leader_election.cc:290] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.022926 16711 raft_consensus.cc:359] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.024083 16711 raft_consensus.cc:385] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.024456 16711 raft_consensus.cc:740] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.020277 16588 raft_consensus.cc:2468] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:13.020102 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:13.025652 16514 raft_consensus.cc:3060] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.030030 16715 tablet_bootstrap.cc:654] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.035120 16630 leader_election.cc:304] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:13.036940 16767 raft_consensus.cc:2804] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.038746 16767 raft_consensus.cc:697] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:13.040125 16767 consensus_queue.cc:237] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.041774 16514 raft_consensus.cc:2468] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:13.047119 16833 raft_consensus.cc:493] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.047778 16833 raft_consensus.cc:515] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.042075 16710 tablet_bootstrap.cc:654] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.053380 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:13.053817 16712 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:13.054706 16712 ts_tablet_manager.cc:1403] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.058s	user 0.034s	sys 0.020s
I20260709 13:19:13.055825 16833 leader_election.cc:290] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:13.058028 16712 raft_consensus.cc:359] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.058796 16712 raft_consensus.cc:385] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.059063 16712 raft_consensus.cc:740] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.058588 16339 catalog_manager.cc:5697] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.061961 16712 consensus_queue.cc:260] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.063620 16712 ts_tablet_manager.cc:1434] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:13.064591 16712 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:13.056595 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:13.067773 16555 leader_election.cc:343] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.070590 16712 tablet_bootstrap.cc:654] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.075300 16715 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:13.075923 16715 ts_tablet_manager.cc:1403] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.008s
I20260709 13:19:13.083684 16712 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:13.084270 16712 ts_tablet_manager.cc:1403] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:19:13.087523 16712 raft_consensus.cc:359] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.088446 16712 raft_consensus.cc:385] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.088768 16712 raft_consensus.cc:740] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.070109 16711 consensus_queue.cc:260] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.090219 16439 raft_consensus.cc:2468] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:13.092281 16711 ts_tablet_manager.cc:1434] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.004s
I20260709 13:19:13.093348 16711 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:13.093780 16557 leader_election.cc:304] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:13.095175 16830 raft_consensus.cc:2804] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.095582 16830 raft_consensus.cc:493] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.095934 16830 raft_consensus.cc:3060] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.098704 16710 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:13.099290 16710 ts_tablet_manager.cc:1403] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.148s	user 0.008s	sys 0.004s
I20260709 13:19:13.102828 16710 raft_consensus.cc:359] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.103552 16710 raft_consensus.cc:385] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.103847 16710 raft_consensus.cc:740] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.104768 16710 consensus_queue.cc:260] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.107510 16710 ts_tablet_manager.cc:1434] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:13.112094 16711 tablet_bootstrap.cc:654] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.113263 16899 raft_consensus.cc:493] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.114034 16899 raft_consensus.cc:515] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.114697 16712 consensus_queue.cc:260] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.116233 16710 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:13.117408 16712 ts_tablet_manager.cc:1434] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.004s
I20260709 13:19:13.119123 16712 tablet_bootstrap.cc:492] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:13.120024 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:13.121127 16438 raft_consensus.cc:2468] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:13.123250 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:13.124465 16710 tablet_bootstrap.cc:654] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.124536 16899 leader_election.cc:290] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.125342 16483 leader_election.cc:304] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:13.125587 16715 raft_consensus.cc:359] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.126421 16715 raft_consensus.cc:385] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.126974 16781 raft_consensus.cc:2804] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.127940 16781 raft_consensus.cc:493] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.128422 16781 raft_consensus.cc:3060] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.130904 16711 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:13.130904 16710 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:13.131584 16711 ts_tablet_manager.cc:1403] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 13:19:13.131584 16710 ts_tablet_manager.cc:1403] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 13:19:13.131496 16830 raft_consensus.cc:515] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.133595 16588 raft_consensus.cc:2393] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
I20260709 13:19:13.135041 16710 raft_consensus.cc:359] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.135528 16833 raft_consensus.cc:493] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.136075 16710 raft_consensus.cc:385] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.136473 16710 raft_consensus.cc:740] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.134824 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:13.134864 16711 raft_consensus.cc:359] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.137059 16439 raft_consensus.cc:3060] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.137318 16711 raft_consensus.cc:385] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.137722 16711 raft_consensus.cc:740] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.139760 16711 consensus_queue.cc:260] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.142818 16711 ts_tablet_manager.cc:1434] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:19:13.136586 16833 raft_consensus.cc:515] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.144014 16711 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:13.147548 16833 leader_election.cc:290] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:13.147801 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4652fa932d845a7b78a8a57edc661fd" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:13.149456 16660 raft_consensus.cc:2468] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:13.151088 16711 tablet_bootstrap.cc:654] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.151342 16781 raft_consensus.cc:515] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.151719 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4652fa932d845a7b78a8a57edc661fd" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:13.152938 16438 raft_consensus.cc:2468] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:13.153167 16710 consensus_queue.cc:260] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.152746 16556 leader_election.cc:304] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:13.155303 16833 raft_consensus.cc:2804] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.155857 16833 raft_consensus.cc:493] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.156564 16767 raft_consensus.cc:493] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.156661 16833 raft_consensus.cc:3060] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.157341 16767 raft_consensus.cc:515] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.162600 16763 consensus_queue.cc:1048] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.165103 16767 leader_election.cc:290] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.159725 16710 ts_tablet_manager.cc:1434] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:19:13.168025 16710 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:13.169752 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:13.161911 16899 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.171654 16899 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.172061 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:13.162370 16631 consensus_peers.cc:597] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.175432 16899 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:13.127040 16715 raft_consensus.cc:740] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.177284 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:13.173336 16630 leader_election.cc:343] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:13.178833 16629 leader_election.cc:343] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.180317 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:13.181129 16629 leader_election.cc:304] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:13.184428 16767 raft_consensus.cc:2749] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.186650 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:13.179333 16715 consensus_queue.cc:260] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.188649 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:13.189517 16588 raft_consensus.cc:2393] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
I20260709 13:19:13.189309 16482 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:13.190822 16899 raft_consensus.cc:2749] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.191883 16482 leader_election.cc:304] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:13.198189 16899 raft_consensus.cc:2749] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.199580 16781 leader_election.cc:290] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.127007 16712 tablet_bootstrap.cc:654] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.205847 16715 ts_tablet_manager.cc:1434] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.000s
I20260709 13:19:13.210129 16439 raft_consensus.cc:2468] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:13.211490 16557 leader_election.cc:304] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:13.212527 16726 raft_consensus.cc:2804] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.213063 16726 raft_consensus.cc:697] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:13.213924 16726 consensus_queue.cc:237] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.218640 16781 raft_consensus.cc:493] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.219897 16781 raft_consensus.cc:515] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.223428 16710 tablet_bootstrap.cc:654] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.223989 16781 leader_election.cc:290] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.224146 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:13.227020 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:13.228575 16483 leader_election.cc:343] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.229197 16715 tablet_bootstrap.cc:492] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:13.233809 16438 raft_consensus.cc:3060] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.237306 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db0f6fc6e1413fb75245a35d2e4cef" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:13.238442 16514 raft_consensus.cc:2393] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:13.245795 16517 raft_consensus.cc:3060] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.241480 16830 leader_election.cc:290] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:13.257238 16482 leader_election.cc:343] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.257911 16482 leader_election.cc:304] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:13.258072 16833 raft_consensus.cc:515] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.259469 16781 raft_consensus.cc:2749] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.262202 16711 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:13.263016 16711 ts_tablet_manager.cc:1403] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.119s	user 0.050s	sys 0.058s
I20260709 13:19:13.264364 16833 leader_election.cc:290] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:13.265575 16710 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:13.265957 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4652fa932d845a7b78a8a57edc661fd" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:13.266077 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4652fa932d845a7b78a8a57edc661fd" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:13.266633 16439 raft_consensus.cc:3060] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.266901 16664 raft_consensus.cc:3060] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.267057 16340 catalog_manager.cc:5697] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.266122 16710 ts_tablet_manager.cc:1403] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.005s
I20260709 13:19:13.272599 16711 raft_consensus.cc:359] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.273478 16711 raft_consensus.cc:385] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.271464 16710 raft_consensus.cc:359] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.273633 16767 consensus_queue.cc:1048] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:13.273749 16711 raft_consensus.cc:740] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.274394 16710 raft_consensus.cc:385] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.275476 16439 raft_consensus.cc:2468] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:13.275872 16710 raft_consensus.cc:740] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.277274 16557 leader_election.cc:304] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:13.277117 16710 consensus_queue.cc:260] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.279146 16818 raft_consensus.cc:2804] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.278851 16711 consensus_queue.cc:260] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.279698 16818 raft_consensus.cc:697] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:13.280288 16710 ts_tablet_manager.cc:1434] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:19:13.281687 16710 tablet_bootstrap.cc:492] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:13.282406 16711 ts_tablet_manager.cc:1434] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:19:13.286566 16711 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:13.289340 16710 tablet_bootstrap.cc:654] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.280656 16818 consensus_queue.cc:237] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.293344 16711 tablet_bootstrap.cc:654] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.304183 16865 consensus_queue.cc:1048] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.308130 16771 raft_consensus.cc:493] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.308988 16771 raft_consensus.cc:515] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.311532 16771 leader_election.cc:290] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:13.312472 16781 consensus_queue.cc:1048] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.317488 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:13.318351 16439 raft_consensus.cc:2468] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:13.319613 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:13.320593 16514 raft_consensus.cc:2468] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:13.319845 16631 leader_election.cc:304] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:13.330423 16865 consensus_queue.cc:1048] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.333300 16767 raft_consensus.cc:2804] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.334122 16767 raft_consensus.cc:493] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.334838 16767 raft_consensus.cc:3060] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.355084 16767 raft_consensus.cc:515] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.364004 16898 consensus_queue.cc:1048] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:13.366930 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:13.367684 16439 raft_consensus.cc:3060] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.367203 16767 leader_election.cc:290] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:13.369293 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:13.370579 16515 raft_consensus.cc:3060] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.392146 16763 consensus_queue.cc:1048] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.402150 16715 tablet_bootstrap.cc:654] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.405511 16711 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:13.409655 16711 ts_tablet_manager.cc:1403] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.029s
I20260709 13:19:13.413195 16664 raft_consensus.cc:2468] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:13.423779 16726 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.424412 16726 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.431988 16726 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:13.437467 16340 catalog_manager.cc:5697] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.441778 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:13.473860 16557 leader_election.cc:343] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.461051 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:13.476146 16556 leader_election.cc:343] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.476727 16556 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:13.478082 16726 raft_consensus.cc:2749] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:13.441084 16406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 57676.2us
I20260709 13:19:13.513912 16742 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.514644 16742 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.555294 16712 tablet_bootstrap.cc:492] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:13.556124 16712 ts_tablet_manager.cc:1403] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.437s	user 0.037s	sys 0.007s
I20260709 13:19:13.566147 16710 tablet_bootstrap.cc:492] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:13.566751 16710 ts_tablet_manager.cc:1403] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.285s	user 0.059s	sys 0.077s
I20260709 13:19:13.569803 16710 raft_consensus.cc:359] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.570567 16710 raft_consensus.cc:385] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.570848 16710 raft_consensus.cc:740] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.571652 16710 consensus_queue.cc:260] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.573880 16710 ts_tablet_manager.cc:1434] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:13.575001 16710 tablet_bootstrap.cc:492] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:13.575872 16711 raft_consensus.cc:359] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.578299 16711 raft_consensus.cc:385] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.578737 16711 raft_consensus.cc:740] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.542838 16439 raft_consensus.cc:2468] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:13.587621 16712 raft_consensus.cc:359] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.588443 16712 raft_consensus.cc:385] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.590104 16742 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.590484 16515 raft_consensus.cc:2468] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:13.591620 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:13.592607 16629 leader_election.cc:304] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:13.580123 16711 consensus_queue.cc:260] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.588726 16712 raft_consensus.cc:740] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.597508 16715 tablet_bootstrap.cc:492] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:13.606233 16712 consensus_queue.cc:260] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.598838 16715 ts_tablet_manager.cc:1403] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.370s	user 0.024s	sys 0.002s
W20260709 13:19:13.595093 16482 leader_election.cc:343] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.610453 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:13.620649 16771 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.597733 16928 raft_consensus.cc:2804] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:13.627818 16483 leader_election.cc:343] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.636610 16767 consensus_queue.cc:1048] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.645103 16928 raft_consensus.cc:697] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:13.621390 16771 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.646124 16928 consensus_queue.cc:237] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:13.647502 16771 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:13.647109 16830 consensus_queue.cc:1048] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.653522 16710 tablet_bootstrap.cc:654] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.656706 16771 consensus_queue.cc:1048] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.661811 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:13.665252 16631 leader_election.cc:343] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.683609 16483 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:13.690158 16767 raft_consensus.cc:493] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.704514 16767 raft_consensus.cc:515] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.700309 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:13.707753 16589 raft_consensus.cc:2468] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:13.720355 16630 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:13.722257 16928 raft_consensus.cc:2804] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.722957 16928 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.723546 16928 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.726601 16830 consensus_queue.cc:1048] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:13.728896 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:13.728076 16340 catalog_manager.cc:5697] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:13.730304 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:13.733197 16767 leader_election.cc:290] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:13.735570 16711 ts_tablet_manager.cc:1434] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.325s	user 0.010s	sys 0.001s
I20260709 13:19:13.737223 16711 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:13.713733 16742 raft_consensus.cc:2749] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:13.714941 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 94210.2us
I20260709 13:19:13.711493 16712 ts_tablet_manager.cc:1434] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.155s	user 0.005s	sys 0.012s
I20260709 13:19:13.745096 16712 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:13.742413 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b55c6dbc8124cd78b036f8b92987ab1" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:13.771626 16630 leader_election.cc:304] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:13.773489 16771 raft_consensus.cc:2749] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:13.786330 16935 log.cc:927] Time spent T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:19:13.788049 16833 consensus_queue.cc:1048] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.798729 16863 raft_consensus.cc:493] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.799290 16863 raft_consensus.cc:515] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.800552 16715 raft_consensus.cc:359] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.801667 16715 raft_consensus.cc:385] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.801903 16863 leader_election.cc:290] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:13.816421 16726 consensus_queue.cc:1048] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:13.802059 16715 raft_consensus.cc:740] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.825582 16715 consensus_queue.cc:260] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.803897 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:13.835374 16833 raft_consensus.cc:493] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.804708 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be1c7cede5d74f08be30f9213dc321fb" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:13.838129 16407 leader_election.cc:304] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:13.827359 16440 raft_consensus.cc:3060] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.804000 16712 tablet_bootstrap.cc:654] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.836313 16833 raft_consensus.cc:515] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.843912 16833 leader_election.cc:290] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:13.845283 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:13.846871 16555 leader_election.cc:343] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.851501 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:13.852463 16661 raft_consensus.cc:2468] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:13.853727 16556 leader_election.cc:304] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:13.859063 16711 tablet_bootstrap.cc:654] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.862540 16726 raft_consensus.cc:2804] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:13.863015 16726 raft_consensus.cc:493] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.863368 16726 raft_consensus.cc:3060] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.872891 16726 raft_consensus.cc:515] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.880554 16715 ts_tablet_manager.cc:1434] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.272s	user 0.010s	sys 0.000s
I20260709 13:19:13.881911 16715 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:13.895730 16712 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:13.895551 16928 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.896271 16712 ts_tablet_manager.cc:1403] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.151s	user 0.021s	sys 0.040s
I20260709 13:19:13.896620 16710 tablet_bootstrap.cc:492] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:13.897459 16710 ts_tablet_manager.cc:1403] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.323s	user 0.048s	sys 0.077s
I20260709 13:19:13.900676 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:13.900470 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:13.900485 16710 raft_consensus.cc:359] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.913740 16661 raft_consensus.cc:3060] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.913839 16710 raft_consensus.cc:385] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.914517 16710 raft_consensus.cc:740] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.915421 16710 consensus_queue.cc:260] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.917416 16710 ts_tablet_manager.cc:1434] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.005s
I20260709 13:19:13.918730 16710 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:13.897974 16928 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:13.922715 16517 raft_consensus.cc:3060] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.925498 16715 tablet_bootstrap.cc:654] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.927556 16712 raft_consensus.cc:359] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.928467 16712 raft_consensus.cc:385] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.928889 16712 raft_consensus.cc:740] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.934402 16712 consensus_queue.cc:260] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.935417 16710 tablet_bootstrap.cc:654] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.941001 16863 raft_consensus.cc:2749] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:13.901182 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:13.955477 16589 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:13.943027 16661 raft_consensus.cc:2468] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:13.936956 16712 ts_tablet_manager.cc:1434] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:19:13.962785 16556 leader_election.cc:304] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:13.963724 16833 raft_consensus.cc:2804] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.964455 16833 raft_consensus.cc:697] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:13.965421 16833 consensus_queue.cc:237] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:13.968528 16710 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:13.969130 16710 ts_tablet_manager.cc:1403] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.006s
I20260709 13:19:13.971638 16712 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:13.972146 16715 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:13.972725 16715 ts_tablet_manager.cc:1403] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.004s
I20260709 13:19:13.975561 16715 raft_consensus.cc:359] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.972195 16710 raft_consensus.cc:359] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.976425 16715 raft_consensus.cc:385] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.976593 16710 raft_consensus.cc:385] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:13.976812 16715 raft_consensus.cc:740] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.977012 16710 raft_consensus.cc:740] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:13.977780 16715 consensus_queue.cc:260] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.978207 16710 consensus_queue.cc:260] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:13.905340 16726 leader_election.cc:290] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:13.899220 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:13.980573 16710 ts_tablet_manager.cc:1434] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
W20260709 13:19:13.981017 16631 leader_election.cc:343] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:13.981704 16710 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:13.980712 16715 ts_tablet_manager.cc:1434] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:19:13.985423 16589 raft_consensus.cc:2468] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:13.986357 16715 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:13.986649 16630 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:13.987493 16928 raft_consensus.cc:2804] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:13.982940 16712 tablet_bootstrap.cc:654] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.988032 16928 raft_consensus.cc:697] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:13.989152 16928 consensus_queue.cc:237] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:13.991482 16710 tablet_bootstrap.cc:654] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.993253 16715 tablet_bootstrap.cc:654] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:13.997222 16711 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:13.997745 16711 ts_tablet_manager.cc:1403] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.261s	user 0.018s	sys 0.006s
I20260709 13:19:14.000931 16711 raft_consensus.cc:359] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.001746 16711 raft_consensus.cc:385] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.002059 16711 raft_consensus.cc:740] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.003371 16711 consensus_queue.cc:260] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.009454 16715 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:14.010010 16715 ts_tablet_manager.cc:1403] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 13:19:14.011152 16711 ts_tablet_manager.cc:1434] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:14.011756 16517 raft_consensus.cc:2468] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:14.013881 16715 raft_consensus.cc:359] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.014485 16710 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:14.014707 16715 raft_consensus.cc:385] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.015019 16710 ts_tablet_manager.cc:1403] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.014s
I20260709 13:19:14.018342 16710 raft_consensus.cc:359] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.019136 16710 raft_consensus.cc:385] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.015017 16715 raft_consensus.cc:740] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.019438 16710 raft_consensus.cc:740] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.020147 16710 consensus_queue.cc:260] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.020265 16715 consensus_queue.cc:260] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.022416 16710 ts_tablet_manager.cc:1434] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:14.023432 16710 tablet_bootstrap.cc:492] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:14.024219 16715 ts_tablet_manager.cc:1434] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:19:14.025218 16715 tablet_bootstrap.cc:492] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:14.024353 16340 catalog_manager.cc:5697] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.028213 16711 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:14.029214 16661 raft_consensus.cc:3060] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.046993 16712 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:14.047574 16712 ts_tablet_manager.cc:1403] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.076s	user 0.009s	sys 0.005s
I20260709 13:19:14.046761 16339 catalog_manager.cc:5697] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:14.050282 16781 raft_consensus.cc:493] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.051153 16715 tablet_bootstrap.cc:654] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.050896 16781 raft_consensus.cc:515] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.054257 16712 raft_consensus.cc:359] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.055015 16712 raft_consensus.cc:385] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.055290 16712 raft_consensus.cc:740] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.056095 16712 consensus_queue.cc:260] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.056730 16898 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.057484 16742 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.057314 16898 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.058013 16742 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:14.058883 16712 ts_tablet_manager.cc:1434] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:19:14.059684 16898 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:14.060088 16712 tablet_bootstrap.cc:492] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:14.060424 16742 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:14.061331 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:14.061614 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:14.063395 16483 leader_election.cc:343] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.063982 16710 tablet_bootstrap.cc:654] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.056612 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401e752e0f07412eb1f2506a3d7e942a" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:14.069772 16781 leader_election.cc:290] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.073629 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:14.069216 16483 leader_election.cc:343] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.076805 16712 tablet_bootstrap.cc:654] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.083139 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401e752e0f07412eb1f2506a3d7e942a" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:14.084700 16482 leader_election.cc:343] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:14.094451 16482 leader_election.cc:343] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.095070 16482 leader_election.cc:304] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:14.097150 16781 raft_consensus.cc:2749] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.099612 16711 tablet_bootstrap.cc:654] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.091899 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:14.105713 16482 leader_election.cc:343] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.115581 16482 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:14.108757 16767 consensus_queue.cc:1048] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:14.118897 16781 raft_consensus.cc:2749] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.114779 16833 raft_consensus.cc:493] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.119869 16833 raft_consensus.cc:515] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:14.121101 16711 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:14.121707 16711 ts_tablet_manager.cc:1403] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.104s	user 0.023s	sys 0.000s
I20260709 13:19:14.122113 16833 leader_election.cc:290] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:14.124394 16482 leader_election.cc:343] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.124843 16482 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:14.125281 16711 raft_consensus.cc:359] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.126374 16781 raft_consensus.cc:2749] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.126607 16711 raft_consensus.cc:385] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.127077 16711 raft_consensus.cc:740] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.128669 16711 consensus_queue.cc:260] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.131506 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:14.132342 16711 ts_tablet_manager.cc:1434] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:14.132628 16515 raft_consensus.cc:2468] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:14.134971 16555 leader_election.cc:304] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:14.136948 16726 raft_consensus.cc:2804] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.137521 16726 raft_consensus.cc:493] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.138450 16726 raft_consensus.cc:3060] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.140906 16710 tablet_bootstrap.cc:492] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:14.141808 16710 ts_tablet_manager.cc:1403] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.119s	user 0.020s	sys 0.024s
I20260709 13:19:14.143082 16711 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:14.143967 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:14.145614 16557 leader_election.cc:343] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.148646 16726 raft_consensus.cc:515] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:14.151124 16710 raft_consensus.cc:359] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.152041 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:14.153649 16710 raft_consensus.cc:385] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.154470 16710 raft_consensus.cc:740] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
W20260709 13:19:14.155078 16557 leader_election.cc:343] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.155922 16712 tablet_bootstrap.cc:492] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:14.155515 16710 consensus_queue.cc:260] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.156422 16712 ts_tablet_manager.cc:1403] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.000s
I20260709 13:19:14.156702 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:14.157343 16515 raft_consensus.cc:3060] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.157909 16710 ts_tablet_manager.cc:1434] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:19:14.159166 16712 raft_consensus.cc:359] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.159746 16710 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:14.159847 16712 raft_consensus.cc:385] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.160204 16712 raft_consensus.cc:740] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.163166 16715 tablet_bootstrap.cc:492] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:14.163861 16715 ts_tablet_manager.cc:1403] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.139s	user 0.002s	sys 0.016s
I20260709 13:19:14.165076 16833 raft_consensus.cc:493] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.165719 16833 raft_consensus.cc:515] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.167619 16710 tablet_bootstrap.cc:654] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.167591 16715 raft_consensus.cc:359] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.168331 16715 raft_consensus.cc:385] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.168632 16715 raft_consensus.cc:740] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.169378 16715 consensus_queue.cc:260] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.170907 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72af2df1d2c54a47a37d3f35a497d2c9" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:14.171618 16661 raft_consensus.cc:2468] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:14.171794 16715 ts_tablet_manager.cc:1434] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 13:19:14.173046 16556 leader_election.cc:304] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:14.175993 16818 raft_consensus.cc:2804] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.176474 16818 raft_consensus.cc:493] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.176885 16818 raft_consensus.cc:3060] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.177971 16711 tablet_bootstrap.cc:654] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.178884 16712 consensus_queue.cc:260] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.192652 16712 ts_tablet_manager.cc:1434] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:19:14.210268 16833 leader_election.cc:290] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:14.246107 16711 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:14.249297 16515 raft_consensus.cc:2468] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:14.269209 16711 ts_tablet_manager.cc:1403] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.126s	user 0.015s	sys 0.005s
I20260709 13:19:14.270354 16555 leader_election.cc:304] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:14.221519 16930 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.210940 16932 consensus_queue.cc:1048] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.061s
I20260709 13:19:14.271657 16930 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.277937 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:14.278985 16589 raft_consensus.cc:2468] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:14.242432 16726 leader_election.cc:290] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:14.280930 16407 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:14.282109 16924 raft_consensus.cc:2804] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.282675 16924 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.283095 16924 raft_consensus.cc:3060] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.192719 16818 raft_consensus.cc:515] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.291868 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72af2df1d2c54a47a37d3f35a497d2c9" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:14.292811 16661 raft_consensus.cc:3060] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.307724 16711 raft_consensus.cc:359] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.315240 16661 raft_consensus.cc:2468] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:14.272768 16830 raft_consensus.cc:2804] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.273999 16712 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:14.193405 16715 tablet_bootstrap.cc:492] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:14.321830 16928 raft_consensus.cc:493] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.322918 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72af2df1d2c54a47a37d3f35a497d2c9" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:14.326431 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72af2df1d2c54a47a37d3f35a497d2c9" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:14.327286 16924 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.375434 16710 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:14.376029 16710 ts_tablet_manager.cc:1403] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.216s	user 0.069s	sys 0.096s
I20260709 13:19:14.379150 16710 raft_consensus.cc:359] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.379863 16710 raft_consensus.cc:385] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.380172 16710 raft_consensus.cc:740] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.379959 16960 consensus_queue.cc:1048] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:14.380923 16710 consensus_queue.cc:260] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.383209 16710 ts_tablet_manager.cc:1434] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:14.384581 16556 leader_election.cc:304] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:14.349025 16742 raft_consensus.cc:493] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.385612 16833 consensus_queue.cc:1048] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.386499 16960 raft_consensus.cc:2804] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.386757 16710 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
W20260709 13:19:14.388163 16557 leader_election.cc:343] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.327268 16711 raft_consensus.cc:385] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.403908 16960 raft_consensus.cc:697] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:14.405390 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:14.406145 16439 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.415771 16960 consensus_queue.cc:237] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.392947 16930 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.410542 16710 tablet_bootstrap.cc:654] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:14.422241 16407 leader_election.cc:343] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.423954 16715 tablet_bootstrap.cc:654] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.411343 16711 raft_consensus.cc:740] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.397976 16742 raft_consensus.cc:515] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.291674 16818 leader_election.cc:290] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:14.398089 16928 raft_consensus.cc:515] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.398627 16830 raft_consensus.cc:697] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:14.434226 16830 consensus_queue.cc:237] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:14.432619 16711 consensus_queue.cc:260] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.442451 16711 ts_tablet_manager.cc:1434] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.000s
I20260709 13:19:14.454592 16711 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:14.459383 16932 consensus_queue.cc:1048] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:14.438529 16924 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
W20260709 13:19:14.450598 16557 leader_election.cc:343] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.478426 16711 tablet_bootstrap.cc:654] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.453922 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:14.498513 16928 leader_election.cc:290] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:14.493800 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 49284.4us
W20260709 13:19:14.505581 16407 leader_election.cc:343] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.535465 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:14.536291 16588 raft_consensus.cc:3060] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.527683 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf47a28b4474e56ba716e2826c931a3" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:14.546618 16710 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:14.547405 16710 ts_tablet_manager.cc:1403] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.161s	user 0.018s	sys 0.016s
I20260709 13:19:14.553848 16712 tablet_bootstrap.cc:654] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.539657 16863 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.565083 16767 consensus_queue.cc:1048] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:14.560271 16863 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.563524 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf47a28b4474e56ba716e2826c931a3" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:14.556839 16742 leader_election.cc:290] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.576853 16969 raft_consensus.cc:493] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.577451 16969 raft_consensus.cc:515] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.579468 16588 raft_consensus.cc:2468] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:14.585678 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:14.587687 16407 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:14.579676 16969 leader_election.cc:290] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.606179 16924 raft_consensus.cc:2804] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:14.606964 16924 raft_consensus.cc:697] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:14.625617 16863 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.621392 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401e752e0f07412eb1f2506a3d7e942a" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:14.629513 16715 tablet_bootstrap.cc:492] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:14.634214 16715 ts_tablet_manager.cc:1403] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.450s	user 0.016s	sys 0.017s
I20260709 13:19:14.632776 16767 raft_consensus.cc:493] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.646844 16781 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:14.647303 16482 leader_election.cc:343] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.647477 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:14.655946 16711 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:14.656917 16711 ts_tablet_manager.cc:1403] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.203s	user 0.021s	sys 0.000s
I20260709 13:19:14.619737 16924 consensus_queue.cc:237] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:14.648267 16407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 60724.7us
W20260709 13:19:14.662140 16556 leader_election.cc:343] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.651424 16781 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.665112 16715 raft_consensus.cc:359] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.665880 16715 raft_consensus.cc:385] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.666210 16781 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:14.650972 16767 raft_consensus.cc:515] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.667860 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401e752e0f07412eb1f2506a3d7e942a" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:14.669852 16517 raft_consensus.cc:2468] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:14.671236 16767 leader_election.cc:290] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:14.666312 16715 raft_consensus.cc:740] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.672192 16715 consensus_queue.cc:260] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.673771 16710 raft_consensus.cc:359] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.674304 16711 raft_consensus.cc:359] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.674819 16710 raft_consensus.cc:385] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.675060 16711 raft_consensus.cc:385] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.675211 16710 raft_consensus.cc:740] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.675455 16711 raft_consensus.cc:740] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.676399 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:14.676241 16710 consensus_queue.cc:260] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.676208 16711 consensus_queue.cc:260] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.690394 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fd7d385a584bb7b88bfc35cd380c4e" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:14.690768 16631 leader_election.cc:343] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.691820 16555 leader_election.cc:304] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:14.693830 16710 ts_tablet_manager.cc:1434] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.146s	user 0.010s	sys 0.002s
I20260709 13:19:14.695356 16710 tablet_bootstrap.cc:492] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:14.700433 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:14.701926 16712 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:14.702457 16712 ts_tablet_manager.cc:1403] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.429s	user 0.014s	sys 0.009s
I20260709 13:19:14.704474 16715 ts_tablet_manager.cc:1434] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:19:14.706416 16715 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:14.702338 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:14.708593 16711 ts_tablet_manager.cc:1434] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:19:14.711645 16711 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:14.713016 16818 raft_consensus.cc:2804] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.719018 16818 raft_consensus.cc:493] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.719532 16818 raft_consensus.cc:3060] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.722455 16710 tablet_bootstrap.cc:654] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:14.731909 16630 leader_election.cc:343] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.733240 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:14.743978 16712 raft_consensus.cc:359] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.746271 16712 raft_consensus.cc:385] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.746498 16712 raft_consensus.cc:740] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.749377 16515 raft_consensus.cc:2468] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:14.753544 16712 consensus_queue.cc:260] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.759158 16712 ts_tablet_manager.cc:1434] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.004s
I20260709 13:19:14.759711 16715 tablet_bootstrap.cc:654] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.760257 16712 tablet_bootstrap.cc:492] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:14.766392 16711 tablet_bootstrap.cc:654] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.766361 16818 raft_consensus.cc:515] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.767467 16712 tablet_bootstrap.cc:654] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.767400 16710 tablet_bootstrap.cc:492] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:14.768433 16710 ts_tablet_manager.cc:1403] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.002s
I20260709 13:19:14.769083 16818 leader_election.cc:290] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.773916 16710 raft_consensus.cc:359] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.774703 16710 raft_consensus.cc:385] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.775617 16715 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:14.776134 16715 ts_tablet_manager.cc:1403] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.004s
I20260709 13:19:14.827155 16407 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
W20260709 13:19:14.848369 16483 leader_election.cc:343] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:14.848682 16482 leader_election.cc:343] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:14.852206 16482 leader_election.cc:304] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
W20260709 13:19:14.862582 16555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 109316us
I20260709 13:19:14.867681 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fd7d385a584bb7b88bfc35cd380c4e" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:14.878553 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:14.879264 16629 leader_election.cc:304] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:14.775111 16710 raft_consensus.cc:740] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.885571 16710 consensus_queue.cc:260] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.888496 16712 tablet_bootstrap.cc:492] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:14.889734 16339 catalog_manager.cc:5697] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.890848 16742 raft_consensus.cc:2749] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:14.891165 16711 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:14.893234 16335 catalog_manager.cc:5697] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.895973 16517 raft_consensus.cc:2468] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:14.896221 16863 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.895268 16818 raft_consensus.cc:493] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.908653 16978 raft_consensus.cc:2749] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:14.909072 16711 ts_tablet_manager.cc:1403] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.000s
I20260709 13:19:14.883090 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401e752e0f07412eb1f2506a3d7e942a" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:14.907797 16710 ts_tablet_manager.cc:1434] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.007s
I20260709 13:19:14.922011 16974 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.922786 16974 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.924206 16933 raft_consensus.cc:2804] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.924675 16933 raft_consensus.cc:493] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.925105 16933 raft_consensus.cc:3060] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.935024 16863 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.953104 16710 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:14.953104 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "401e752e0f07412eb1f2506a3d7e942a" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:14.957939 16514 raft_consensus.cc:3060] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:14.970252 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 91553.6us
I20260709 13:19:14.972456 16629 leader_election.cc:304] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:14.982563 16974 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:14.985203 16767 raft_consensus.cc:2804] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:14.985899 16767 raft_consensus.cc:493] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.986375 16767 raft_consensus.cc:3060] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:14.988590 16863 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:14.989413 16818 raft_consensus.cc:515] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:14.989825 16711 raft_consensus.cc:359] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:14.991194 16711 raft_consensus.cc:385] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.991652 16711 raft_consensus.cc:740] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:14.995311 16715 raft_consensus.cc:359] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:14.996544 16715 raft_consensus.cc:385] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:14.997489 16710 tablet_bootstrap.cc:654] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:14.999753 16712 ts_tablet_manager.cc:1403] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.240s	user 0.015s	sys 0.001s
I20260709 13:19:15.000485 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:14.992667 16711 consensus_queue.cc:260] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:15.005775 16556 leader_election.cc:343] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:15.006706 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 158257us
I20260709 13:19:15.002784 16715 raft_consensus.cc:740] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.014910 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:15.027560 16557 consensus_peers.cc:597] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.032409 16407 leader_election.cc:343] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.033464 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.034152 16711 ts_tablet_manager.cc:1434] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.124s	user 0.013s	sys 0.002s
I20260709 13:19:15.036607 16711 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:15.032414 16969 consensus_queue.cc:1048] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20260709 13:19:15.042650 16407 leader_election.cc:343] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:15.042775 16556 leader_election.cc:343] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.038007 16715 consensus_queue.cc:260] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:15.043522 16712 raft_consensus.cc:359] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.012663 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.064018 16712 raft_consensus.cc:385] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.003049 16818 leader_election.cc:290] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
W20260709 13:19:15.054903 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 171858us
I20260709 13:19:15.064569 16712 raft_consensus.cc:740] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.068518 16712 consensus_queue.cc:260] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.070813 16712 ts_tablet_manager.cc:1434] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:19:15.064437 16407 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:15.079815 16715 ts_tablet_manager.cc:1434] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.303s	user 0.012s	sys 0.000s
W20260709 13:19:15.080884 16482 leader_election.cc:343] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.086992 16482 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
W20260709 13:19:15.089542 16407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 46951.7us
I20260709 13:19:15.090404 16988 raft_consensus.cc:2749] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.097980 16712 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
W20260709 13:19:15.102118 16407 leader_election.cc:343] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.111636 16514 raft_consensus.cc:2468] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:15.115712 16830 raft_consensus.cc:493] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.116669 16830 raft_consensus.cc:515] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:15.119874 16830 leader_election.cc:290] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:15.120107 16863 consensus_queue.cc:1048] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:15.121641 16557 consensus_peers.cc:597] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.128069 16711 tablet_bootstrap.cc:654] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.130295 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.137648 16972 raft_consensus.cc:2749] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.137825 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:15.141064 16557 leader_election.cc:343] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:15.144284 16556 leader_election.cc:343] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.144903 16556 leader_election.cc:304] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:15.146023 16830 raft_consensus.cc:2749] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.149296 16715 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
W20260709 13:19:15.149523 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 84369.2us
I20260709 13:19:15.168957 16555 leader_election.cc:304] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:15.169154 16990 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.169149 16767 raft_consensus.cc:515] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.170172 16990 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:15.172971 16767 leader_election.cc:290] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.174515 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.175400 16514 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:15.176564 16933 raft_consensus.cc:515] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.179275 16933 leader_election.cc:290] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:15.180112 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:15.182973 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf47a28b4474e56ba716e2826c931a3" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:15.183861 16514 raft_consensus.cc:3060] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.185518 16712 tablet_bootstrap.cc:654] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.179842 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fd7d385a584bb7b88bfc35cd380c4e" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:15.188977 16990 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:15.189337 16513 raft_consensus.cc:3060] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.190941 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf47a28b4474e56ba716e2826c931a3" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:15.191286 16830 raft_consensus.cc:2804] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:15.191964 16830 raft_consensus.cc:697] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:15.193212 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fd7d385a584bb7b88bfc35cd380c4e" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:15.193517 16830 consensus_queue.cc:237] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:15.194455 16631 leader_election.cc:343] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.194675 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:15.195971 16630 leader_election.cc:343] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.197391 16661 raft_consensus.cc:3060] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.198084 16630 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:15.201448 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.202206 16515 raft_consensus.cc:2468] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:15.197839 16514 raft_consensus.cc:2468] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:15.204416 16963 consensus_queue.cc:1048] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:15.204998 16629 leader_election.cc:304] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:15.206459 16928 raft_consensus.cc:2804] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:15.208395 16928 raft_consensus.cc:697] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:15.209617 16928 consensus_queue.cc:237] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.213279 16555 leader_election.cc:304] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:15.215899 16960 raft_consensus.cc:2804] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:15.216485 16960 raft_consensus.cc:493] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.216982 16960 raft_consensus.cc:3060] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.229214 16711 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:15.229921 16711 ts_tablet_manager.cc:1403] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.194s	user 0.029s	sys 0.019s
I20260709 13:19:15.243433 16406 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:15.244714 16863 raft_consensus.cc:2804] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:15.245160 16863 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.245517 16863 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.249891 16710 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:15.250455 16710 ts_tablet_manager.cc:1403] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.298s	user 0.017s	sys 0.011s
I20260709 13:19:15.255834 16710 raft_consensus.cc:359] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.258124 16710 raft_consensus.cc:385] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.259836 16710 raft_consensus.cc:740] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.264492 16710 consensus_queue.cc:260] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.272943 16711 raft_consensus.cc:359] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.274885 16711 raft_consensus.cc:385] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.275251 16711 raft_consensus.cc:740] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.273299 16974 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.283538 16711 consensus_queue.cc:260] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.295694 16974 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.302115 16933 raft_consensus.cc:2749] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.305480 16974 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:15.304244 16710 ts_tablet_manager.cc:1434] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.002s
I20260709 13:19:15.310127 16711 ts_tablet_manager.cc:1434] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 13:19:15.317268 16987 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.323545 16987 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.325699 16863 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.328473 16987 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.332599 16710 tablet_bootstrap.cc:492] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:15.322297 16975 raft_consensus.cc:493] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.334539 16975 raft_consensus.cc:515] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.338680 16975 leader_election.cc:290] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:15.338855 16712 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:15.322387 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.339529 16712 ts_tablet_manager.cc:1403] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.266s	user 0.013s	sys 0.017s
I20260709 13:19:15.340055 16512 raft_consensus.cc:2468] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:15.341671 16710 tablet_bootstrap.cc:654] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.342365 16975 consensus_queue.cc:1048] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:15.342979 16712 raft_consensus.cc:359] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.344082 16712 raft_consensus.cc:385] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.344209 16513 raft_consensus.cc:2468] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:15.344388 16712 raft_consensus.cc:740] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.363005 16712 consensus_queue.cc:260] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.368225 16711 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:15.361780 16406 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:15.321259 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.358573 16629 leader_election.cc:304] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
W20260709 13:19:15.377470 16407 leader_election.cc:343] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.378429 16975 raft_consensus.cc:2804] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:15.378912 16975 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.379308 16975 raft_consensus.cc:3060] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.381872 16767 raft_consensus.cc:2804] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:15.382385 16767 raft_consensus.cc:697] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:15.384322 16715 tablet_bootstrap.cc:654] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.379316 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:15.386821 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:15.386831 16482 leader_election.cc:343] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.389545 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf47a28b4474e56ba716e2826c931a3" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.390486 16513 raft_consensus.cc:2393] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:15.366780 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf47a28b4474e56ba716e2826c931a3" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.391376 16767 consensus_queue.cc:237] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.391629 16975 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.407275 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:15.410667 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:15.412319 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:15.413089 16514 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.414003 16661 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.416989 16407 leader_election.cc:304] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:15.421741 16407 leader_election.cc:343] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.422638 16974 raft_consensus.cc:3060] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.428187 16712 ts_tablet_manager.cc:1434] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.088s	user 0.008s	sys 0.001s
I20260709 13:19:15.427168 16863 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:15.434600 16661 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
W20260709 13:19:15.438515 16483 leader_election.cc:343] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.416524 16960 raft_consensus.cc:515] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.449849 16960 leader_election.cc:290] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:15.451196 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:15.452560 16407 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:15.457263 16988 raft_consensus.cc:2804] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:15.457857 16988 raft_consensus.cc:697] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
W20260709 13:19:15.457923 16556 leader_election.cc:343] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.459266 16988 consensus_queue.cc:237] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.461874 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:15.462613 16515 raft_consensus.cc:3060] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.455953 16975 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:15.439318 16483 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:15.468144 16987 raft_consensus.cc:2749] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.472008 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:15.472827 16512 raft_consensus.cc:3060] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.489638 16512 raft_consensus.cc:2468] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:15.491778 16767 raft_consensus.cc:493] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.491689 16555 leader_election.cc:304] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:15.492400 16767 raft_consensus.cc:515] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.493872 16960 raft_consensus.cc:2804] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:15.494623 16960 raft_consensus.cc:697] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:15.495404 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.496019 16767 leader_election.cc:290] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.496646 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:15.499897 16629 leader_election.cc:343] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.501184 16987 raft_consensus.cc:493] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.501818 16987 raft_consensus.cc:515] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:15.503146 16630 leader_election.cc:343] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.503866 16630 leader_election.cc:304] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:15.472342 16711 tablet_bootstrap.cc:654] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.506120 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.501289 16712 tablet_bootstrap.cc:492] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:15.508185 16767 raft_consensus.cc:2749] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.515967 16987 leader_election.cc:290] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:15.513705 16482 leader_election.cc:343] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.516814 16515 raft_consensus.cc:2468] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:15.534803 16406 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:15.535912 16863 raft_consensus.cc:2804] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:15.536444 16863 raft_consensus.cc:697] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:15.537315 16863 consensus_queue.cc:237] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:15.539204 16710 tablet_bootstrap.cc:492] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:15.539736 16710 ts_tablet_manager.cc:1403] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.208s	user 0.017s	sys 0.024s
I20260709 13:19:15.546802 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:15.530987 16974 raft_consensus.cc:2749] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.554412 16340 catalog_manager.cc:5697] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:15.556286 16483 leader_election.cc:343] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.557392 16483 leader_election.cc:304] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:15.552841 16715 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:15.548281 16710 raft_consensus.cc:359] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.526597 16960 consensus_queue.cc:237] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.557438 16340 catalog_manager.cc:5697] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.558997 16715 ts_tablet_manager.cc:1403] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.412s	user 0.009s	sys 0.011s
I20260709 13:19:15.553802 16514 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:15.559052 16712 tablet_bootstrap.cc:654] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.559453 16710 raft_consensus.cc:385] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.558946 16987 raft_consensus.cc:2749] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.564473 16710 raft_consensus.cc:740] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.565598 16710 consensus_queue.cc:260] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.568024 16710 ts_tablet_manager.cc:1434] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:19:15.570729 16711 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:15.571300 16711 ts_tablet_manager.cc:1403] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.001s
I20260709 13:19:15.581712 16710 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:15.582333 16711 raft_consensus.cc:359] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.584628 16711 raft_consensus.cc:385] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.585599 16711 raft_consensus.cc:740] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.587826 16711 consensus_queue.cc:260] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.598150 16336 catalog_manager.cc:5697] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.602542 16710 tablet_bootstrap.cc:654] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.610036 16336 catalog_manager.cc:5697] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:15.613384 16711 ts_tablet_manager.cc:1434] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:19:15.616920 16711 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:15.617578 16969 consensus_queue.cc:1048] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:15.626808 16711 tablet_bootstrap.cc:654] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.635362 16715 raft_consensus.cc:359] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:15.636425 16715 raft_consensus.cc:385] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.641772 16340 catalog_manager.cc:5697] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.636726 16715 raft_consensus.cc:740] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.668208 16712 tablet_bootstrap.cc:492] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:15.669127 16712 ts_tablet_manager.cc:1403] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.006s
I20260709 13:19:15.690886 16715 consensus_queue.cc:260] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:15.740633 16340 catalog_manager.cc:5697] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.742412 16340 catalog_manager.cc:5697] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:15.743871 16928 consensus_queue.cc:1048] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:15.756532 16556 consensus_peers.cc:597] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 -> Peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Couldn't send request to peer ccb9eea20c4f4b309b2b16f8edb35d4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.770833 16712 raft_consensus.cc:359] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.777513 16712 raft_consensus.cc:385] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.777887 16712 raft_consensus.cc:740] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.782618 16863 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.783334 16863 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.783968 16711 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:15.785782 16711 ts_tablet_manager.cc:1403] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.169s	user 0.020s	sys 0.004s
I20260709 13:19:15.787635 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:15.788516 16987 raft_consensus.cc:493] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.789104 16987 raft_consensus.cc:515] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:15.790521 16407 leader_election.cc:343] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.791340 16863 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.792613 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:15.794533 16711 raft_consensus.cc:359] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.796176 16711 raft_consensus.cc:385] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.796080 16712 consensus_queue.cc:260] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.796593 16711 raft_consensus.cc:740] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
W20260709 13:19:15.799463 16482 leader_election.cc:343] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.799809 16710 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:15.800330 16710 ts_tablet_manager.cc:1403] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.219s	user 0.042s	sys 0.036s
W20260709 13:19:15.800364 16630 consensus_peers.cc:597] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.801391 16987 leader_election.cc:290] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:15.803980 16710 raft_consensus.cc:359] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.804811 16710 raft_consensus.cc:385] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:15.805119 16710 raft_consensus.cc:740] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:15.805903 16710 consensus_queue.cc:260] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.808684 16710 ts_tablet_manager.cc:1434] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:15.814085 16715 ts_tablet_manager.cc:1434] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.253s	user 0.005s	sys 0.004s
I20260709 13:19:15.813612 16711 consensus_queue.cc:260] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.819890 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.820046 16933 consensus_queue.cc:1048] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:15.831773 16515 raft_consensus.cc:2468] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:15.833460 16406 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:15.839217 16715 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:15.848764 16975 raft_consensus.cc:2804] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:15.849298 16975 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.849644 16975 raft_consensus.cc:3060] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.850405 16710 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:15.881350 16767 raft_consensus.cc:493] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.891027 16863 raft_consensus.cc:493] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.938706 16715 tablet_bootstrap.cc:654] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.939023 16863 raft_consensus.cc:515] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.871255 16975 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.907565 16712 ts_tablet_manager.cc:1434] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.238s	user 0.010s	sys 0.000s
I20260709 13:19:15.909289 16711 ts_tablet_manager.cc:1434] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.001s
W20260709 13:19:15.927963 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 108180us
I20260709 13:19:15.943681 16712 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:15.937940 16767 raft_consensus.cc:515] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:15.946983 16711 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:15.959983 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:15.961086 16863 leader_election.cc:290] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.949141 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.961843 16662 raft_consensus.cc:2468] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:15.962692 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:15.897492 16960 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.965297 16960 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:15.967552 16960 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:15.970183 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:15.970978 16441 raft_consensus.cc:2468] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:15.973034 16557 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:15.973567 16711 tablet_bootstrap.cc:654] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.974799 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e667d5b79d2444a91b6666d783dc895" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.955856 16767 leader_election.cc:290] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.953586 16928 consensus_queue.cc:1048] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:19:15.978377 16969 raft_consensus.cc:2804] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:15.978910 16969 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.955878 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:15.979569 16969 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.979852 16514 raft_consensus.cc:3060] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:15.980206 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:15.957545 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:15.981276 16513 raft_consensus.cc:2393] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
I20260709 13:19:15.982496 16406 leader_election.cc:304] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:15.983240 16715 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:15.983700 16863 raft_consensus.cc:2749] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:15.983759 16715 ts_tablet_manager.cc:1403] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.016s
W20260709 13:19:15.984584 16407 leader_election.cc:343] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.958094 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e444695debf458f83b39578e6b6d31d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:15.986824 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:15.987203 16482 leader_election.cc:304] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:15.987739 16715 raft_consensus.cc:359] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.988020 16975 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.988405 16987 raft_consensus.cc:2804] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:19:15.988436 16556 leader_election.cc:343] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.989063 16987 raft_consensus.cc:493] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.989506 16987 raft_consensus.cc:3060] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:15.990878 16712 tablet_bootstrap.cc:654] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:15.997197 16742 raft_consensus.cc:493] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.997798 16742 raft_consensus.cc:515] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:15.998809 16629 leader_election.cc:304] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:16.000007 16742 leader_election.cc:290] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:15.988471 16715 raft_consensus.cc:385] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.000782 16767 raft_consensus.cc:3060] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.003504 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7036dbae781d42c997f89fb211d4da89" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.004962 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7036dbae781d42c997f89fb211d4da89" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:16.005360 16482 leader_election.cc:343] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:15.943727 16710 tablet_bootstrap.cc:654] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:16.006714 16483 leader_election.cc:343] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.007196 16483 leader_election.cc:304] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.008407 16742 raft_consensus.cc:2749] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.015625 16514 raft_consensus.cc:2468] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:16.017599 16767 raft_consensus.cc:2749] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.017776 16406 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.024092 16975 raft_consensus.cc:2804] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:16.026144 16975 raft_consensus.cc:697] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:16.027681 16975 consensus_queue.cc:237] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.028654 16969 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.030326 16710 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:16.030910 16710 ts_tablet_manager.cc:1403] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.181s	user 0.028s	sys 0.000s
I20260709 13:19:16.016762 16715 raft_consensus.cc:740] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.032557 16715 consensus_queue.cc:260] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.033192 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:16.034652 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:16.034840 16715 ts_tablet_manager.cc:1434] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.004s
I20260709 13:19:16.035264 16441 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.036077 16715 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
W20260709 13:19:16.038321 16556 leader_election.cc:343] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.044986 16969 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:16.047545 16441 raft_consensus.cc:2468] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:16.049737 16557 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:16.050581 16715 tablet_bootstrap.cc:654] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.062134 16711 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:16.063004 16711 ts_tablet_manager.cc:1403] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.000s
I20260709 13:19:16.066586 16863 consensus_queue.cc:1048] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:16.020094 16987 raft_consensus.cc:515] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.071760 16960 raft_consensus.cc:2804] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:16.072439 16960 raft_consensus.cc:697] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:16.073534 16960 consensus_queue.cc:237] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.074523 16987 leader_election.cc:290] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:16.074729 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:16.075356 16662 raft_consensus.cc:3060] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.076304 16710 raft_consensus.cc:359] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.077055 16710 raft_consensus.cc:385] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.077344 16710 raft_consensus.cc:740] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.078114 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:16.078059 16710 consensus_queue.cc:260] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.080184 16975 consensus_queue.cc:1048] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:16.084182 16482 leader_election.cc:343] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.080812 16711 raft_consensus.cc:359] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.113081 16711 raft_consensus.cc:385] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.113487 16711 raft_consensus.cc:740] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.114285 16711 consensus_queue.cc:260] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.090204 16710 ts_tablet_manager.cc:1434] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 13:19:16.120760 16710 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:16.095127 16339 catalog_manager.cc:5697] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.129344 16336 catalog_manager.cc:5697] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.116777 16711 ts_tablet_manager.cc:1434] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.006s
I20260709 13:19:16.132375 16711 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:16.139385 16974 consensus_queue.cc:1048] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:16.146741 16710 tablet_bootstrap.cc:654] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.157822 16960 consensus_queue.cc:1048] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:16.162714 16711 tablet_bootstrap.cc:654] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:16.163808 16407 consensus_peers.cc:597] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 -> Peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Couldn't send request to peer ccb9eea20c4f4b309b2b16f8edb35d4f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.171545 16987 raft_consensus.cc:493] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.172435 16987 raft_consensus.cc:515] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.175088 16987 leader_election.cc:290] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:16.179304 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.184903 16662 raft_consensus.cc:2468] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:16.185434 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:16.186779 16482 leader_election.cc:343] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.197666 16712 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:16.198259 16712 ts_tablet_manager.cc:1403] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.255s	user 0.027s	sys 0.040s
I20260709 13:19:16.202709 16960 consensus_queue.cc:1048] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:16.210915 16710 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:16.211520 16710 ts_tablet_manager.cc:1403] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.091s	user 0.012s	sys 0.007s
I20260709 13:19:16.213433 16712 raft_consensus.cc:359] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.214224 16712 raft_consensus.cc:385] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.214510 16712 raft_consensus.cc:740] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.214437 16710 raft_consensus.cc:359] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:16.215293 16710 raft_consensus.cc:385] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.215601 16710 raft_consensus.cc:740] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.216269 16710 consensus_queue.cc:260] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:16.217880 16710 ts_tablet_manager.cc:1434] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:19:16.218585 16482 leader_election.cc:304] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.219377 16710 tablet_bootstrap.cc:492] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
W20260709 13:19:16.221251 16483 leader_election.cc:343] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.220252 16987 raft_consensus.cc:2804] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:16.222007 16441 raft_consensus.cc:3060] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.222146 16987 raft_consensus.cc:697] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:16.226648 16483 leader_election.cc:304] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.228277 16712 consensus_queue.cc:260] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.228278 16742 raft_consensus.cc:2749] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.232466 16987 consensus_queue.cc:237] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.246635 16710 tablet_bootstrap.cc:654] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.256218 16715 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:16.257052 16715 ts_tablet_manager.cc:1403] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.221s	user 0.034s	sys 0.009s
I20260709 13:19:16.262928 16712 ts_tablet_manager.cc:1434] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 13:19:16.269724 16712 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:16.278332 16712 tablet_bootstrap.cc:654] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.280009 16715 raft_consensus.cc:359] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.280933 16715 raft_consensus.cc:385] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.281554 16715 raft_consensus.cc:740] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.285877 16715 consensus_queue.cc:260] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.303750 16974 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.304610 16974 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.352573 16974 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:16.355685 16715 ts_tablet_manager.cc:1434] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.098s	user 0.011s	sys 0.000s
I20260709 13:19:16.362927 16715 tablet_bootstrap.cc:492] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
W20260709 13:19:16.358417 16407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 69496.1us
I20260709 13:19:16.390460 16711 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:16.390460 16712 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:16.391252 16711 ts_tablet_manager.cc:1403] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.259s	user 0.014s	sys 0.006s
I20260709 13:19:16.391636 16712 ts_tablet_manager.cc:1403] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.018s
I20260709 13:19:16.396050 16712 raft_consensus.cc:359] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.397219 16712 raft_consensus.cc:385] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.397889 16712 raft_consensus.cc:740] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.398080 16711 raft_consensus.cc:359] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.399353 16711 raft_consensus.cc:385] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.399734 16711 raft_consensus.cc:740] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.400895 16711 consensus_queue.cc:260] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.404011 16711 ts_tablet_manager.cc:1434] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:19:16.405262 16711 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:16.399353 16712 consensus_queue.cc:260] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.408411 17046 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.409346 17046 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.410779 16712 ts_tablet_manager.cc:1434] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:19:16.426038 16710 tablet_bootstrap.cc:492] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:16.427177 16710 ts_tablet_manager.cc:1403] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.208s	user 0.013s	sys 0.004s
I20260709 13:19:16.432291 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.433049 16590 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:16.435146 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.437184 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:16.437929 16515 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:16.439167 16406 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:16.442679 16715 tablet_bootstrap.cc:654] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:16.416307 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 61590us
I20260709 13:19:16.446651 16863 raft_consensus.cc:2804] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:16.447793 16863 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.448448 16863 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.453271 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:16.454663 16442 raft_consensus.cc:2393] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
I20260709 13:19:16.440529 16710 raft_consensus.cc:359] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.456679 16710 raft_consensus.cc:385] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.457041 16710 raft_consensus.cc:740] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.458539 16710 consensus_queue.cc:260] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.471196 16712 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:16.473575 16711 tablet_bootstrap.cc:654] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.422820 17046 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:16.474748 17049 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.475308 17049 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.476975 16742 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.477730 16742 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:16.494668 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 48862.5us
I20260709 13:19:16.511305 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:16.517331 16710 ts_tablet_manager.cc:1434] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.089s	user 0.013s	sys 0.001s
I20260709 13:19:16.509130 16742 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:16.523033 17049 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:16.526047 16482 leader_election.cc:343] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.541601 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.496937 16631 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.545785 17036 raft_consensus.cc:493] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.546640 17036 raft_consensus.cc:515] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:16.549201 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 68114.1us
W20260709 13:19:16.551898 16630 leader_election.cc:343] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.553406 17041 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.562798 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:16.563210 17041 raft_consensus.cc:2749] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:16.576226 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 50215.9us
I20260709 13:19:16.589347 16710 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
W20260709 13:19:16.597333 16631 leader_election.cc:343] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.598140 16631 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.600589 16928 raft_consensus.cc:2749] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.612908 16963 consensus_queue.cc:1048] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:16.613376 16818 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.614111 16818 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.617125 16818 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:16.621228 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:16.622120 16514 raft_consensus.cc:2393] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate d663b44309664a8e85e27bcc0804d088 in this term.
I20260709 13:19:16.630466 17036 leader_election.cc:290] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:16.631695 16710 tablet_bootstrap.cc:654] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.633328 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:16.627492 16863 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.643498 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:16.647490 16712 tablet_bootstrap.cc:654] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.651088 16715 tablet_bootstrap.cc:492] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:16.651682 16715 ts_tablet_manager.cc:1403] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.293s	user 0.008s	sys 0.019s
I20260709 13:19:16.655817 16863 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:16.659878 16715 raft_consensus.cc:359] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.661286 16715 raft_consensus.cc:385] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.662321 16715 raft_consensus.cc:740] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.665316 17053 consensus_queue.cc:1048] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:16.666803 16483 leader_election.cc:343] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.668402 16483 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:16.666596 16715 consensus_queue.cc:260] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.674564 17057 raft_consensus.cc:2749] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.675272 16715 ts_tablet_manager.cc:1434] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 13:19:16.676481 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72af2df1d2c54a47a37d3f35a497d2c9" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:16.676999 16715 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:16.689080 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72af2df1d2c54a47a37d3f35a497d2c9" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.689558 16588 raft_consensus.cc:3060] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.694478 17036 consensus_queue.cc:1048] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:16.708003 16557 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:16.731436 16711 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:16.732079 16711 ts_tablet_manager.cc:1403] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.327s	user 0.048s	sys 0.034s
I20260709 13:19:16.738621 16710 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:16.739424 16407 leader_election.cc:304] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.741715 17036 raft_consensus.cc:2749] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.739447 16710 ts_tablet_manager.cc:1403] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.150s	user 0.008s	sys 0.008s
I20260709 13:19:16.742815 16712 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:16.743350 16712 ts_tablet_manager.cc:1403] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.321s	user 0.009s	sys 0.009s
I20260709 13:19:16.746531 16712 raft_consensus.cc:359] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:16.747581 16712 raft_consensus.cc:385] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.747900 16712 raft_consensus.cc:740] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.747773 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:16.752079 16712 consensus_queue.cc:260] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:16.752826 16513 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.739800 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:16.754062 16963 raft_consensus.cc:2749] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.765194 16591 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.791589 17036 consensus_queue.cc:1048] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:16.795750 16591 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:16.795753 16513 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:16.799201 16407 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:16.802953 16712 ts_tablet_manager.cc:1434] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.000s
I20260709 13:19:16.804353 16712 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:16.809978 16710 raft_consensus.cc:359] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.810957 16710 raft_consensus.cc:385] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.811322 16710 raft_consensus.cc:740] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.812122 16710 consensus_queue.cc:260] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.814663 16710 ts_tablet_manager.cc:1434] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:19:16.815618 16710 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:16.820547 16715 tablet_bootstrap.cc:654] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.821604 16710 tablet_bootstrap.cc:654] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.822104 17036 raft_consensus.cc:2804] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:16.824800 16711 raft_consensus.cc:359] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.829780 16711 raft_consensus.cc:385] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.830150 16711 raft_consensus.cc:740] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.832002 16711 consensus_queue.cc:260] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.845202 16712 tablet_bootstrap.cc:654] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.849556 16340 catalog_manager.cc:5697] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.833381 17036 raft_consensus.cc:697] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:16.852520 17036 consensus_queue.cc:237] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.855815 17051 raft_consensus.cc:493] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.856402 17051 raft_consensus.cc:515] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.857491 16742 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.857704 16711 ts_tablet_manager.cc:1434] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.004s
I20260709 13:19:16.858047 16742 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.858664 17051 leader_election.cc:290] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:16.858968 16711 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:16.860293 16742 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:16.867002 16482 consensus_peers.cc:597] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.878131 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:16.880451 16441 raft_consensus.cc:3060] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:16.883008 16437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:16.883780 16437 raft_consensus.cc:2468] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:16.875705 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:16.887785 16556 leader_election.cc:343] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.889376 16710 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:16.889926 16710 ts_tablet_manager.cc:1403] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.005s
I20260709 13:19:16.893746 16715 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:16.894286 16715 ts_tablet_manager.cc:1403] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.003s
I20260709 13:19:16.894685 16712 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:16.895252 16712 ts_tablet_manager.cc:1403] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.091s	user 0.007s	sys 0.006s
I20260709 13:19:16.897881 16712 raft_consensus.cc:359] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.898576 16712 raft_consensus.cc:385] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.898856 16712 raft_consensus.cc:740] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.904454 16557 leader_election.cc:304] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:16.905616 17061 raft_consensus.cc:2804] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:16.906085 17061 raft_consensus.cc:493] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.906222 17053 raft_consensus.cc:493] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.906454 17061 raft_consensus.cc:3060] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:16.906580 16482 leader_election.cc:343] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.906807 17053 raft_consensus.cc:515] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.908243 16742 consensus_queue.cc:1048] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:16.910459 17053 leader_election.cc:290] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:16.910686 16437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:16.914181 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fd7d385a584bb7b88bfc35cd380c4e" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:16.915654 16715 raft_consensus.cc:359] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.918432 16715 raft_consensus.cc:385] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.918069 16712 consensus_queue.cc:260] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:16.914738 16710 raft_consensus.cc:359] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:16.918727 16715 raft_consensus.cc:740] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.919480 16710 raft_consensus.cc:385] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:16.919793 16710 raft_consensus.cc:740] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:16.927049 16715 consensus_queue.cc:260] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:16.927958 16712 ts_tablet_manager.cc:1434] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
W20260709 13:19:16.941478 17069 log.cc:927] Time spent T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:19:16.954186 16483 leader_election.cc:343] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:16.954979 16483 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:16.961511 16742 raft_consensus.cc:2749] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:16.969087 16711 tablet_bootstrap.cc:654] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:16.959065 16710 consensus_queue.cc:260] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:16.989367 16710 ts_tablet_manager.cc:1434] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.002s
I20260709 13:19:16.991969 16710 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:16.995486 17054 raft_consensus.cc:493] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.996291 17054 raft_consensus.cc:515] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:16.999284 17061 raft_consensus.cc:515] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:17.001253 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fd7d385a584bb7b88bfc35cd380c4e" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:17.007685 16715 ts_tablet_manager.cc:1434] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
W20260709 13:19:17.010190 17072 log.cc:927] Time spent T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:19:17.012403 17054 leader_election.cc:290] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:17.016079 16588 raft_consensus.cc:3060] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.024901 16712 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:17.053359 16712 tablet_bootstrap.cc:654] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.055908 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:17.056826 17049 raft_consensus.cc:493] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.057628 17049 raft_consensus.cc:515] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:17.062707 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:17.065202 17049 leader_election.cc:290] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:17.068100 17049 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.068768 17049 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:17.069664 16556 leader_election.cc:304] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:17.073920 16482 leader_election.cc:343] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:17.074541 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:17.077893 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:17.086679 17049 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:17.068665 16715 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:17.122679 16586 raft_consensus.cc:2393] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
W20260709 13:19:17.138877 16482 leader_election.cc:343] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:17.139727 16482 leader_election.cc:304] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:17.144841 16818 raft_consensus.cc:493] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.179875 17055 raft_consensus.cc:493] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.238972 16818 raft_consensus.cc:515] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.239066 17055 raft_consensus.cc:515] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:17.163033 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:17.176803 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:17.249720 16440 raft_consensus.cc:2468] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:17.236312 16660 raft_consensus.cc:3060] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.251585 16631 leader_election.cc:304] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:17.253126 17046 raft_consensus.cc:2804] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:17.253744 17046 raft_consensus.cc:493] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.254236 17046 raft_consensus.cc:3060] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.242429 17055 leader_election.cc:290] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:17.247383 17054 raft_consensus.cc:2749] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:17.263701 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:17.265672 16483 leader_election.cc:343] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:17.262595 16818 leader_election.cc:290] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:17.279639 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 49965.8us
I20260709 13:19:17.362977 16631 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:17.417335 16711 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:17.417961 16711 ts_tablet_manager.cc:1403] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.559s	user 0.058s	sys 0.096s
I20260709 13:19:17.421897 16439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:17.415370 17061 leader_election.cc:290] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:17.456405 16712 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:17.457084 16712 ts_tablet_manager.cc:1403] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.479s	user 0.014s	sys 0.038s
I20260709 13:19:17.462638 16715 tablet_bootstrap.cc:654] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.477793 16710 tablet_bootstrap.cc:654] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:17.504448 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 365594us
I20260709 13:19:17.510677 16712 raft_consensus.cc:359] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:17.511564 16712 raft_consensus.cc:385] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.519767 16712 raft_consensus.cc:740] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.524062 16711 raft_consensus.cc:359] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.524722 16711 raft_consensus.cc:385] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.525070 16711 raft_consensus.cc:740] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.522390 16712 consensus_queue.cc:260] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:17.525754 16711 consensus_queue.cc:260] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.527659 16712 ts_tablet_manager.cc:1434] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 13:19:17.529342 16712 tablet_bootstrap.cc:492] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:17.530958 17046 raft_consensus.cc:515] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:17.535085 16711 ts_tablet_manager.cc:1434] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.000s
I20260709 13:19:17.536309 16711 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:17.537247 16557 leader_election.cc:343] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:17.537338 16712 tablet_bootstrap.cc:654] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.544358 16437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:17.545568 16437 raft_consensus.cc:3060] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.547346 17036 consensus_queue.cc:1048] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:17.548405 17054 raft_consensus.cc:493] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.549132 17054 raft_consensus.cc:515] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:17.552466 17054 leader_election.cc:290] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:17.558322 16438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:17.564548 16441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.028s	sys 0.055s
I20260709 13:19:17.578807 16710 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:17.579711 16710 ts_tablet_manager.cc:1403] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.588s	user 0.031s	sys 0.027s
W20260709 13:19:17.571142 16441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.031s	sys 0.055s
I20260709 13:19:17.289686 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:17.582165 16512 raft_consensus.cc:2468] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:17.583108 16710 raft_consensus.cc:359] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.583966 16710 raft_consensus.cc:385] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.584283 16710 raft_consensus.cc:740] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
W20260709 13:19:17.420749 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 68875.9us
I20260709 13:19:17.589903 16437 raft_consensus.cc:2468] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:17.614723 16557 leader_election.cc:304] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:17.619525 17055 raft_consensus.cc:493] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.620158 17055 raft_consensus.cc:515] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.685595 16711 tablet_bootstrap.cc:654] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.712787 16715 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:17.713598 16715 ts_tablet_manager.cc:1403] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.645s	user 0.017s	sys 0.002s
I20260709 13:19:17.718673 16712 tablet_bootstrap.cc:492] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:17.719295 16712 ts_tablet_manager.cc:1403] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.190s	user 0.020s	sys 0.022s
I20260709 13:19:17.722808 16712 raft_consensus.cc:359] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:17.723762 16712 raft_consensus.cc:385] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.721067 16710 consensus_queue.cc:260] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.724735 16712 raft_consensus.cc:740] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.726004 16742 raft_consensus.cc:493] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.726086 16712 consensus_queue.cc:260] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:17.726603 16742 raft_consensus.cc:515] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.729076 17046 leader_election.cc:290] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:17.731419 16712 ts_tablet_manager.cc:1434] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:19:17.730199 16742 leader_election.cc:290] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:17.732491 16712 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:17.734359 17050 raft_consensus.cc:2804] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:17.735076 17050 raft_consensus.cc:697] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:17.736157 17050 consensus_queue.cc:237] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:17.751259 16483 leader_election.cc:343] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:17.755191 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7036dbae781d42c997f89fb211d4da89" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:17.756842 16436 raft_consensus.cc:2468] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:17.764840 16710 ts_tablet_manager.cc:1434] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.185s	user 0.006s	sys 0.003s
I20260709 13:19:17.792184 16715 raft_consensus.cc:359] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.793411 16715 raft_consensus.cc:385] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:17.793783 16715 raft_consensus.cc:740] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:17.798295 16715 consensus_queue.cc:260] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:17.800519 16712 tablet_bootstrap.cc:654] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:17.811256 16441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:17.794413 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:17.797168 17051 raft_consensus.cc:2749] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:17.836319 16660 consensus_meta.cc:287] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.002s
I20260709 13:19:17.842573 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:17.843623 16663 raft_consensus.cc:2393] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:17.816748 16436 raft_consensus.cc:2393] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
W20260709 13:19:17.866109 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 113389us
I20260709 13:19:17.876243 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:17.880095 16555 leader_election.cc:304] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:17.882797 16630 leader_election.cc:304] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:17.885113 17094 raft_consensus.cc:2804] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:17.885874 17094 raft_consensus.cc:493] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.886240 17094 raft_consensus.cc:3060] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.885151 17081 raft_consensus.cc:2749] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:17.919087 16665 raft_consensus.cc:3060] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:17.978170 16483 leader_election.cc:304] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:17.979508 16483 leader_election.cc:343] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:17.985309 17090 raft_consensus.cc:2804] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:17.994233 17090 raft_consensus.cc:493] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.994722 17090 raft_consensus.cc:3060] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.024750 17094 raft_consensus.cc:515] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.028365 17094 leader_election.cc:290] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:18.028928 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:18.030174 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7036dbae781d42c997f89fb211d4da89" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:18.035333 17090 raft_consensus.cc:515] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:18.058028 16482 leader_election.cc:343] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.058622 16482 leader_election.cc:304] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:18.059921 17093 raft_consensus.cc:2749] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.060470 16587 raft_consensus.cc:2468] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:18.067158 17100 consensus_queue.cc:1048] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:18.070681 16406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 108458us
I20260709 13:19:18.071010 16715 ts_tablet_manager.cc:1434] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.357s	user 0.017s	sys 0.009s
I20260709 13:19:18.072237 16715 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
W20260709 13:19:18.080999 16555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 97948.2us
I20260709 13:19:18.083097 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:18.083801 16514 raft_consensus.cc:3060] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.060531 17049 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.089340 17090 leader_election.cc:290] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:18.100909 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7036dbae781d42c997f89fb211d4da89" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:18.109149 16440 raft_consensus.cc:3060] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.101996 17049 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.117537 16440 raft_consensus.cc:2468] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:18.117784 17049 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.119504 16710 tablet_bootstrap.cc:492] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:18.120121 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:18.122081 16630 leader_election.cc:343] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.122347 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.123484 16715 tablet_bootstrap.cc:654] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:18.124037 16631 leader_election.cc:343] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.124404 16483 leader_election.cc:304] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:18.124585 16631 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:18.125415 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7036dbae781d42c997f89fb211d4da89" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:18.099112 16928 raft_consensus.cc:2749] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.128400 16711 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:18.129151 16711 ts_tablet_manager.cc:1403] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.593s	user 0.022s	sys 0.009s
I20260709 13:19:18.125440 17090 raft_consensus.cc:2804] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.126940 16586 raft_consensus.cc:3060] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.131664 16588 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34764 (request call id 75) took 1116 ms. Trace:
I20260709 13:19:18.125931 17049 raft_consensus.cc:2749] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.132293 16588 rpcz_store.cc:276] 0709 13:19:17.015101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.015526 (+   425us) service_pool.cc:224] Handling call
0709 13:19:17.015908 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:17.049640 (+ 33732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:17.049696 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:17.058610 (+  8914us) log.cc:844] Serialized 26 byte log entry
0709 13:19:17.730809 (+672199us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:19:17.761220 (+ 30411us) log.cc:844] Serialized 14 byte log entry
0709 13:19:17.790130 (+ 28910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:17.795694 (+  5564us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:18.131108 (+335414us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000ef220. stack: 00007fce6cc7b343 00007fce6cc7b240 00007fce6c60a1d4 00007fce76348304 00007fce76348299 00007fce6fd03571 00007fce6fd0fdbe 00007fce6fd1a930 00007fce6fd1a8d8 00007fce6fd1a858 00007fce6fd1a813 00007fce6fd19a9c 00007fce75c05626 00007fce75bffdd8 00007fce6fd567cb 00007fce6fd592c0
0709 13:19:18.131349 (+   241us) raft_consensus.cc:1685] finished
0709 13:19:18.131456 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:18.131582 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8770,"prepare.queue_time_us":57420,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":29537,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":2955,"spinlock_wait_cycles":564342656,"thread_start_us":380916,"threads_started":2,"wal-append.queue_time_us":391343}
I20260709 13:19:18.134990 17055 leader_election.cc:290] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:18.143688 16514 raft_consensus.cc:2468] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:18.148294 16712 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:18.148846 16712 ts_tablet_manager.cc:1403] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.417s	user 0.015s	sys 0.022s
I20260709 13:19:18.149654 16555 leader_election.cc:304] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:18.150605 17104 log.cc:927] Time spent T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
I20260709 13:19:18.153411 16818 raft_consensus.cc:2804] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.154147 16818 raft_consensus.cc:697] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:18.154146 16712 raft_consensus.cc:359] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.156134 16712 raft_consensus.cc:385] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.155294 16818 consensus_queue.cc:237] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.157747 16712 raft_consensus.cc:740] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.158490 16712 consensus_queue.cc:260] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.130689 17090 raft_consensus.cc:697] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
W20260709 13:19:18.165426 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:18.164654 16335 catalog_manager.cc:5697] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:17.767179 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 152592us
I20260709 13:19:18.175872 16711 raft_consensus.cc:359] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.177246 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:18.176756 16711 raft_consensus.cc:385] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.178238 16711 raft_consensus.cc:740] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.178886 16711 consensus_queue.cc:260] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.179834 16436 raft_consensus.cc:3060] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:18.182097 16629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.006s	sys 0.034s
I20260709 13:19:18.181820 17090 consensus_queue.cc:237] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.186909 16586 raft_consensus.cc:2468] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:18.190845 16340 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38088 (request call id 76) took 1422 ms. Trace:
W20260709 13:19:18.182458 16629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.006s	sys 0.034s
I20260709 13:19:18.193331 16711 ts_tablet_manager.cc:1434] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.001s
I20260709 13:19:18.191279 16340 rpcz_store.cc:276] 0709 13:19:16.768974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.769138 (+   164us) service_pool.cc:224] Handling call
0709 13:19:18.190766 (+1421628us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:16.888952 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:16.899971 (+ 11019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:16.900020 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:19:16.900071 (+    51us) tablet.cc:662] Decoding operations
0709 13:19:16.900424 (+   353us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:16.900512 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:16.900550 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:16.900745 (+   195us) tablet.cc:701] Row locks acquired
0709 13:19:16.900761 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:19:16.900934 (+   173us) write_op.cc:270] Start()
0709 13:19:16.901070 (+   136us) write_op.cc:276] Timestamp: P: 1783603156900886 usec, L: 0
0709 13:19:16.901092 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:19:16.901813 (+   721us) log.cc:844] Serialized 537 byte log entry
0709 13:19:17.389917 (+488104us) op_driver.cc:464] REPLICATION: finished
0709 13:19:17.468928 (+ 79011us) write_op.cc:301] APPLY: starting
0709 13:19:17.471604 (+  2676us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:17.473571 (+  1967us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:17.481716 (+  8145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:17.522152 (+ 40436us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:17.540638 (+ 18486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:19:17.540689 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:17.555396 (+ 14707us) log.cc:844] Serialized 22 byte log entry
0709 13:19:17.571400 (+ 16004us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.572390 (+   990us) write_op.cc:454] Released schema lock
0709 13:19:17.573558 (+  1168us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:17.585790 (+ 12232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.585823 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":105097,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":69636,"apply.run_cpu_time_us":2949,"apply.run_wall_time_us":118487,"num_ops":1,"prepare.queue_time_us":22185,"prepare.run_cpu_time_us":2965,"prepare.run_wall_time_us":40195,"replication_time_us":468391,"thread_start_us":69798,"threads_started":2}]]}
I20260709 13:19:18.208720 16712 ts_tablet_manager.cc:1434] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 13:19:18.230060 16710 tablet_bootstrap.cc:654] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.232265 16711 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:18.242761 16711 tablet_bootstrap.cc:654] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.255247 16715 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:18.255930 16715 ts_tablet_manager.cc:1403] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.184s	user 0.018s	sys 0.013s
I20260709 13:19:18.259006 16712 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:18.321139 16715 raft_consensus.cc:359] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.321899 16715 raft_consensus.cc:385] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.322201 16715 raft_consensus.cc:740] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.322889 16715 consensus_queue.cc:260] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.323594 16436 raft_consensus.cc:2468] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:18.352166 16710 tablet_bootstrap.cc:492] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:18.375450 16710 ts_tablet_manager.cc:1403] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.594s	user 0.057s	sys 0.041s
I20260709 13:19:18.349923 16715 ts_tablet_manager.cc:1434] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 13:19:18.379686 16712 tablet_bootstrap.cc:654] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.389600 16715 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:18.390005 17053 consensus_queue.cc:1048] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.397430 16710 raft_consensus.cc:359] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.398375 16710 raft_consensus.cc:385] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.398811 16710 raft_consensus.cc:740] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.399789 16710 consensus_queue.cc:260] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.405315 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.407325 16710 ts_tablet_manager.cc:1434] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.003s
I20260709 13:19:18.407004 17055 raft_consensus.cc:493] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccb9eea20c4f4b309b2b16f8edb35d4f)
I20260709 13:19:18.411755 17055 raft_consensus.cc:515] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.412680 16711 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:18.416250 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.413879 17055 leader_election.cc:290] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.414728 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.421233 16661 raft_consensus.cc:2468] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:18.415669 16336 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38108 (request call id 71) took 1550 ms. Trace:
I20260709 13:19:18.422138 16336 rpcz_store.cc:276] 0709 13:19:16.870086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.870246 (+   160us) service_pool.cc:224] Handling call
0709 13:19:18.415613 (+1545367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24466,"reported_tablets":1}
I20260709 13:19:18.416742 16339 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38092 (request call id 59) took 1397 ms. Trace:
I20260709 13:19:18.423146 16339 rpcz_store.cc:276] 0709 13:19:17.019405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.138859 (+119454us) service_pool.cc:224] Handling call
0709 13:19:18.416682 (+1277823us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8452,"reported_tablets":1}
I20260709 13:19:18.418049 16335 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38074 (request call id 68) took 1540 ms. Trace:
I20260709 13:19:18.424422 16335 rpcz_store.cc:276] 0709 13:19:16.877877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.878015 (+   138us) service_pool.cc:224] Handling call
0709 13:19:18.417994 (+1539979us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:18.277101 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:18.316201 (+ 39100us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:18.316237 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:18.316255 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:18.316604 (+   349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:18.316661 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:18.324462 (+  7801us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:18.324695 (+   233us) tablet.cc:701] Row locks acquired
0709 13:19:18.324713 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:19:18.324846 (+   133us) write_op.cc:270] Start()
0709 13:19:18.324982 (+   136us) write_op.cc:276] Timestamp: P: 1783603158324807 usec, L: 0
0709 13:19:18.325003 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.326153 (+  1150us) log.cc:844] Serialized 537 byte log entry
0709 13:19:18.362303 (+ 36150us) op_driver.cc:464] REPLICATION: finished
0709 13:19:18.377574 (+ 15271us) write_op.cc:301] APPLY: starting
0709 13:19:18.377663 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:18.377773 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:18.377924 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:18.378136 (+   212us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:18.378320 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:19:18.378371 (+    51us) write_op.cc:312] APPLY: finished
0709 13:19:18.378590 (+   219us) log.cc:844] Serialized 22 byte log entry
0709 13:19:18.381205 (+  2615us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.381298 (+    93us) write_op.cc:454] Released schema lock
0709 13:19:18.381336 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:18.382204 (+   868us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:18.382245 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":14999,"apply.run_cpu_time_us":1747,"apply.run_wall_time_us":4619,"num_ops":1,"prepare.queue_time_us":84211,"prepare.run_cpu_time_us":6615,"prepare.run_wall_time_us":67694,"replication_time_us":37062,"thread_start_us":77519,"threads_started":2}]]}
I20260709 13:19:18.416613 16711 ts_tablet_manager.cc:1403] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.001s
I20260709 13:19:18.437173 17065 consensus_queue.cc:1048] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:18.420169 16482 leader_election.cc:343] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.441099 16710 tablet_bootstrap.cc:492] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:18.441187 16482 leader_election.cc:304] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:18.443162 16742 raft_consensus.cc:493] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccb9eea20c4f4b309b2b16f8edb35d4f)
I20260709 13:19:18.447949 17093 raft_consensus.cc:2749] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.446411 16742 raft_consensus.cc:515] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.452208 16742 leader_election.cc:290] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.453707 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.459481 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.459585 16482 leader_election.cc:304] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:18.461329 17093 raft_consensus.cc:2804] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.461752 17093 raft_consensus.cc:493] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.462087 17093 raft_consensus.cc:3060] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.468473 16710 tablet_bootstrap.cc:654] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.469784 16715 tablet_bootstrap.cc:654] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.473801 16482 leader_election.cc:304] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:18.475657 16742 raft_consensus.cc:2749] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:18.482316 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97929a85900c4b398c9e654088b6fb7d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.490054 16482 leader_election.cc:304] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:18.492942 16742 raft_consensus.cc:2749] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:18.440026 16711 raft_consensus.cc:359] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.494009 16711 raft_consensus.cc:385] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.494321 16711 raft_consensus.cc:740] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.496295 16711 consensus_queue.cc:260] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.513715 17060 raft_consensus.cc:493] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.514293 17060 raft_consensus.cc:515] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.530966 16712 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:18.530844 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.531760 16712 ts_tablet_manager.cc:1403] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.287s	user 0.012s	sys 0.014s
I20260709 13:19:18.531836 16661 raft_consensus.cc:2468] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:18.533310 16407 leader_election.cc:304] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:18.534439 16863 raft_consensus.cc:2804] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.534988 16863 raft_consensus.cc:493] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.535460 16863 raft_consensus.cc:3060] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.537987 16711 ts_tablet_manager.cc:1434] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 13:19:18.540175 16711 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:18.551105 16712 raft_consensus.cc:359] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.551863 16712 raft_consensus.cc:385] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.552276 16712 raft_consensus.cc:740] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.553247 16712 consensus_queue.cc:260] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.563865 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:18.564394 16712 ts_tablet_manager.cc:1434] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.001s
I20260709 13:19:18.565104 16711 tablet_bootstrap.cc:654] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.529266 17093 raft_consensus.cc:515] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.592646 16712 tablet_bootstrap.cc:492] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:18.601784 16710 tablet_bootstrap.cc:492] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:18.602324 16710 ts_tablet_manager.cc:1403] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.162s	user 0.014s	sys 0.015s
I20260709 13:19:18.599267 16715 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:18.602448 16515 raft_consensus.cc:2393] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:18.605065 16715 ts_tablet_manager.cc:1403] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.217s	user 0.015s	sys 0.043s
I20260709 13:19:18.561230 16339 catalog_manager.cc:5697] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.529438 17060 leader_election.cc:290] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:18.607522 16710 raft_consensus.cc:359] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.607833 16715 raft_consensus.cc:359] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.608383 16710 raft_consensus.cc:385] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.608656 16715 raft_consensus.cc:385] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.608718 16710 raft_consensus.cc:740] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.609084 16715 raft_consensus.cc:740] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.609786 16710 consensus_queue.cc:260] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.615041 16712 tablet_bootstrap.cc:654] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.609869 16715 consensus_queue.cc:260] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.600514 16863 raft_consensus.cc:515] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.627916 16710 ts_tablet_manager.cc:1434] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:19:18.630527 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:18.631184 16710 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:18.631557 16435 raft_consensus.cc:2393] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 in current term 1: Already voted for candidate d663b44309664a8e85e27bcc0804d088 in this term.
I20260709 13:19:18.609794 17093 leader_election.cc:290] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.634919 16715 ts_tablet_manager.cc:1434] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:19:18.647924 16710 tablet_bootstrap.cc:654] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.638288 16336 catalog_manager.cc:5697] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.650353 16336 catalog_manager.cc:5697] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:18.627003 17065 consensus_queue.cc:1048] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:19:18.628820 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:18.653927 16715 tablet_bootstrap.cc:492] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:18.655277 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:18.656284 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9f159848bf47c0bb6f68a580087fcc" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:18.657115 16515 raft_consensus.cc:2393] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:18.647511 16863 leader_election.cc:290] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:18.660606 16661 raft_consensus.cc:3060] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.662598 16406 leader_election.cc:304] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:18.668598 17100 raft_consensus.cc:2749] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.679142 16661 raft_consensus.cc:2468] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:18.681142 17053 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.681916 17053 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.686328 17053 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.687463 17051 consensus_queue.cc:1048] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:18.688141 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.689136 16661 raft_consensus.cc:2468] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:18.690325 16556 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:18.692040 17053 raft_consensus.cc:2804] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.692677 17053 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.693192 17053 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.694115 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.702638 16711 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:18.703497 16711 ts_tablet_manager.cc:1403] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.164s	user 0.034s	sys 0.024s
I20260709 13:19:18.706342 16711 raft_consensus.cc:359] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.713574 16711 raft_consensus.cc:385] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.713896 16711 raft_consensus.cc:740] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.714656 16711 consensus_queue.cc:260] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.684055 16482 leader_election.cc:304] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:18.717952 17093 raft_consensus.cc:2804] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.718607 17093 raft_consensus.cc:697] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:18.719631 17093 consensus_queue.cc:237] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.712354 17055 raft_consensus.cc:493] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.707290 17053 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.729691 17090 consensus_queue.cc:1048] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:18.730409 17055 raft_consensus.cc:515] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.731973 16711 ts_tablet_manager.cc:1434] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:19:18.708992 16715 tablet_bootstrap.cc:654] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.735595 16711 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:18.742538 17053 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.743157 17055 leader_election.cc:290] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:18.741642 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:18.744194 16661 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:18.750288 16557 leader_election.cc:343] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.761770 16712 tablet_bootstrap.cc:492] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:18.762707 16712 ts_tablet_manager.cc:1403] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.008s
I20260709 13:19:18.764103 16661 raft_consensus.cc:2468] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:18.766142 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:18.766310 16712 raft_consensus.cc:359] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.777388 16712 raft_consensus.cc:385] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.777825 16712 raft_consensus.cc:740] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.778474 16712 consensus_queue.cc:260] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.801854 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce763dbd25fa427992454c176ec757c4" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.811429 16712 ts_tablet_manager.cc:1434] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 13:19:18.814321 16556 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
W20260709 13:19:18.814446 16482 leader_election.cc:343] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.816740 16711 tablet_bootstrap.cc:654] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.766664 17053 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.822154 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce763dbd25fa427992454c176ec757c4" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:18.824205 17081 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.835675 17081 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.824168 17053 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:18.838471 16482 leader_election.cc:343] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.842818 16482 leader_election.cc:304] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:18.844985 16712 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:18.845850 16715 tablet_bootstrap.cc:492] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:18.849613 16715 ts_tablet_manager.cc:1403] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.020s
I20260709 13:19:18.841531 17051 raft_consensus.cc:2804] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:18.847226 17055 raft_consensus.cc:2749] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:18.855880 16686 debug-util.cc:398] Leaking SignalData structure 0x7b08000b04a0 after lost signal to thread 7660
W20260709 13:19:18.860458 16686 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4000 after lost signal to thread 16374
I20260709 13:19:18.861217 17051 raft_consensus.cc:697] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:18.862428 17055 raft_consensus.cc:493] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.862222 17051 consensus_queue.cc:237] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:18.862844 16686 debug-util.cc:398] Leaking SignalData structure 0x7b08001ac0e0 after lost signal to thread 16466
I20260709 13:19:18.862931 17055 raft_consensus.cc:515] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.867918 17055 leader_election.cc:290] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:18.868510 16710 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:18.870237 16710 ts_tablet_manager.cc:1403] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.239s	user 0.013s	sys 0.005s
I20260709 13:19:18.875345 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:18.877264 16482 leader_election.cc:343] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.883180 17053 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.886729 16863 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.887669 16863 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.888996 17081 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:18.889843 16863 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:18.891010 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:18.892330 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:18.893380 16588 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:18.894681 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:18.895603 16661 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:18.896696 16630 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:18.897365 17115 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.896881 17055 consensus_queue.cc:1048] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:18.897871 17115 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.898511 16928 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.899145 16928 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.899519 16928 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:18.901436 16482 leader_election.cc:343] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.901957 16482 leader_election.cc:304] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:18.906051 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:18.907016 16588 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:18.896788 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.909942 16435 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:18.911149 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:18.917805 16686 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7dc0 after lost signal to thread 16541
I20260709 13:19:18.918427 16710 raft_consensus.cc:359] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.919188 16710 raft_consensus.cc:385] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:18.909961 16407 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:18.919493 16710 raft_consensus.cc:740] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.921931 16863 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.920418 17093 raft_consensus.cc:2749] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:18.922120 16710 consensus_queue.cc:260] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.923635 16863 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.925117 16863 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:18.925762 17115 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:18.927420 16710 ts_tablet_manager.cc:1434] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.003s
I20260709 13:19:18.931133 17093 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.931757 17093 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:18.931768 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.932216 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:18.936100 16557 leader_election.cc:343] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.937209 16433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:18.922376 16686 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd860 after lost signal to thread 16615
W20260709 13:19:18.941035 16686 debug-util.cc:398] Leaking SignalData structure 0x7b0800320180 after lost signal to thread 16689
I20260709 13:19:18.933146 16511 raft_consensus.cc:2468] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:18.929909 16715 raft_consensus.cc:359] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.943490 16715 raft_consensus.cc:385] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:18.942262 16631 leader_election.cc:343] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.959110 16710 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:18.962344 16339 catalog_manager.cc:5697] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.957830 16629 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:18.943787 16715 raft_consensus.cc:740] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:18.974558 16715 consensus_queue.cc:260] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:18.987845 16742 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.973891 17115 raft_consensus.cc:2804] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:18.988421 16742 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:18.991501 16710 tablet_bootstrap.cc:654] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:18.993595 16715 ts_tablet_manager.cc:1434] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.144s	user 0.009s	sys 0.000s
I20260709 13:19:18.978585 16863 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.996965 16742 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:18.998409 16433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:18.998802 16863 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:19.000278 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:19.000474 16483 leader_election.cc:343] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:18.989431 17115 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:19.001726 16483 leader_election.cc:343] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.001643 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:19.001554 17115 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.005580 16440 raft_consensus.cc:2393] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate d663b44309664a8e85e27bcc0804d088 in this term.
I20260709 13:19:19.005688 16712 tablet_bootstrap.cc:654] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.010172 16928 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:18.994220 17093 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:19.020711 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:19.022710 16660 raft_consensus.cc:2393] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:19.032889 16711 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:19.033506 16711 ts_tablet_manager.cc:1403] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.298s	user 0.020s	sys 0.001s
I20260709 13:19:19.036643 16711 raft_consensus.cc:359] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:19.039551 16711 raft_consensus.cc:385] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.039805 16711 raft_consensus.cc:740] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.055418 16711 consensus_queue.cc:260] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:19.065466 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:19.068001 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:19.068722 16590 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:19.069759 16482 leader_election.cc:343] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.070256 16482 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:19.071883 17055 raft_consensus.cc:2749] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.077505 16715 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:19.028578 17115 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.087222 16661 raft_consensus.cc:2393] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:19.088688 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:19.089419 16512 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.093760 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:19.094338 16557 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
W20260709 13:19:19.095543 16631 leader_election.cc:343] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.093741 16482 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:19.102383 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:19.102460 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:19.105415 16436 raft_consensus.cc:2393] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate d663b44309664a8e85e27bcc0804d088 in this term.
I20260709 13:19:19.103442 17115 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:19.108475 16631 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:19.110237 17115 raft_consensus.cc:2749] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.130306 16711 ts_tablet_manager.cc:1434] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.002s
I20260709 13:19:19.128700 16928 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:19.135891 17055 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.144207 16711 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:19.138701 17055 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:19.148622 17055 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:19.152598 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:19.154564 16712 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:19.155124 16712 ts_tablet_manager.cc:1403] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.325s	user 0.017s	sys 0.008s
I20260709 13:19:19.155584 16710 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:19.156410 16710 ts_tablet_manager.cc:1403] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.198s	user 0.019s	sys 0.055s
I20260709 13:19:19.157372 16715 tablet_bootstrap.cc:654] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:19.155019 16482 leader_election.cc:343] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.165261 16711 tablet_bootstrap.cc:654] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.166887 16512 raft_consensus.cc:2468] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:19.166594 16712 raft_consensus.cc:359] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.170360 16742 raft_consensus.cc:2749] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.170428 16712 raft_consensus.cc:385] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.170730 16710 raft_consensus.cc:359] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.171749 16710 raft_consensus.cc:385] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.171264 16712 raft_consensus.cc:740] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.174314 16712 consensus_queue.cc:260] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.180132 17115 raft_consensus.cc:493] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.180681 17115 raft_consensus.cc:515] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:19.182803 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:19.184177 16483 leader_election.cc:343] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.184676 16483 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:19.184810 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:19.185604 16589 raft_consensus.cc:2468] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:19.185750 17090 raft_consensus.cc:2749] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.180891 16629 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:19.187781 16630 leader_election.cc:304] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:19.188293 17081 raft_consensus.cc:2804] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.188939 17081 raft_consensus.cc:697] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:19.189471 17120 raft_consensus.cc:2804] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.189914 17120 raft_consensus.cc:493] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.189796 17081 consensus_queue.cc:237] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.192382 16590 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:19.192976 17065 raft_consensus.cc:2749] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.172017 16710 raft_consensus.cc:740] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.194469 16710 consensus_queue.cc:260] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.196681 16710 ts_tablet_manager.cc:1434] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 13:19:19.197780 16710 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8: Bootstrap starting.
I20260709 13:19:19.190343 17120 raft_consensus.cc:3060] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.207985 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:19.213240 16512 raft_consensus.cc:2468] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:19.183033 17115 leader_election.cc:290] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:19.213379 16337 catalog_manager.cc:5697] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.224807 16742 consensus_queue.cc:1048] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.228737 16715 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:19.229290 16715 ts_tablet_manager.cc:1403] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.152s	user 0.023s	sys 0.001s
I20260709 13:19:19.231763 16710 tablet_bootstrap.cc:654] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.232194 16715 raft_consensus.cc:359] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:19.233188 16715 raft_consensus.cc:385] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.233595 16715 raft_consensus.cc:740] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.234887 16715 consensus_queue.cc:260] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:19.238891 16715 ts_tablet_manager.cc:1434] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:19.179867 16712 ts_tablet_manager.cc:1434] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:19:19.239981 16715 tablet_bootstrap.cc:492] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:19.241271 16712 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:19.247645 16715 tablet_bootstrap.cc:654] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.249094 16742 consensus_queue.cc:1048] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.242883 17120 raft_consensus.cc:515] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:19.253940 16340 catalog_manager.cc:5697] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:19.262737 16710 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8: No bootstrap required, opened a new log
I20260709 13:19:19.305811 16710 ts_tablet_manager.cc:1403] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8: Time spent bootstrapping tablet: real 0.108s	user 0.003s	sys 0.009s
I20260709 13:19:19.270203 16407 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:19.309998 16863 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.310216 16710 raft_consensus.cc:359] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.310935 16863 raft_consensus.cc:697] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:19.314002 16863 consensus_queue.cc:237] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:19.294245 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:19.317873 16511 raft_consensus.cc:3060] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.311143 16710 raft_consensus.cc:385] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.318970 16710 raft_consensus.cc:740] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.320094 16710 consensus_queue.cc:260] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.325933 16710 ts_tablet_manager.cc:1434] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:19:19.343355 17036 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.344288 17036 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:19.346431 16511 raft_consensus.cc:2468] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:19.350250 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:19.358777 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:19.353765 16629 leader_election.cc:304] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:19.365471 16928 raft_consensus.cc:2804] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:19.367681 16928 raft_consensus.cc:697] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:19.368422 17036 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:19.368695 16928 consensus_queue.cc:237] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:19.369838 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:19.371192 16660 raft_consensus.cc:2393] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate df1d541d9e6249978deccff88fdfe1a3 in this term.
I20260709 13:19:19.372678 16407 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:19.374778 17053 raft_consensus.cc:493] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.376063 17053 raft_consensus.cc:515] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:19.377091 17100 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.379518 17053 leader_election.cc:290] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:19.381743 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:19.383241 16557 leader_election.cc:343] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.397063 17120 leader_election.cc:290] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:19.419816 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:19.434763 16742 raft_consensus.cc:493] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.435595 16742 raft_consensus.cc:515] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.397086 16590 raft_consensus.cc:3060] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.511296 16742 leader_election.cc:290] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:19.513495 16712 tablet_bootstrap.cc:654] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.516181 17100 raft_consensus.cc:2749] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.521960 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:19.523944 16483 leader_election.cc:343] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.539865 16336 catalog_manager.cc:5697] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:19.518826 16511 raft_consensus.cc:2468] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 0.
I20260709 13:19:19.573974 16711 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:19.574672 16711 ts_tablet_manager.cc:1403] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.435s	user 0.044s	sys 0.027s
I20260709 13:19:19.593039 16818 consensus_queue.cc:1048] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.595341 17055 raft_consensus.cc:493] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.595974 17055 raft_consensus.cc:515] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.602258 17049 raft_consensus.cc:493] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.602905 17049 raft_consensus.cc:515] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:19.616617 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 114542us
I20260709 13:19:19.628881 16711 raft_consensus.cc:359] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.630206 16711 raft_consensus.cc:385] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.630330 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:19.630611 16711 raft_consensus.cc:740] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.634275 16590 raft_consensus.cc:2468] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:19.635818 17049 leader_election.cc:290] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:19.637895 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:19.647167 16631 leader_election.cc:343] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.651301 16715 tablet_bootstrap.cc:492] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:19.652369 16715 ts_tablet_manager.cc:1403] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.413s	user 0.063s	sys 0.098s
I20260709 13:19:19.675442 16555 leader_election.cc:304] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:19.687284 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b250f340b854e90816317511b46db7d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:19.632539 16711 consensus_queue.cc:260] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:19.694125 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 122245us
W20260709 13:19:19.692335 16482 leader_election.cc:343] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.700965 16482 leader_election.cc:304] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:19.703852 16742 raft_consensus.cc:2749] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:19.704856 16482 leader_election.cc:343] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.704793 16715 raft_consensus.cc:359] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:19.707613 16711 ts_tablet_manager.cc:1434] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.133s	user 0.011s	sys 0.000s
I20260709 13:19:19.707963 16715 raft_consensus.cc:385] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.711092 16715 raft_consensus.cc:740] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.702715 17065 raft_consensus.cc:2804] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.717746 16712 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:19.719029 16712 ts_tablet_manager.cc:1403] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.478s	user 0.014s	sys 0.011s
I20260709 13:19:19.720764 16715 consensus_queue.cc:260] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:19.726740 17155 consensus_queue.cc:1048] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.727483 16711 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:19.721760 17065 raft_consensus.cc:493] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:19.741132 16715 ts_tablet_manager.cc:1434] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.088s	user 0.002s	sys 0.007s
I20260709 13:19:19.741255 17065 raft_consensus.cc:3060] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.778617 16715 tablet_bootstrap.cc:492] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:19.789824 17055 leader_election.cc:290] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:19.792426 16712 raft_consensus.cc:359] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.793262 16712 raft_consensus.cc:385] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:19.793679 16712 raft_consensus.cc:740] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:19.794427 16712 consensus_queue.cc:260] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.801707 16436 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.809064 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:19.809830 16511 raft_consensus.cc:2468] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:19.817147 17151 consensus_queue.cc:1048] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:19.820196 16712 ts_tablet_manager.cc:1434] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.100s	user 0.007s	sys 0.001s
I20260709 13:19:19.825188 16629 leader_election.cc:304] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:19.830442 16712 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:19.815153 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b250f340b854e90816317511b46db7d" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:19.835240 17159 raft_consensus.cc:2804] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:19.835999 17159 raft_consensus.cc:493] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:19.850208 16483 leader_election.cc:343] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.851014 16483 leader_election.cc:304] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
W20260709 13:19:19.853461 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:19.836544 17159 raft_consensus.cc:3060] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.857205 16742 raft_consensus.cc:2749] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:19.854429 17046 raft_consensus.cc:493] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.873420 17046 raft_consensus.cc:515] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.876561 17046 leader_election.cc:290] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:19.912778 16711 tablet_bootstrap.cc:654] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.904629 16960 raft_consensus.cc:493] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.914610 16960 raft_consensus.cc:515] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:19.915297 16433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:19.930190 17060 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.933554 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:19.934190 17060 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.936669 16960 leader_election.cc:290] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:19.940728 16715 tablet_bootstrap.cc:654] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:19.943404 16631 leader_election.cc:343] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:19.957049 17081 consensus_queue.cc:1048] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:19.958011 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:19.958774 16513 raft_consensus.cc:2468] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:19.959818 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:19.962759 16712 tablet_bootstrap.cc:654] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:19.966895 16589 raft_consensus.cc:3060] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:19.967454 17159 raft_consensus.cc:515] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:19.973775 17060 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:19.983688 17065 raft_consensus.cc:515] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:19.986191 17159 leader_election.cc:290] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:19.986531 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:19.987469 16511 raft_consensus.cc:2468] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:19.991617 16406 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:19.998003 16629 leader_election.cc:304] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:19.999676 16556 leader_election.cc:304] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:20.003386 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
W20260709 13:19:20.018302 16631 leader_election.cc:343] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:20.020032 17159 consensus_queue.cc:1048] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.005152 17081 raft_consensus.cc:2804] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:20.025776 17081 raft_consensus.cc:493] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.026353 17081 raft_consensus.cc:3060] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.035856 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:20.058750 16712 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:20.059294 16712 ts_tablet_manager.cc:1403] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.233s	user 0.016s	sys 0.004s
I20260709 13:19:20.070549 17065 leader_election.cc:290] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:20.015242 16336 catalog_manager.cc:5697] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:20.074844 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
W20260709 13:19:20.078634 16557 leader_election.cc:343] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:20.087795 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:20.091817 16517 raft_consensus.cc:3060] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.059301 16928 consensus_queue.cc:1048] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 13:19:20.123188 17151 consensus_queue.cc:1048] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.130739 16712 raft_consensus.cc:359] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:20.131614 16712 raft_consensus.cc:385] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.131888 16712 raft_consensus.cc:740] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.137276 16712 consensus_queue.cc:260] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:20.139904 17046 raft_consensus.cc:493] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.142786 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:20.145594 16511 raft_consensus.cc:3060] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.157919 16711 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:20.158550 16711 ts_tablet_manager.cc:1403] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.431s	user 0.018s	sys 0.004s
I20260709 13:19:20.153915 16712 ts_tablet_manager.cc:1434] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.003s
I20260709 13:19:20.192813 16711 raft_consensus.cc:359] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.193974 16711 raft_consensus.cc:385] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.194316 16711 raft_consensus.cc:740] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.195808 16712 tablet_bootstrap.cc:492] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:20.199505 16517 raft_consensus.cc:2468] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:20.201187 16555 leader_election.cc:304] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:20.186494 17060 raft_consensus.cc:2804] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:20.151924 17046 raft_consensus.cc:515] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:20.202767 16711 consensus_queue.cc:260] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.213161 16711 ts_tablet_manager.cc:1434] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:19:20.206812 17170 raft_consensus.cc:2804] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:20.231702 17060 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ccb9eea20c4f4b309b2b16f8edb35d4f)
I20260709 13:19:20.232509 17060 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.242985 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:20.225884 16960 raft_consensus.cc:2749] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:20.263211 16712 tablet_bootstrap.cc:654] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.257208 16715 tablet_bootstrap.cc:492] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:20.264011 16715 ts_tablet_manager.cc:1403] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.486s	user 0.025s	sys 0.019s
W20260709 13:19:20.264148 16630 leader_election.cc:343] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:20.266650 16711 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:20.259447 17046 leader_election.cc:290] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:20.277385 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:20.280319 16715 raft_consensus.cc:359] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.284670 16715 raft_consensus.cc:385] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.285315 16715 raft_consensus.cc:740] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.290920 16715 consensus_queue.cc:260] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:20.294657 17176 log.cc:927] Time spent T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
W20260709 13:19:20.300382 16631 leader_election.cc:343] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:20.253928 17170 raft_consensus.cc:697] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:20.301811 16631 leader_election.cc:304] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:20.302822 17170 consensus_queue.cc:237] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.303460 17046 raft_consensus.cc:2749] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:20.313752 17115 consensus_queue.cc:1048] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:19:20.314841 16715 ts_tablet_manager.cc:1434] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:19:20.320066 16715 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:20.259346 17060 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.331897 17060 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:20.332597 16433 raft_consensus.cc:1240] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Rejecting Update request from peer ccb9eea20c4f4b309b2b16f8edb35d4f for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:20.266300 17081 raft_consensus.cc:515] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.252027 16511 raft_consensus.cc:2468] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
W20260709 13:19:20.367658 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 96408.4us
W20260709 13:19:20.370908 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 104791us
I20260709 13:19:20.379640 16629 leader_election.cc:304] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:20.354725 17100 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.390110 17100 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.397338 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
W20260709 13:19:20.399215 16631 leader_election.cc:343] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:20.387668 17115 raft_consensus.cc:2804] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:20.398769 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:20.404649 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:20.410569 16711 tablet_bootstrap.cc:654] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.417116 17115 raft_consensus.cc:697] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:20.418252 17115 consensus_queue.cc:237] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.401538 17081 leader_election.cc:290] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:20.422034 16715 tablet_bootstrap.cc:654] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.441661 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:20.442515 16515 raft_consensus.cc:3060] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.462965 16712 tablet_bootstrap.cc:492] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
W20260709 13:19:20.463171 17180 log.cc:927] Time spent T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:19:20.463609 16712 ts_tablet_manager.cc:1403] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.268s	user 0.024s	sys 0.026s
I20260709 13:19:20.466825 16515 raft_consensus.cc:2468] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:20.465376 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:20.474264 16513 raft_consensus.cc:2468] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:20.478880 16406 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:20.486703 16629 leader_election.cc:304] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:20.495657 17100 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:20.498848 16407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 71064us
I20260709 13:19:20.500196 16407 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:20.502784 16712 raft_consensus.cc:359] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.506063 16712 raft_consensus.cc:385] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.506405 16712 raft_consensus.cc:740] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.509265 17182 consensus_queue.cc:1059] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:19:20.510771 17182 raft_consensus.cc:3055] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:20.490897 17060 raft_consensus.cc:2804] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:20.512564 16712 consensus_queue.cc:260] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.511379 17182 raft_consensus.cc:740] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:20.539981 16711 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:20.540588 16711 ts_tablet_manager.cc:1403] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.317s	user 0.024s	sys 0.014s
I20260709 13:19:20.513324 17120 raft_consensus.cc:2804] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:20.524564 17060 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.546810 17060 raft_consensus.cc:3060] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.554105 17183 raft_consensus.cc:2749] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:20.567765 17120 raft_consensus.cc:697] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:20.568938 17120 consensus_queue.cc:237] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.584998 16712 ts_tablet_manager.cc:1434] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.121s	user 0.010s	sys 0.008s
W20260709 13:19:20.587883 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 56719.4us
W20260709 13:19:20.592288 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 110770us
I20260709 13:19:20.594838 16712 tablet_bootstrap.cc:492] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:20.615401 16711 raft_consensus.cc:359] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:20.619709 16711 raft_consensus.cc:385] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.620528 16711 raft_consensus.cc:740] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.586449 17182 consensus_queue.cc:260] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.626479 16715 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:20.627058 16715 ts_tablet_manager.cc:1403] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.307s	user 0.015s	sys 0.005s
I20260709 13:19:20.627853 16711 consensus_queue.cc:260] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:20.631748 16711 ts_tablet_manager.cc:1434] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 13:19:20.633330 17182 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:20.635936 16715 raft_consensus.cc:359] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.636833 16715 raft_consensus.cc:385] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.637161 16715 raft_consensus.cc:740] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.638176 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:20.646847 16715 consensus_queue.cc:260] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.635952 16711 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:20.653235 17194 log.cc:927] Time spent T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:19:20.644125 17060 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.657001 16589 raft_consensus.cc:2468] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:20.658422 16715 ts_tablet_manager.cc:1434] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.006s
I20260709 13:19:20.671001 16712 tablet_bootstrap.cc:654] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.675153 17060 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:20.676329 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:20.677027 16513 raft_consensus.cc:3060] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.677234 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:20.677839 16591 raft_consensus.cc:3060] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.686306 16591 raft_consensus.cc:2468] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:20.687763 16407 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:20.689831 17158 raft_consensus.cc:2804] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:20.690423 17158 raft_consensus.cc:697] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:20.691358 17158 consensus_queue.cc:237] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:20.697242 16513 raft_consensus.cc:2468] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:20.701001 16742 raft_consensus.cc:493] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.701607 16742 raft_consensus.cc:515] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.707227 16339 catalog_manager.cc:5697] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:20.729598 17115 raft_consensus.cc:493] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.730625 17115 raft_consensus.cc:515] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.734611 16711 tablet_bootstrap.cc:654] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.735687 16742 leader_election.cc:290] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:20.737336 16715 tablet_bootstrap.cc:492] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:20.738817 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:20.742146 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:20.742944 16586 raft_consensus.cc:2468] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:20.744226 16482 leader_election.cc:304] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:20.745666 16742 raft_consensus.cc:2804] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:20.746474 16742 raft_consensus.cc:493] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.747006 16742 raft_consensus.cc:3060] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.748121 17115 leader_election.cc:290] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:20.749069 16660 raft_consensus.cc:2468] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:20.750663 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:20.751488 16586 raft_consensus.cc:2468] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:20.756495 16630 leader_election.cc:304] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:20.757853 17120 raft_consensus.cc:2804] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:20.758298 17120 raft_consensus.cc:493] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.758795 17120 raft_consensus.cc:3060] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.760035 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:20.776659 17170 consensus_queue.cc:1048] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:20.786309 16715 tablet_bootstrap.cc:654] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.788142 16742 raft_consensus.cc:515] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.787988 16336 catalog_manager.cc:5697] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.790580 16514 raft_consensus.cc:2393] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:20.793042 16712 tablet_bootstrap.cc:492] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:20.794667 16712 ts_tablet_manager.cc:1403] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.200s	user 0.024s	sys 0.021s
I20260709 13:19:20.794996 17120 raft_consensus.cc:515] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.796689 17055 raft_consensus.cc:493] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.797288 17055 raft_consensus.cc:515] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
W20260709 13:19:20.799130 16557 consensus_peers.cc:597] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.798879 16712 raft_consensus.cc:359] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.803488 16712 raft_consensus.cc:385] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.804111 16712 raft_consensus.cc:740] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.809537 16742 leader_election.cc:290] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:20.809736 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:20.810863 16589 raft_consensus.cc:3060] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.821198 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:20.822145 16665 raft_consensus.cc:2393] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:20.830128 16712 consensus_queue.cc:260] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.845717 17055 leader_election.cc:290] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:20.861151 16589 raft_consensus.cc:2468] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:20.861442 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:20.862214 16512 raft_consensus.cc:2393] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:20.864636 17120 leader_election.cc:290] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:20.867403 16712 ts_tablet_manager.cc:1434] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.001s
I20260709 13:19:20.869439 16712 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:20.869581 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce763dbd25fa427992454c176ec757c4" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:20.870349 16660 raft_consensus.cc:2468] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 0.
I20260709 13:19:20.868146 16711 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:20.874130 16711 ts_tablet_manager.cc:1403] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.008s
I20260709 13:19:20.874161 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce763dbd25fa427992454c176ec757c4" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:20.881841 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44e3f3c16d034dc983fcc6fd01ce72e9" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:20.882652 16589 raft_consensus.cc:2393] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ccb9eea20c4f4b309b2b16f8edb35d4f in current term 1: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:20.882306 16482 leader_election.cc:304] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:20.883723 16482 leader_election.cc:304] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:20.884714 16742 raft_consensus.cc:2804] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:20.885223 16742 raft_consensus.cc:697] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:20.885995 16742 consensus_queue.cc:237] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.890863 17055 raft_consensus.cc:2804] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:20.891410 17055 raft_consensus.cc:493] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.891785 17055 raft_consensus.cc:3060] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:20.897418 16630 leader_election.cc:304] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:20.904671 16711 raft_consensus.cc:359] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.905683 16711 raft_consensus.cc:385] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.906023 16711 raft_consensus.cc:740] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.906739 16711 consensus_queue.cc:260] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:20.909260 16631 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.899255 17156 raft_consensus.cc:2749] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:20.913177 17188 raft_consensus.cc:493] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.913780 17188 raft_consensus.cc:515] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:20.921048 16711 ts_tablet_manager.cc:1434] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 13:19:20.923929 16711 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:20.930953 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 45706.9us
W20260709 13:19:20.936776 16482 leader_election.cc:343] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:20.942747 17188 leader_election.cc:290] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:20.944168 16712 tablet_bootstrap.cc:654] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.951239 16715 tablet_bootstrap.cc:492] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:20.952092 16715 ts_tablet_manager.cc:1403] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.219s	user 0.038s	sys 0.022s
I20260709 13:19:20.956102 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:20.964607 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b817e005d140481c9f6ad4b49f1f0837" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:20.966838 16715 raft_consensus.cc:359] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.967743 16715 raft_consensus.cc:385] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:20.968034 16715 raft_consensus.cc:740] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:20.968817 16715 consensus_queue.cc:260] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.970530 16711 tablet_bootstrap.cc:654] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.970986 16715 ts_tablet_manager.cc:1434] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:19:20.972076 16715 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:20.979933 17055 raft_consensus.cc:515] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:20.982448 17055 leader_election.cc:290] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:20.982889 16515 raft_consensus.cc:2393] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:20.989234 16406 leader_election.cc:304] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:20.992506 17100 raft_consensus.cc:3060] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.008503 16715 tablet_bootstrap.cc:654] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:20.994678 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce763dbd25fa427992454c176ec757c4" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:20.996076 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce763dbd25fa427992454c176ec757c4" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:21.016687 16583 raft_consensus.cc:3060] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.025087 17181 consensus_queue.cc:1048] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:21.029636 17206 log.cc:927] Time spent T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:19:21.016958 16665 raft_consensus.cc:3060] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.047817 16711 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:21.048406 16711 ts_tablet_manager.cc:1403] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.125s	user 0.027s	sys 0.004s
I20260709 13:19:21.039662 17100 raft_consensus.cc:2749] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:21.053136 16631 consensus_peers.cc:597] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.052618 16711 raft_consensus.cc:359] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.053758 16711 raft_consensus.cc:385] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.054190 16711 raft_consensus.cc:740] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:21.055097 16711 consensus_queue.cc:260] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.082659 16583 raft_consensus.cc:2468] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:21.083992 16482 leader_election.cc:304] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:21.084836 17055 raft_consensus.cc:2804] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:21.085374 17055 raft_consensus.cc:697] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:21.090461 16711 ts_tablet_manager.cc:1434] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.006s
I20260709 13:19:21.103987 16711 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:21.106869 17055 consensus_queue.cc:237] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:21.096987 17158 raft_consensus.cc:493] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.108630 16712 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:21.109262 17158 raft_consensus.cc:515] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.109488 16712 ts_tablet_manager.cc:1403] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.240s	user 0.010s	sys 0.010s
I20260709 13:19:21.111898 17158 leader_election.cc:290] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:21.112653 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:21.113471 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:21.114135 16660 raft_consensus.cc:2468] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
I20260709 13:19:21.115353 16712 raft_consensus.cc:359] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:21.116111 16712 raft_consensus.cc:385] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.116386 16712 raft_consensus.cc:740] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:21.117492 16712 consensus_queue.cc:260] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:21.118750 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:21.118105 16407 leader_election.cc:343] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:21.120110 16715 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:21.120366 16407 leader_election.cc:304] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:21.120704 16715 ts_tablet_manager.cc:1403] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.149s	user 0.030s	sys 0.012s
I20260709 13:19:21.123353 16712 ts_tablet_manager.cc:1434] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:21.125059 17100 raft_consensus.cc:2804] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:21.125618 17100 raft_consensus.cc:493] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.125982 17100 raft_consensus.cc:3060] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.135241 16340 catalog_manager.cc:5697] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.164110 17158 raft_consensus.cc:493] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.182438 17158 raft_consensus.cc:515] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.186084 17158 leader_election.cc:290] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:21.187363 16715 raft_consensus.cc:359] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.188365 16715 raft_consensus.cc:385] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.195159 17100 raft_consensus.cc:515] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.188746 16715 raft_consensus.cc:740] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:21.199290 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:21.208261 16712 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:21.207232 16715 consensus_queue.cc:260] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.211609 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:21.216691 17060 consensus_queue.cc:1048] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:21.221243 16407 leader_election.cc:304] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:21.223115 17188 raft_consensus.cc:2749] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:21.231851 17168 consensus_queue.cc:1048] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:21.232326 17100 leader_election.cc:290] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:21.241909 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:21.242826 16660 raft_consensus.cc:3060] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.244011 16711 tablet_bootstrap.cc:654] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:21.255029 16435 raft_consensus.cc:3060] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.245450 17060 consensus_queue.cc:1048] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:21.246126 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:21.248330 17168 raft_consensus.cc:493] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.250633 16715 ts_tablet_manager.cc:1434] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.129s	user 0.013s	sys 0.003s
W20260709 13:19:21.262157 16407 leader_election.cc:343] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:21.233963 16665 raft_consensus.cc:2468] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:21.259092 17168 raft_consensus.cc:515] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:21.297761 17065 raft_consensus.cc:493] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.305613 17168 leader_election.cc:290] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:21.307664 16337 catalog_manager.cc:5697] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.303205 17065 raft_consensus.cc:515] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.313642 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b250f340b854e90816317511b46db7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:21.316324 16715 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:21.314281 16515 raft_consensus.cc:2468] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:21.318794 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f64336673a45d99ebe7cc4736fb411" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:21.326870 16557 leader_election.cc:343] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:21.315944 17065 leader_election.cc:290] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:21.301671 16433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b250f340b854e90816317511b46db7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:21.332809 16629 leader_election.cc:304] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:21.335076 16631 leader_election.cc:343] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:21.336035 17167 raft_consensus.cc:2804] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:21.340050 17167 raft_consensus.cc:493] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.346557 17167 raft_consensus.cc:3060] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.357349 16742 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.353327 16339 catalog_manager.cc:5697] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.358994 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f64336673a45d99ebe7cc4736fb411" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:21.362299 16339 catalog_manager.cc:5697] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.358084 16742 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.393630 16742 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:21.395449 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:21.406515 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:21.415249 16483 leader_election.cc:343] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:21.513677 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 98493.8us
W20260709 13:19:21.514263 16556 leader_election.cc:343] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:21.515407 16556 leader_election.cc:304] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:21.406129 16660 raft_consensus.cc:2468] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
W20260709 13:19:21.518594 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 63603.5us
I20260709 13:19:21.523097 16711 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:21.523928 16711 ts_tablet_manager.cc:1403] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.420s	user 0.034s	sys 0.017s
W20260709 13:19:21.535327 16482 leader_election.cc:343] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:21.536101 16482 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:21.543381 16742 raft_consensus.cc:2749] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:21.562160 16715 tablet_bootstrap.cc:654] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:21.563912 16712 tablet_bootstrap.cc:654] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:21.563906 16711 raft_consensus.cc:359] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.569412 16711 raft_consensus.cc:385] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.569866 16711 raft_consensus.cc:740] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:21.571038 16711 consensus_queue.cc:260] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.573709 16407 leader_election.cc:304] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:21.588155 17100 raft_consensus.cc:2804] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:21.591490 16711 ts_tablet_manager.cc:1434] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.067s	user 0.010s	sys 0.001s
I20260709 13:19:21.593928 16742 consensus_queue.cc:1048] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:21.591029 17215 log.cc:927] Time spent T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:19:21.617439 17100 raft_consensus.cc:697] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:21.638022 17100 consensus_queue.cc:237] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.642972 16711 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:21.604126 17227 raft_consensus.cc:2749] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:21.602244 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 150015us
I20260709 13:19:21.672255 16715 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:21.672825 16715 ts_tablet_manager.cc:1403] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.373s	user 0.017s	sys 0.014s
I20260709 13:19:21.692029 17167 raft_consensus.cc:515] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:21.745692 16711 tablet_bootstrap.cc:654] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:21.761453 16715 raft_consensus.cc:359] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.769286 16715 raft_consensus.cc:385] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.770612 16715 raft_consensus.cc:740] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
W20260709 13:19:21.772235 16406 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 146744us
I20260709 13:19:21.776535 16715 consensus_queue.cc:260] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.793839 17225 consensus_queue.cc:1048] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:21.800101 17167 leader_election.cc:290] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:21.793597 16715 ts_tablet_manager.cc:1434] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.000s
I20260709 13:19:21.809636 16712 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:21.810566 16712 ts_tablet_manager.cc:1403] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.613s	user 0.012s	sys 0.024s
I20260709 13:19:21.815472 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b250f340b854e90816317511b46db7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:21.816183 16515 raft_consensus.cc:3060] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.775055 17191 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.837538 17065 raft_consensus.cc:493] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.840811 17065 raft_consensus.cc:515] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.850191 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:21.819726 17228 consensus_queue.cc:1048] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:19:21.837445 17151 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.857132 17151 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:21.857844 16515 raft_consensus.cc:2468] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:21.859153 17065 leader_election.cc:290] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:21.835297 17191 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:21.860114 16629 leader_election.cc:304] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:21.861045 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:21.861878 16665 raft_consensus.cc:2393] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 1: Already voted for candidate d663b44309664a8e85e27bcc0804d088 in this term.
I20260709 13:19:21.861987 17234 raft_consensus.cc:2804] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:21.862526 17234 raft_consensus.cc:697] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:21.862655 17191 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:21.863198 16556 leader_election.cc:304] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:21.863456 16715 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:21.841580 16712 raft_consensus.cc:359] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.865139 16712 raft_consensus.cc:385] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:21.865198 17235 raft_consensus.cc:3060] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:21.863534 17234 consensus_queue.cc:237] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:21.865571 16712 raft_consensus.cc:740] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:21.871990 16712 consensus_queue.cc:260] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:21.884799 17228 consensus_queue.cc:1048] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:21.887495 16712 ts_tablet_manager.cc:1434] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.000s
I20260709 13:19:21.915028 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:21.915724 16514 raft_consensus.cc:2468] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 0.
W20260709 13:19:21.916007 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 99595.7us
I20260709 13:19:21.894738 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:21.917713 16406 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:21.925132 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:21.959609 16442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:21.976218 16442 raft_consensus.cc:2468] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:21.983314 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b250f340b854e90816317511b46db7d" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:21.989022 16712 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f: Bootstrap starting.
I20260709 13:19:21.940570 17158 raft_consensus.cc:2804] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:21.996189 17158 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:21.996727 17158 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:22.009326 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 69187.8us
W20260709 13:19:22.011579 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 50990.7us
I20260709 13:19:22.022042 17151 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:22.051438 16715 tablet_bootstrap.cc:654] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:22.055389 16407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 157892us
W20260709 13:19:22.062623 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 52058.8us
I20260709 13:19:22.097606 16711 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:22.098380 16711 ts_tablet_manager.cc:1403] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.465s	user 0.008s	sys 0.024s
W20260709 13:19:22.100692 16407 leader_election.cc:343] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:22.072568 17235 raft_consensus.cc:2749] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:22.104123 17158 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:22.117736 17158 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:22.127700 17100 consensus_queue.cc:1048] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:22.131629 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:22.119728 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:22.112257 16712 tablet_bootstrap.cc:654] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.137358 16517 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:22.144668 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 64385.4us
W20260709 13:19:22.149901 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 73935us
I20260709 13:19:22.162781 16517 raft_consensus.cc:2468] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 1.
I20260709 13:19:22.130892 16711 raft_consensus.cc:359] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.165256 16711 raft_consensus.cc:385] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.166043 16711 raft_consensus.cc:740] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.150889 16631 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:22.164358 16406 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:22.169198 16631 leader_election.cc:343] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:22.166858 16711 consensus_queue.cc:260] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.181747 16711 ts_tablet_manager.cc:1434] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.083s	user 0.009s	sys 0.001s
I20260709 13:19:22.174876 17181 raft_consensus.cc:2804] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:22.173736 17188 raft_consensus.cc:2804] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:22.190346 17181 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.205857 17181 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.199443 17188 raft_consensus.cc:697] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
W20260709 13:19:22.208911 16388 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:22.209543 17188 consensus_queue.cc:237] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:22.197708 17120 raft_consensus.cc:493] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.232697 16711 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:22.232970 16407 leader_election.cc:343] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:22.262817 17252 log.cc:927] Time spent T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:19:22.230423 17120 raft_consensus.cc:515] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.287273 17120 leader_election.cc:290] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:22.293453 16337 catalog_manager.cc:5697] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.303716 16440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f64336673a45d99ebe7cc4736fb411" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:22.316083 16711 tablet_bootstrap.cc:654] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.331575 16712 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f: No bootstrap required, opened a new log
I20260709 13:19:22.344103 16712 ts_tablet_manager.cc:1403] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent bootstrapping tablet: real 0.356s	user 0.018s	sys 0.006s
W20260709 13:19:22.343580 16631 leader_election.cc:343] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:22.330456 17151 consensus_queue.cc:1048] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:19:22.349813 16440 raft_consensus.cc:3060] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:22.352893 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f64336673a45d99ebe7cc4736fb411" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:22.329789 17181 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.353979 16586 raft_consensus.cc:2468] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:22.357551 16630 leader_election.cc:304] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:22.358987 17181 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:22.360483 17233 raft_consensus.cc:2804] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:22.361449 17233 raft_consensus.cc:493] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.362607 17233 raft_consensus.cc:3060] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:22.362202 17231 raft_consensus.cc:493] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccb9eea20c4f4b309b2b16f8edb35d4f)
I20260709 13:19:22.403791 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:22.372730 17231 raft_consensus.cc:515] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.410724 17231 leader_election.cc:290] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:22.406648 16712 raft_consensus.cc:359] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.411511 16712 raft_consensus.cc:385] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.411888 16712 raft_consensus.cc:740] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.412635 16712 consensus_queue.cc:260] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.413255 16513 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.414887 16712 ts_tablet_manager.cc:1434] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:19:22.421149 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:22.423036 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:22.422116 16660 raft_consensus.cc:2368] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 for earlier term 2. Current term is 3.
I20260709 13:19:22.435552 16435 raft_consensus.cc:3060] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:22.451043 16436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a68f1fff79c4430e881d7b675d2d5541" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:22.456820 17159 consensus_queue.cc:1048] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:22.463129 16482 leader_election.cc:400] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803) with higher term. Message: Invalid argument: T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 for earlier term 2. Current term is 3.
I20260709 13:19:22.463673 16482 leader_election.cc:403] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:22.484160 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 44252.3us
W20260709 13:19:22.516186 17258 log.cc:927] Time spent T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:19:22.541793 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 80729.6us
I20260709 13:19:22.565382 16513 raft_consensus.cc:2468] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
I20260709 13:19:22.566344 16742 raft_consensus.cc:2749] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803) with higher term. Message: Invalid argument: T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec4abbd5c2a54ed19180984efefd22f8 for earlier term 2. Current term is 3.
I20260709 13:19:22.581110 16715 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:22.581620 16715 ts_tablet_manager.cc:1403] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.718s	user 0.011s	sys 0.020s
W20260709 13:19:22.582965 16631 consensus_peers.cc:597] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.584156 16629 leader_election.cc:304] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:22.585489 17181 raft_consensus.cc:2804] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:22.586170 17181 raft_consensus.cc:697] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:22.587333 17181 consensus_queue.cc:237] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.584641 16715 raft_consensus.cc:359] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.611526 16715 raft_consensus.cc:385] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.611835 16715 raft_consensus.cc:740] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.516312 17233 raft_consensus.cc:515] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.618728 16715 consensus_queue.cc:260] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.625463 17159 raft_consensus.cc:493] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.638324 16715 ts_tablet_manager.cc:1434] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.000s
I20260709 13:19:22.656193 16715 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3: Bootstrap starting.
I20260709 13:19:22.658861 16711 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:22.659415 16711 ts_tablet_manager.cc:1403] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.427s	user 0.005s	sys 0.017s
I20260709 13:19:22.663857 16435 raft_consensus.cc:2468] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
I20260709 13:19:22.645663 17159 raft_consensus.cc:515] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.699433 17159 leader_election.cc:290] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:22.706369 16433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3e8e73054842b9ad74a252019d99eb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
W20260709 13:19:22.708266 16631 leader_election.cc:343] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:22.713292 17060 raft_consensus.cc:493] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ccb9eea20c4f4b309b2b16f8edb35d4f)
I20260709 13:19:22.711400 16711 raft_consensus.cc:359] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.714607 16711 raft_consensus.cc:385] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.713924 17060 raft_consensus.cc:515] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.717042 16711 raft_consensus.cc:740] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.718071 16711 consensus_queue.cc:260] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.720413 16711 ts_tablet_manager.cc:1434] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.061s	user 0.002s	sys 0.005s
I20260709 13:19:22.721539 16711 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:22.723495 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:22.725134 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:22.689762 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3e8e73054842b9ad74a252019d99eb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:22.726558 16585 raft_consensus.cc:2468] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 0.
I20260709 13:19:22.720507 17060 leader_election.cc:290] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:22.728803 16630 leader_election.cc:304] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:22.728976 16407 leader_election.cc:304] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:22.731221 17270 raft_consensus.cc:2749] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:22.739055 17115 raft_consensus.cc:2804] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:22.738996 17240 consensus_queue.cc:1048] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:22.739671 17115 raft_consensus.cc:493] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:22.740111 17115 raft_consensus.cc:3060] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:22.743199 17233 leader_election.cc:290] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:22.745030 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f64336673a45d99ebe7cc4736fb411" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:22.746002 16585 raft_consensus.cc:3060] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:22.745119 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4f64336673a45d99ebe7cc4736fb411" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:22.750685 16435 raft_consensus.cc:3060] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:22.756662 16711 tablet_bootstrap.cc:654] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.768236 16435 raft_consensus.cc:2468] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:22.771412 16715 tablet_bootstrap.cc:654] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.776346 16585 raft_consensus.cc:2468] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:22.783425 16631 leader_election.cc:304] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:22.785271 17159 raft_consensus.cc:2804] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:22.786338 17159 raft_consensus.cc:697] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:22.787958 17159 consensus_queue.cc:237] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.790236 17115 raft_consensus.cc:515] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.794015 17115 leader_election.cc:290] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:22.794363 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3e8e73054842b9ad74a252019d99eb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:22.794240 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3e8e73054842b9ad74a252019d99eb" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088"
I20260709 13:19:22.795094 16585 raft_consensus.cc:3060] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:22.796262 16631 leader_election.cc:343] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:22.781541 16407 consensus_peers.cc:597] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.817126 16339 catalog_manager.cc:5697] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:22.848073 16585 raft_consensus.cc:2468] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:22.878844 16630 leader_election.cc:304] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:22.865707 16337 catalog_manager.cc:5697] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 0 to 1, leader changed from <none> to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:22.871417 16711 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:22.873912 16715 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3: No bootstrap required, opened a new log
I20260709 13:19:22.883678 16715 ts_tablet_manager.cc:1403] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3: Time spent bootstrapping tablet: real 0.230s	user 0.010s	sys 0.005s
I20260709 13:19:22.884672 17168 raft_consensus.cc:2804] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:22.886612 17168 raft_consensus.cc:697] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:22.887483 16715 raft_consensus.cc:359] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:22.888403 16715 raft_consensus.cc:385] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.888684 16715 raft_consensus.cc:740] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.889436 16715 consensus_queue.cc:260] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:22.891114 16715 ts_tablet_manager.cc:1434] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:22.883678 16711 ts_tablet_manager.cc:1403] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.162s	user 0.036s	sys 0.034s
I20260709 13:19:22.897109 16711 raft_consensus.cc:359] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.897930 16711 raft_consensus.cc:385] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.900592 16711 raft_consensus.cc:740] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.901348 16711 consensus_queue.cc:260] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:22.903072 16711 ts_tablet_manager.cc:1434] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:19:22.904675 16711 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:22.887776 17168 consensus_queue.cc:237] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.912429 16711 tablet_bootstrap.cc:654] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:22.957734 16711 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: No bootstrap required, opened a new log
I20260709 13:19:22.958290 16711 ts_tablet_manager.cc:1403] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.000s
I20260709 13:19:22.961498 16711 raft_consensus.cc:359] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.962308 16711 raft_consensus.cc:385] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:22.962628 16711 raft_consensus.cc:740] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:22.963511 16711 consensus_queue.cc:260] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:22.965727 16711 ts_tablet_manager.cc:1434] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:22.998658 16442 raft_consensus.cc:3060] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:22.998687 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 84474.3us
I20260709 13:19:23.012838 16339 catalog_manager.cc:5697] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.016249 16435 raft_consensus.cc:1275] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:23.019827 17191 consensus_queue.cc:1048] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:23.019682 16339 catalog_manager.cc:5697] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 0 to 1, leader changed from <none> to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 1 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.021953 16339 catalog_manager.cc:5697] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.037572 16512 raft_consensus.cc:1275] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:23.041379 17191 consensus_queue.cc:1048] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:23.287546 17191 consensus_queue.cc:1048] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:23.290674 16585 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.339294 17115 consensus_queue.cc:1048] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:23.343182 17235 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:23.343845 17235 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:23.349211 16435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d663b44309664a8e85e27bcc0804d088" is_pre_election: true
I20260709 13:19:23.353631 17235 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:23.359063 17239 raft_consensus.cc:493] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:23.369288 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:23.359838 17239 raft_consensus.cc:515] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:23.378213 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3e8e73054842b9ad74a252019d99eb" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:23.379124 16585 raft_consensus.cc:2393] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d663b44309664a8e85e27bcc0804d088 in current term 1: Already voted for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in this term.
I20260709 13:19:23.380460 17239 leader_election.cc:290] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:23.381242 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3e8e73054842b9ad74a252019d99eb" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:23.382781 16407 leader_election.cc:304] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:23.383577 17239 raft_consensus.cc:3060] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:23.389485 16555 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:23.394135 17235 raft_consensus.cc:2749] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:23.396772 17239 raft_consensus.cc:2749] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:23.449366 17191 consensus_queue.cc:1048] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:23.461745 17226 consensus_queue.cc:1048] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:24.823216  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
W20260709 13:19:24.827523 16483 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:24.851099 16483 consensus_peers.cc:597] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.877712 16557 consensus_peers.cc:597] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.878386 16631 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.880120 16631 consensus_peers.cc:597] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.888556 16631 consensus_peers.cc:597] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.888893 16483 consensus_peers.cc:597] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.892511 16631 consensus_peers.cc:597] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:24.913365 16483 consensus_peers.cc:597] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:24.923398  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:24.924474  7657 tablet_replica.cc:333] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.925414  7657 raft_consensus.cc:2243] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.925945  7657 raft_consensus.cc:2272] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.928452  7657 tablet_replica.cc:333] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.929385  7657 raft_consensus.cc:2243] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.929951  7657 raft_consensus.cc:2272] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.932838  7657 tablet_replica.cc:333] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.933717  7657 raft_consensus.cc:2243] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.934242  7657 raft_consensus.cc:2272] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.936599  7657 tablet_replica.cc:333] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.937927  7657 raft_consensus.cc:2243] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.938620  7657 raft_consensus.cc:2272] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.942562  7657 tablet_replica.cc:333] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.943449  7657 raft_consensus.cc:2243] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.944008  7657 raft_consensus.cc:2272] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.958571  7657 tablet_replica.cc:333] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.959875  7657 raft_consensus.cc:2243] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:24.960642  7657 raft_consensus.cc:2272] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:24.964119  7657 tablet_replica.cc:333] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:24.965345  7657 raft_consensus.cc:2243] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.012349  7657 raft_consensus.cc:2272] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.033677  7657 tablet_replica.cc:333] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.037730  7657 raft_consensus.cc:2243] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.041908  7657 raft_consensus.cc:2272] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.088053 16483 consensus_peers.cc:597] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.117842 16557 consensus_peers.cc:597] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.119319  7657 tablet_replica.cc:333] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
W20260709 13:19:25.119891 16483 consensus_peers.cc:597] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.122929  7657 raft_consensus.cc:2243] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.124217  7657 raft_consensus.cc:2272] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.138490 16557 consensus_peers.cc:597] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.150722 16631 consensus_peers.cc:597] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.152181  7657 tablet_replica.cc:333] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
W20260709 13:19:25.153049 16483 consensus_peers.cc:597] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.155752  7657 raft_consensus.cc:2243] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.158634  7657 raft_consensus.cc:2272] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.151536 16631 consensus_peers.cc:597] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.161773 16483 consensus_peers.cc:597] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.167596 16631 consensus_peers.cc:597] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.168509 16631 consensus_peers.cc:597] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.168696 16557 consensus_peers.cc:597] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.169193 16631 consensus_peers.cc:597] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.173727 16631 consensus_peers.cc:597] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.184962  7657 tablet_replica.cc:333] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
W20260709 13:19:25.186053 16631 consensus_peers.cc:597] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.193174  7657 raft_consensus.cc:2243] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.194363  7657 raft_consensus.cc:2272] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.199204  7657 tablet_replica.cc:333] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.200560  7657 raft_consensus.cc:2243] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.202462  7657 raft_consensus.cc:2272] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.206758  7657 tablet_replica.cc:333] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.209606  7657 raft_consensus.cc:2243] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.213269  7657 raft_consensus.cc:2272] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.220306  7657 tablet_replica.cc:333] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
W20260709 13:19:25.234696 16557 consensus_peers.cc:597] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.241875  7657 raft_consensus.cc:2243] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.245222  7657 raft_consensus.cc:2272] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.251415  7657 tablet_replica.cc:333] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.254803  7657 raft_consensus.cc:2243] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.255820  7657 raft_consensus.cc:2272] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.262315 16557 consensus_peers.cc:597] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.272079  7657 tablet_replica.cc:333] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.273614  7657 raft_consensus.cc:2243] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.288792  7657 raft_consensus.cc:2272] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.301476 16631 consensus_peers.cc:597] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.309111  7657 tablet_replica.cc:333] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.349129  7657 raft_consensus.cc:2243] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.353144  7657 raft_consensus.cc:2272] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.386641 16631 consensus_peers.cc:597] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.399240 16557 consensus_peers.cc:597] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.400257 16557 consensus_peers.cc:597] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.401485  7657 tablet_replica.cc:333] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
W20260709 13:19:25.401695 16557 consensus_peers.cc:597] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.402340 16557 consensus_peers.cc:597] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.403030  7657 raft_consensus.cc:2243] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.404007  7657 raft_consensus.cc:2272] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.409284 16557 consensus_peers.cc:597] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.417981  7657 tablet_replica.cc:333] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.420092  7657 raft_consensus.cc:2243] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.421002  7657 raft_consensus.cc:2272] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.424111  7657 tablet_replica.cc:333] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.425268  7657 raft_consensus.cc:2243] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.427057  7657 raft_consensus.cc:2272] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.431922  7657 tablet_replica.cc:333] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.433326  7657 raft_consensus.cc:2243] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.434942  7657 raft_consensus.cc:2272] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.439117  7657 tablet_replica.cc:333] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.441614  7657 raft_consensus.cc:2243] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.442546  7657 raft_consensus.cc:2272] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.446309  7657 tablet_replica.cc:333] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.447364  7657 raft_consensus.cc:2243] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.448232  7657 raft_consensus.cc:2272] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.452930  7657 tablet_replica.cc:333] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.454175  7657 raft_consensus.cc:2243] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.455735  7657 raft_consensus.cc:2272] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.462724  7657 tablet_replica.cc:333] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.463806  7657 raft_consensus.cc:2243] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.464632  7657 raft_consensus.cc:2272] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.469727  7657 tablet_replica.cc:333] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.472506  7657 raft_consensus.cc:2243] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.473496  7657 raft_consensus.cc:2272] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.477567  7657 tablet_replica.cc:333] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.478709  7657 raft_consensus.cc:2243] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.479504  7657 raft_consensus.cc:2272] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.484122  7657 tablet_replica.cc:333] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.485644  7657 raft_consensus.cc:2243] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.487639  7657 raft_consensus.cc:2272] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.491652  7657 tablet_replica.cc:333] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.492928  7657 raft_consensus.cc:2243] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.493814  7657 raft_consensus.cc:2272] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.497884  7657 tablet_replica.cc:333] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.498944  7657 raft_consensus.cc:2243] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.501216  7657 raft_consensus.cc:2272] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.504992  7657 tablet_replica.cc:333] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.505888  7657 raft_consensus.cc:2243] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.506754  7657 raft_consensus.cc:2272] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.510718  7657 tablet_replica.cc:333] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.511662  7657 raft_consensus.cc:2243] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.512498  7657 raft_consensus.cc:2272] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.517104  7657 tablet_replica.cc:333] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.518213  7657 raft_consensus.cc:2243] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.519387  7657 raft_consensus.cc:2272] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.512292 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 89364.4us
I20260709 13:19:25.528692  7657 tablet_replica.cc:333] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.529778  7657 raft_consensus.cc:2243] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.530588  7657 raft_consensus.cc:2272] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.535034  7657 tablet_replica.cc:333] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.535943  7657 raft_consensus.cc:2243] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.538000  7657 raft_consensus.cc:2272] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.541685  7657 tablet_replica.cc:333] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.542663  7657 raft_consensus.cc:2243] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.543987  7657 raft_consensus.cc:2272] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.547668  7657 tablet_replica.cc:333] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.548698  7657 raft_consensus.cc:2243] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.549577  7657 raft_consensus.cc:2272] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.552909  7657 tablet_replica.cc:333] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.553867  7657 raft_consensus.cc:2243] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.555608  7657 raft_consensus.cc:2272] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.559181  7657 tablet_replica.cc:333] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.560348  7657 raft_consensus.cc:2243] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.561154  7657 raft_consensus.cc:2272] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.564625  7657 tablet_replica.cc:333] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.565567  7657 raft_consensus.cc:2243] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:25.566977  7657 raft_consensus.cc:2272] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.571179  7657 tablet_replica.cc:333] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.572182  7657 raft_consensus.cc:2243] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.573113  7657 raft_consensus.cc:2272] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.575533 16631 consensus_peers.cc:597] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.597174  7657 tablet_replica.cc:333] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.598208  7657 raft_consensus.cc:2243] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.599397  7657 raft_consensus.cc:2272] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.603246  7657 tablet_replica.cc:333] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.604347  7657 raft_consensus.cc:2243] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.607635  7657 raft_consensus.cc:2272] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.611917  7657 tablet_replica.cc:333] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.612804  7657 raft_consensus.cc:2243] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.613603  7657 raft_consensus.cc:2272] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:25.617280  7657 tablet_replica.cc:333] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: stopping tablet replica
I20260709 13:19:25.618161  7657 raft_consensus.cc:2243] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:25.618763  7657 raft_consensus.cc:2272] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:25.743137 16407 connection.cc:466] server connection from 127.0.0.1:45814 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45814 (request call id 225) could send its response
W20260709 13:19:25.758314 16483 connection.cc:573] client connection to 127.7.122.65:46203 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:19:25.789054  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
I20260709 13:19:25.974901  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:25.988801 17311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:25.992637 17312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:25.994791 17314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:25.998997  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:26.008244  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:26.008628  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:26.008908  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603166008887 us; error 0 us; skew 500 ppm
I20260709 13:19:26.009884  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:26.013909  7657 webserver.cc:533] Webserver started at http://127.7.122.65:39459/ using document root <none> and password file <none>
I20260709 13:19:26.014771  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:26.015070  7657 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:26.022245  7657 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:19:26.041376 17319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:26.042753  7657 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:19:26.044178  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "d663b44309664a8e85e27bcc0804d088"
format_stamp: "Formatted at 2026-07-09 13:19:07 on dist-test-slave-078m"
I20260709 13:19:26.045465  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:26.086251  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:26.088284  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:26.090698  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:26.126782 17326 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:19:26.164104 17304 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.165208 17304 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.169931 17304 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.178191 17272 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.179085 17272 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.175690 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:26.202706 17272 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.208232 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:26.217780 16483 leader_election.cc:336] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.221486 16482 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:26.222709 17272 raft_consensus.cc:2749] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:26.235662 17304 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.238242 17304 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.241218 17304 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.242326 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:26.243088 16513 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:26.244594 16555 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:26.246385 17304 raft_consensus.cc:2804] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:26.246856 17304 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.249078 17304 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.258350 17272 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.259069 17272 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:26.259565 17304 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.264024 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:26.264243 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:26.264917 16513 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.267007 17304 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.272663 17272 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:26.275087 16483 leader_election.cc:336] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.275961 16483 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:26.277356 17272 raft_consensus.cc:2749] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:26.278362 16513 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 2.
I20260709 13:19:26.280382 16555 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:26.281666 17304 raft_consensus.cc:2804] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.282737 17304 raft_consensus.cc:697] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:26.283844 17304 consensus_queue.cc:237] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.312291 16339 catalog_manager.cc:5697] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:26.354851 17294 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.355501 17294 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.357963 17294 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.359165 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:26.414125 17272 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.415026 17272 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:26.432040 17307 raft_consensus.cc:493] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.432943 17307 raft_consensus.cc:515] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.437832 17307 leader_election.cc:290] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:26.439409 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:26.440161 16665 raft_consensus.cc:2468] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:26.443406 16556 leader_election.cc:304] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:26.444334 17304 raft_consensus.cc:2804] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:26.444741 17304 raft_consensus.cc:493] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.448254 17304 raft_consensus.cc:3060] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.469060 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:26.489142 17272 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:26.495791 16483 leader_election.cc:336] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.496572 16483 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:26.500587 17303 raft_consensus.cc:2749] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:26.576131 17307 raft_consensus.cc:493] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.577013 17307 raft_consensus.cc:515] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.582988  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:19:26.583474  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.464s	user 0.010s	sys 0.003s
I20260709 13:19:26.583884  7657 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:19:26.584569 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:26.589824 17307 leader_election.cc:290] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:26.591166 17168 raft_consensus.cc:493] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.591545 17303 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.593353 17326 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:26.601208 17303 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.607642 17168 raft_consensus.cc:515] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:26.608067 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:26.608814 16585 raft_consensus.cc:2468] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:26.610210 17303 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.610915 16482 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:26.611935 17305 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.612560 17305 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:26.613747 16483 leader_election.cc:336] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.614948 17305 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:26.618520 17303 raft_consensus.cc:2804] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:26.619060 17303 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.619465 17303 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.620813 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:26.634068 17272 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.634773 17272 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.636957 17168 leader_election.cc:290] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.637185 17272 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.637624 17168 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.637781 17326 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:26.638419 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:26.638971 17326 tablet_bootstrap.cc:492] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:26.639235 16585 raft_consensus.cc:2468] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:26.639770 17326 ts_tablet_manager.cc:1403] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.004s
I20260709 13:19:26.640184 17168 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:26.640846 16482 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:26.641765 17272 raft_consensus.cc:2804] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:26.642185 17272 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.642616 17272 raft_consensus.cc:3060] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.643111 17326 raft_consensus.cc:359] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.643872 17326 raft_consensus.cc:740] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.647394 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:26.648957 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 79378.5us
W20260709 13:19:26.652195 16483 leader_election.cc:336] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.651808 17304 raft_consensus.cc:515] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.653198 17326 consensus_queue.cc:260] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.655396 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7a75e87ed0b40428fb757740988a196" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:26.656117 16662 raft_consensus.cc:3060] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.661238 17272 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.665011 17168 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.665058 16662 raft_consensus.cc:2468] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 2.
I20260709 13:19:26.666193 17326 ts_tablet_manager.cc:1434] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:19:26.667233 17326 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:26.669147 17272 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.670032 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d82bece8c0482f890496c02af54926" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:26.673307 16585 raft_consensus.cc:3060] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.670965 16556 leader_election.cc:304] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
W20260709 13:19:26.674266 16483 leader_election.cc:336] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.682029 16585 raft_consensus.cc:2468] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:26.687239 16482 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:26.688412 17272 raft_consensus.cc:2804] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.689206 17272 raft_consensus.cc:697] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:26.690341 17294 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.675977 17307 raft_consensus.cc:2804] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.690907 17294 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.692962 17307 raft_consensus.cc:697] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:26.693472 17294 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.693962 17307 consensus_queue.cc:237] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.684360 17305 raft_consensus.cc:493] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.694828 17272 consensus_queue.cc:237] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.697408 17305 raft_consensus.cc:515] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.704320 17326 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:26.705452 17326 tablet_bootstrap.cc:492] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:26.706132 17326 ts_tablet_manager.cc:1403] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.000s
W20260709 13:19:26.714924 16631 leader_election.cc:336] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.715940 16631 leader_election.cc:304] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:26.717880 17305 leader_election.cc:290] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:26.718215 17226 raft_consensus.cc:2749] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:26.721449 17326 raft_consensus.cc:359] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.722268 17326 raft_consensus.cc:740] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.733192 17326 consensus_queue.cc:260] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.735646 17326 ts_tablet_manager.cc:1434] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:19:26.736730 17326 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:26.754462 17272 raft_consensus.cc:493] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.755231 17272 raft_consensus.cc:515] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:26.757952 17272 leader_election.cc:290] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:26.762945 16339 catalog_manager.cc:5697] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.770030 16337 catalog_manager.cc:5697] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:26.775290 17272 raft_consensus.cc:493] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.776309 17272 raft_consensus.cc:515] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.779094 17303 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.782021 17303 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.777554 17304 leader_election.cc:290] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:26.777686 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:26.782127 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:26.802307 16483 leader_election.cc:336] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.803659 16585 raft_consensus.cc:2468] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:26.785040 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:26.805027 16590 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.785810 17272 leader_election.cc:290] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.811517 17326 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:26.812757 17326 tablet_bootstrap.cc:492] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:26.813136 16482 leader_election.cc:304] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:26.813516 17326 ts_tablet_manager.cc:1403] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.077s	user 0.027s	sys 0.004s
I20260709 13:19:26.817301 17303 raft_consensus.cc:2804] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:26.817888 17303 raft_consensus.cc:493] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.818291 17303 raft_consensus.cc:3060] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:26.831670 17326 raft_consensus.cc:359] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:26.833010 17326 raft_consensus.cc:740] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:26.849749 17326 consensus_queue.cc:260] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:26.851397 16557 leader_election.cc:336] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:26.852372 16557 leader_election.cc:336] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:26.854436 16483 leader_election.cc:336] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:26.855301 16483 leader_election.cc:336] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.857646 17326 ts_tablet_manager.cc:1434] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:19:26.858834 17326 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:26.859627 16590 raft_consensus.cc:2468] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:26.777096 17334 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.866282 17334 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:26.866766 16482 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:26.867964 17272 raft_consensus.cc:2804] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:26.792191 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:26.793550 16511 raft_consensus.cc:1275] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer df1d541d9e6249978deccff88fdfe1a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:26.794651 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:26.863344 16557 leader_election.cc:336] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.868779 17334 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:26.790632 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 71142.8us
I20260709 13:19:26.864532 17303 raft_consensus.cc:515] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:26.868944 17272 raft_consensus.cc:697] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:26.871073 16512 raft_consensus.cc:2468] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:26.871022 16557 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:26.877486 17272 consensus_queue.cc:237] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:26.878225 16557 leader_election.cc:336] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:26.878948 16557 leader_election.cc:336] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.872200 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:26.879578 16557 leader_election.cc:304] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:26.880352 17307 raft_consensus.cc:2749] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:26.880713 16557 leader_election.cc:336] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.879611 17304 raft_consensus.cc:2749] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:26.881388 16557 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
W20260709 13:19:26.882828 16557 leader_election.cc:336] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.883467 16557 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:26.884407 16557 leader_election.cc:336] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.884651 17305 raft_consensus.cc:2749] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:26.884989 16557 leader_election.cc:336] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.886149 17305 raft_consensus.cc:2749] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:26.888659 16514 raft_consensus.cc:2393] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df1d541d9e6249978deccff88fdfe1a3 in current term 2: Already voted for candidate ec4abbd5c2a54ed19180984efefd22f8 in this term.
I20260709 13:19:26.890398 17307 consensus_queue.cc:1048] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:26.893046 17303 leader_election.cc:290] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:26.894268 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e54c35c1a9c48d6bf87b46b0f40d984" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:26.895172 16555 leader_election.cc:304] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:26.896008 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:26.897019 16557 consensus_peers.cc:597] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:26.901818 16662 raft_consensus.cc:2468] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:26.900760 16585 raft_consensus.cc:3060] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:26.902652 16557 leader_election.cc:336] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.911028 16557 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:26.913407 16483 leader_election.cc:336] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:26.915654 16339 catalog_manager.cc:5697] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.017246 17294 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
W20260709 13:19:27.018334 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 94612.9us
I20260709 13:19:27.022336 16585 raft_consensus.cc:2468] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:26.924340 17334 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:26.918772 17304 raft_consensus.cc:2749] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:27.023504 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 83683.1us
I20260709 13:19:27.036206 17294 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.036491 17334 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.037387 16629 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:27.038293 17226 raft_consensus.cc:2804] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.038676 17226 raft_consensus.cc:493] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.039032 17226 raft_consensus.cc:3060] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.039429 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:27.040133 16662 raft_consensus.cc:2468] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 1.
I20260709 13:19:27.041476 16556 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
W20260709 13:19:27.024773 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 107573us
W20260709 13:19:27.029389 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 104121us
I20260709 13:19:27.030534 17338 raft_consensus.cc:2749] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:27.051397 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:27.052073 16514 raft_consensus.cc:2468] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:27.046398 17334 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:27.058420 17338 raft_consensus.cc:2804] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.058910 17338 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.059288 17338 raft_consensus.cc:3060] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:27.049536 16631 leader_election.cc:336] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.075887 17335 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.076505 17335 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.062685 17303 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.082577 17303 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:27.084642 17303 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:27.078797 17335 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:27.061766 16482 leader_election.cc:304] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:27.094589 17191 raft_consensus.cc:493] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.095381 17191 raft_consensus.cc:515] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.099207 17294 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:27.101106 17303 raft_consensus.cc:2804] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.101553 17303 raft_consensus.cc:493] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.101625 16629 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:27.101977 17303 raft_consensus.cc:3060] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.102538 17168 raft_consensus.cc:2804] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.102916 17168 raft_consensus.cc:493] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.103303 17168 raft_consensus.cc:3060] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.103511 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:27.104171 16512 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
W20260709 13:19:27.113368 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 71975.9us
W20260709 13:19:27.120290 16557 leader_election.cc:336] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.124349 16483 leader_election.cc:336] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.142539 17191 leader_election.cc:290] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:27.150951 17168 raft_consensus.cc:515] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.156265 17168 leader_election.cc:290] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:27.163169 16629 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:27.168437 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 56041.8us
W20260709 13:19:27.170871 16631 leader_election.cc:336] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.171411 16631 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:27.179293 17226 raft_consensus.cc:515] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.185034 16662 raft_consensus.cc:1275] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer df1d541d9e6249978deccff88fdfe1a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.156458 17303 raft_consensus.cc:515] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.177619 17334 raft_consensus.cc:2804] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.188537 17334 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.189013 17334 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.189613 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:27.190399 16585 raft_consensus.cc:2468] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:27.190420 17303 leader_election.cc:290] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:27.186012 16482 leader_election.cc:304] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:27.197578 17191 raft_consensus.cc:2749] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:27.201895 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b6908daa7d470d9390a5833ea96825" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:27.202529 16665 raft_consensus.cc:3060] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.213784 16630 leader_election.cc:304] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:27.216164 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae01c3ebc7e44b90bb66c407f8969381" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:27.216913 16514 raft_consensus.cc:3060] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.199163 17303 raft_consensus.cc:2804] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.229101 17338 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.230160 17334 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.237181 17334 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:27.239333 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:27.240061 16662 raft_consensus.cc:3060] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.242640 17226 leader_election.cc:290] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:27.222355 17335 raft_consensus.cc:2804] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.257134 16665 raft_consensus.cc:2468] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:27.257406 17335 raft_consensus.cc:493] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.258021 17335 raft_consensus.cc:3060] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:27.260093 16483 consensus_peers.cc:597] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:27.260686 16483 leader_election.cc:336] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.267891 17350 consensus_queue.cc:1048] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 13:19:27.275743 16629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 54766.8us
I20260709 13:19:27.261832 17338 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:27.280140 16482 leader_election.cc:304] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:27.281428 16662 raft_consensus.cc:2468] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 2.
I20260709 13:19:27.282861 16556 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:27.283494 17349 raft_consensus.cc:2804] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.284090 17349 raft_consensus.cc:697] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:27.241495 17303 raft_consensus.cc:697] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:27.285167 17349 consensus_queue.cc:237] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.285781 17303 consensus_queue.cc:237] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:27.289395 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 72774.4us
I20260709 13:19:27.293498 16514 raft_consensus.cc:2468] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:27.302563 17347 raft_consensus.cc:2804] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.303225 17347 raft_consensus.cc:697] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:27.305315 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:27.306005 16585 raft_consensus.cc:2468] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 1.
I20260709 13:19:27.304179 17347 consensus_queue.cc:237] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.312831 16591 raft_consensus.cc:1275] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:27.323980 16631 leader_election.cc:336] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.329978 16631 leader_election.cc:336] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.325127 17334 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.337510 17334 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.348933 17334 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:27.351759 16629 leader_election.cc:304] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:27.362382 17326 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:27.368008 17335 raft_consensus.cc:515] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.371910 16510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab608fbd45fe408b9eb49f4fabeb9aef" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:27.372622 16510 raft_consensus.cc:3060] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.374301 17335 leader_election.cc:290] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:27.377384 17334 raft_consensus.cc:2804] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.378032 17334 raft_consensus.cc:697] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:27.379010 17334 consensus_queue.cc:237] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.405795 17346 consensus_queue.cc:1048] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:19:27.408118 17326 tablet_bootstrap.cc:492] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
W20260709 13:19:27.424208 16555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 71623.8us
I20260709 13:19:27.387552 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:27.434127 17326 ts_tablet_manager.cc:1403] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.576s	user 0.046s	sys 0.031s
I20260709 13:19:27.435561 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c09a4594984fd897c2eca96506b208" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:27.434382 16585 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 1.
I20260709 13:19:27.440762 16591 raft_consensus.cc:3060] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.434540 16510 raft_consensus.cc:2468] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:27.446092 16630 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:27.447602 16629 leader_election.cc:304] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:27.451172 17355 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.451671 17355 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.452214 17355 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.454205 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:27.454306 17326 raft_consensus.cc:359] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:27.455142 16511 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.455406 17326 raft_consensus.cc:740] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.456231 17326 consensus_queue.cc:260] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:27.450059 17335 raft_consensus.cc:2804] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.471781 17335 raft_consensus.cc:697] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:27.472986 17335 consensus_queue.cc:237] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:27.477401 16483 consensus_peers.cc:597] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:27.490134 16591 raft_consensus.cc:2468] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
W20260709 13:19:27.465431 16557 leader_election.cc:336] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.497036 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 168540us
I20260709 13:19:27.497671 16482 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:27.500658 16630 leader_election.cc:304] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:27.501725 17191 raft_consensus.cc:2804] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.496435 16339 catalog_manager.cc:5697] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.508999 17349 raft_consensus.cc:2804] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:27.509552 17349 raft_consensus.cc:493] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:27.510067 17349 raft_consensus.cc:3060] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.512666 16511 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:27.514500 17191 raft_consensus.cc:697] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:27.516325 16629 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
W20260709 13:19:27.517206 16557 consensus_peers.cc:597] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:27.523417 16583 raft_consensus.cc:1275] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.523554 17358 raft_consensus.cc:2804] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.527571 17358 raft_consensus.cc:697] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:27.528571 17358 consensus_queue.cc:237] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:27.528175 16337 catalog_manager.cc:5697] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.543519 17326 ts_tablet_manager.cc:1434] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.008s
I20260709 13:19:27.544425 17326 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:27.566257 17191 consensus_queue.cc:237] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.574191 17301 consensus_queue.cc:1048] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:19:27.616392 16336 catalog_manager.cc:5697] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:27.612144 16631 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.620217 16631 leader_election.cc:336] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.621073 16631 leader_election.cc:336] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.635520 16631 leader_election.cc:336] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.636672 16631 consensus_peers.cc:597] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.637216 16631 leader_election.cc:336] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.647706 17349 raft_consensus.cc:515] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:27.649804 16631 consensus_peers.cc:597] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.650619 16631 leader_election.cc:336] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.651721 16631 leader_election.cc:336] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.648167 16483 consensus_peers.cc:597] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.656003 16483 consensus_peers.cc:597] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.656623 16483 consensus_peers.cc:597] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.659646 16483 consensus_peers.cc:597] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:27.674540 17355 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.678503 16336 catalog_manager.cc:5697] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:27.680215 17349 leader_election.cc:290] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:27.680208 16631 consensus_peers.cc:597] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:27.684648 17355 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:27.685529 16631 consensus_peers.cc:597] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:27.688732 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e322abcf02184f63b716976eecccf24f" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:27.689498 16585 raft_consensus.cc:3060] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:27.696099  7657 ts_tablet_manager.cc:600] Registering tablets (43/45 complete)
I20260709 13:19:27.719218 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:27.720069 16588 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:27.721750 16631 consensus_peers.cc:597] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.722376 16631 leader_election.cc:336] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:27.724536 16483 consensus_peers.cc:597] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.728400 16483 leader_election.cc:336] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:27.723646 16339 catalog_manager.cc:5697] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.730952 16588 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:27.730823 16339 catalog_manager.cc:5697] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.734206 16630 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:27.735059 17191 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.735652 17191 raft_consensus.cc:697] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:27.732609 16339 catalog_manager.cc:5697] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.736503 17191 consensus_queue.cc:237] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.754820 16662 raft_consensus.cc:1275] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.755321  7657 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:19:27.758314  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 1.174s	user 0.339s	sys 0.017s
I20260709 13:19:27.758893 16588 raft_consensus.cc:1275] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:27.759423 17346 consensus_queue.cc:1048] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 13:19:27.791110 16483 consensus_peers.cc:597] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.792222 16631 consensus_peers.cc:597] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:27.764473 17364 consensus_queue.cc:1048] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:19:27.817422 16585 raft_consensus.cc:2468] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:27.818786 16482 leader_election.cc:304] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:27.820015 17346 raft_consensus.cc:2804] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:27.820494 17346 raft_consensus.cc:697] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:27.821412 17346 consensus_queue.cc:237] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
W20260709 13:19:27.829968 16631 consensus_peers.cc:597] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:27.843403 16663 raft_consensus.cc:1275] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer df1d541d9e6249978deccff88fdfe1a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:27.844035 17376 log.cc:927] Time spent T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:19:27.860351 17350 consensus_queue.cc:1048] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:19:27.870887 16337 catalog_manager.cc:5697] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:27.886665 16336 catalog_manager.cc:5697] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:27.888370 16631 consensus_peers.cc:597] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.900203 16483 consensus_peers.cc:597] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:27.903065 17371 raft_consensus.cc:493] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:27.903649 17371 raft_consensus.cc:515] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.927721 17371 leader_election.cc:290] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:27.954752 17326 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:27.955788 17326 tablet_bootstrap.cc:492] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:27.956584 17326 ts_tablet_manager.cc:1403] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.412s	user 0.005s	sys 0.018s
I20260709 13:19:27.959291 17326 raft_consensus.cc:359] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.959856 17326 raft_consensus.cc:740] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:27.960372 17326 consensus_queue.cc:260] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:27.966856 17326 ts_tablet_manager.cc:1434] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:27.968853 17326 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:27.975536 16631 consensus_peers.cc:597] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:27.984759 16631 consensus_peers.cc:597] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:27.985625 16631 consensus_peers.cc:597] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:28.020980 16483 consensus_peers.cc:597] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:28.023769 16483 consensus_peers.cc:597] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.040508 16557 consensus_peers.cc:597] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:28.050982 16631 consensus_peers.cc:597] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:28.057189 16514 raft_consensus.cc:1275] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.059175 17351 consensus_queue.cc:1048] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:28.061843 16511 raft_consensus.cc:1275] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.064460 17351 consensus_queue.cc:1048] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:28.074298 16631 consensus_peers.cc:597] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:28.074419 16510 raft_consensus.cc:1275] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:28.076012 16631 consensus_peers.cc:597] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.097378 17351 consensus_queue.cc:1048] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:19:28.104415 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:28.179584 16631 consensus_peers.cc:597] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.181147 16585 raft_consensus.cc:1275] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.183900 17356 consensus_queue.cc:1048] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:28.197767 17371 raft_consensus.cc:493] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.198365 17371 raft_consensus.cc:515] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:28.202608 17326 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:28.204677 17371 leader_election.cc:290] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:28.210724 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:28.215696 16557 consensus_peers.cc:597] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.237731 17326 tablet_bootstrap.cc:492] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:28.239215 17326 ts_tablet_manager.cc:1403] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.271s	user 0.020s	sys 0.005s
I20260709 13:19:28.263469 16585 raft_consensus.cc:1275] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:28.277264 16557 consensus_peers.cc:597] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.280275 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:28.285172 17321 leader_election.cc:304] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:28.282488 17326 raft_consensus.cc:359] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:28.286123 17326 raft_consensus.cc:740] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.286331 17371 raft_consensus.cc:2749] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:28.287106 17326 consensus_queue.cc:260] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:28.290311 17326 ts_tablet_manager.cc:1434] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.051s	user 0.009s	sys 0.001s
I20260709 13:19:28.291453 17326 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:28.283447 17367 consensus_queue.cc:1048] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:19:28.301606 16590 raft_consensus.cc:1275] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:28.307578 17335 consensus_queue.cc:1048] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:19:28.318889 16483 consensus_peers.cc:597] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:28.326632 16557 consensus_peers.cc:597] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.337451 16631 consensus_peers.cc:597] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:28.346326 16557 consensus_peers.cc:597] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.351635 16557 consensus_peers.cc:597] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.388406 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7370e1984b694aa99dce543ee5fffbad" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:28.394658 17322 leader_election.cc:304] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:28.395946 17371 raft_consensus.cc:2749] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:28.418114 16631 consensus_peers.cc:597] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.429147 16557 consensus_peers.cc:597] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.445950 16631 consensus_peers.cc:597] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.464948 17326 log.cc:927] Time spent T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:28.465596 17326 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:19:28.466334 16557 consensus_peers.cc:597] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.467119 17371 raft_consensus.cc:493] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.467705 17371 raft_consensus.cc:515] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:28.470327 17371 leader_election.cc:290] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:28.470645 17326 tablet_bootstrap.cc:492] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:28.471691 17326 ts_tablet_manager.cc:1403] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.181s	user 0.021s	sys 0.001s
I20260709 13:19:28.475510 17326 raft_consensus.cc:359] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:28.476450 17326 raft_consensus.cc:740] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.475549 16510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:28.494318 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:28.526846 17326 consensus_queue.cc:260] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:28.530086 17326 ts_tablet_manager.cc:1434] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:19:28.531044 17326 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:28.537598 17322 leader_election.cc:304] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:28.539467 17371 raft_consensus.cc:2749] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:28.575105 17326 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:28.576243 17326 tablet_bootstrap.cc:492] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:28.577047 17326 ts_tablet_manager.cc:1403] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.007s
I20260709 13:19:28.580809 17326 raft_consensus.cc:359] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:28.583159 17326 raft_consensus.cc:740] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.584031 17326 consensus_queue.cc:260] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:28.587452 17326 ts_tablet_manager.cc:1434] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:19:28.588359 17326 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:28.646921 16557 consensus_peers.cc:597] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.772281 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 118234us
W20260709 13:19:28.788576 16557 consensus_peers.cc:597] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.817749 16557 consensus_peers.cc:597] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.829525 16557 consensus_peers.cc:597] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:28.846036 17326 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:28.853446 17371 raft_consensus.cc:493] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:28.855353 17371 raft_consensus.cc:515] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:28.858069 17371 leader_election.cc:290] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:28.859398 17326 tablet_bootstrap.cc:492] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:28.860273 17326 ts_tablet_manager.cc:1403] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.272s	user 0.097s	sys 0.069s
I20260709 13:19:28.865743 17326 raft_consensus.cc:359] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:28.879937 17326 raft_consensus.cc:740] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:28.875130 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:28.866789 16510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "526828ba85d1408a8004f848e12da611" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
W20260709 13:19:28.884215 16555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38173, user_credentials={real_user=slave}} blocked reactor thread for 58739.4us
I20260709 13:19:28.884994 17326 consensus_queue.cc:260] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:28.913441 17326 ts_tablet_manager.cc:1434] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:19:28.915022 17326 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:28.937851 17321 leader_election.cc:304] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:28.939381 17371 raft_consensus.cc:2749] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:29.028692 17326 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.032836 17326 tablet_bootstrap.cc:492] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.033785 17326 ts_tablet_manager.cc:1403] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.025s
I20260709 13:19:29.039621 17326 raft_consensus.cc:359] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.040755 17326 raft_consensus.cc:740] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.041505 17326 consensus_queue.cc:260] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.043879 17326 ts_tablet_manager.cc:1434] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:29.045456 17326 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.149313 17326 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.150456 17326 tablet_bootstrap.cc:492] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.151330 17326 ts_tablet_manager.cc:1403] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.012s
I20260709 13:19:29.154932 17326 raft_consensus.cc:359] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.155629 17326 raft_consensus.cc:740] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.156608 17326 consensus_queue.cc:260] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.159274 17326 ts_tablet_manager.cc:1434] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:29.160413 17326 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.187592 17326 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.188612 17326 tablet_bootstrap.cc:492] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.189445 17326 ts_tablet_manager.cc:1403] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 13:19:29.192166 17326 raft_consensus.cc:359] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.192909 17326 raft_consensus.cc:740] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.193611 17326 consensus_queue.cc:260] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.196178 17326 ts_tablet_manager.cc:1434] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:19:29.197038 17326 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.217828 17326 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.218811 17326 tablet_bootstrap.cc:492] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.219609 17326 ts_tablet_manager.cc:1403] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.004s
I20260709 13:19:29.222123 17326 raft_consensus.cc:359] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.222692 17326 raft_consensus.cc:740] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.223608 17326 consensus_queue.cc:260] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.225862 17326 ts_tablet_manager.cc:1434] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:29.226691 17326 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.248634 17326 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.249658 17326 tablet_bootstrap.cc:492] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.250348 17326 ts_tablet_manager.cc:1403] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.024s	user 0.020s	sys 0.000s
I20260709 13:19:29.252935 17326 raft_consensus.cc:359] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.255879 17326 raft_consensus.cc:740] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.256959 17326 consensus_queue.cc:260] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.259935 17326 ts_tablet_manager.cc:1434] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:29.260820 17326 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.296499 17326 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.300257 17326 tablet_bootstrap.cc:492] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.301064 17326 ts_tablet_manager.cc:1403] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.006s
I20260709 13:19:29.304010 17326 raft_consensus.cc:359] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.309042 17326 raft_consensus.cc:740] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.309865 17326 consensus_queue.cc:260] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.312757 17326 ts_tablet_manager.cc:1434] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:19:29.313618 17326 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.390358 17326 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.391330 17326 tablet_bootstrap.cc:492] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.391963 17326 ts_tablet_manager.cc:1403] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.079s	user 0.009s	sys 0.029s
I20260709 13:19:29.394670 17326 raft_consensus.cc:359] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.395391 17326 raft_consensus.cc:740] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.396085 17326 consensus_queue.cc:260] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.408249 17326 ts_tablet_manager.cc:1434] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:19:29.409147 17326 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:29.434895 16557 consensus_peers.cc:597] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:29.466710 17326 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.468114 17326 tablet_bootstrap.cc:492] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.468828 17326 ts_tablet_manager.cc:1403] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.000s
I20260709 13:19:29.475750 17326 raft_consensus.cc:359] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.476480 17326 raft_consensus.cc:740] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.483165 17326 consensus_queue.cc:260] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.486406 17326 ts_tablet_manager.cc:1434] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:19:29.487277 17326 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.588789 17371 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.590163 17371 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.598148 17326 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.601516 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:29.604107 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:29.606329 17326 tablet_bootstrap.cc:492] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.607031 17466 raft_consensus.cc:493] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.607270 17326 ts_tablet_manager.cc:1403] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.002s
I20260709 13:19:29.607563 17322 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:29.607597 17466 raft_consensus.cc:515] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.610203 17466 leader_election.cc:290] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:29.610746 17466 raft_consensus.cc:2749] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:29.619437 17371 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:29.610877 17326 raft_consensus.cc:359] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.621623 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:29.621790 17326 raft_consensus.cc:740] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.621884 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f0c5b50daa4f20ba7f0bb8daedee02" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:29.624320 17322 leader_election.cc:304] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:29.625173 17371 raft_consensus.cc:2749] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:29.622553 17326 consensus_queue.cc:260] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.632421 17326 ts_tablet_manager.cc:1434] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:19:29.633453  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:46203
I20260709 13:19:29.633581 17468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:46203 every 8 connection(s)
I20260709 13:19:29.633745 17326 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:29.766000 16631 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:29.771829 17326 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.772977 17326 tablet_bootstrap.cc:492] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.774219 17326 ts_tablet_manager.cc:1403] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.141s	user 0.038s	sys 0.016s
I20260709 13:19:29.776038 17431 raft_consensus.cc:3060] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.781941 17326 raft_consensus.cc:359] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.782851 17326 raft_consensus.cc:740] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.783717 17326 consensus_queue.cc:260] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.786877 17326 ts_tablet_manager.cc:1434] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:19:29.787937 17326 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.813737 17470 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36181
I20260709 13:19:29.814401 17470 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:29.815451 17470 heartbeater.cc:507] Master 127.7.122.126:36181 requested a full tablet report, sending...
I20260709 13:19:29.821030 17326 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.822098 17326 tablet_bootstrap.cc:492] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
W20260709 13:19:29.822690 16483 consensus_peers.cc:597] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:29.822813 17326 ts_tablet_manager.cc:1403] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.008s
I20260709 13:19:29.826112 17326 raft_consensus.cc:359] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.827080 17326 raft_consensus.cc:740] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.827849 17326 consensus_queue.cc:260] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:29.831483 17431 raft_consensus.cc:3060] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.832352 17326 ts_tablet_manager.cc:1434] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:29.833539 17326 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.835824 17434 raft_consensus.cc:3060] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.856369 16339 ts_manager.cc:194] Re-registered known tserver with Master: d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:29.869028 17326 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.879299 17326 tablet_bootstrap.cc:492] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.880101 17326 ts_tablet_manager.cc:1403] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.012s
I20260709 13:19:29.883123 17326 raft_consensus.cc:359] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.883914 17326 raft_consensus.cc:740] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.884900 17326 consensus_queue.cc:260] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.887750 17326 ts_tablet_manager.cc:1434] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:19:29.888720 17326 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:29.904814 17466 raft_consensus.cc:493] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:29.905452 17466 raft_consensus.cc:515] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:29.908821 17466 leader_election.cc:290] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:29.910624 16510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8" is_pre_election: true
I20260709 13:19:29.911232 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6a4f5089ef4bae8a81840ca28efa2e" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:29.912801 17322 leader_election.cc:304] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d663b44309664a8e85e27bcc0804d088; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:29.914352 17466 raft_consensus.cc:2749] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:29.945842 17434 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.955292 16339 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60298
I20260709 13:19:29.957988 17431 raft_consensus.cc:3060] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:29.958794 17326 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:29.960510 17326 tablet_bootstrap.cc:492] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:29.961298 17326 ts_tablet_manager.cc:1403] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.073s	user 0.021s	sys 0.007s
I20260709 13:19:29.966001 17470 heartbeater.cc:499] Master 127.7.122.126:36181 was elected leader, sending a full tablet report...
I20260709 13:19:29.965526 17326 raft_consensus.cc:359] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.983767 17326 raft_consensus.cc:740] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:29.993891 17326 consensus_queue.cc:260] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:29.996325 17326 ts_tablet_manager.cc:1434] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 13:19:29.997177 17326 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:30.020937 16483 consensus_peers.cc:597] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.030992 17431 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:30.074692 17326 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.077042 17326 tablet_bootstrap.cc:492] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:30.077733 17326 ts_tablet_manager.cc:1403] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.081s	user 0.023s	sys 0.016s
W20260709 13:19:30.078745 16631 consensus_peers.cc:597] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.080525 17326 raft_consensus.cc:359] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.081331 17326 raft_consensus.cc:740] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.082554 17326 consensus_queue.cc:260] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.085276 17326 ts_tablet_manager.cc:1434] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:19:30.086122 17326 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:30.096429 17434 raft_consensus.cc:3060] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:30.328619 16483 consensus_peers.cc:597] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.340138 16483 consensus_peers.cc:597] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:30.404721 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 83400.8us
W20260709 13:19:30.471683 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 70799.5us
W20260709 13:19:30.496564 16631 consensus_peers.cc:597] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:30.520006 16631 consensus_peers.cc:597] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.523084 17326 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.569783 17326 tablet_bootstrap.cc:492] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:30.570633 17326 ts_tablet_manager.cc:1403] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.485s	user 0.083s	sys 0.082s
I20260709 13:19:30.587761 17326 raft_consensus.cc:359] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.593856 17326 raft_consensus.cc:740] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.594797 17326 consensus_queue.cc:260] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.597601 17326 ts_tablet_manager.cc:1434] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
W20260709 13:19:30.614676 16631 consensus_peers.cc:597] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.646407 16631 consensus_peers.cc:597] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.655339 17326 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:30.705343 17326 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.706358 17326 tablet_bootstrap.cc:492] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
W20260709 13:19:30.709509 16631 consensus_peers.cc:597] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:30.707022 17326 ts_tablet_manager.cc:1403] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.052s	user 0.019s	sys 0.000s
I20260709 13:19:30.719153 17326 raft_consensus.cc:359] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:30.720137 17326 raft_consensus.cc:740] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.720949 17326 consensus_queue.cc:260] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:30.723884 17326 ts_tablet_manager.cc:1434] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:30.724746 17326 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:30.770876 16631 consensus_peers.cc:597] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.779196 17432 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:30.814845 16631 consensus_peers.cc:597] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:30.862790 16631 consensus_peers.cc:597] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.864101 17326 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.865671 17326 tablet_bootstrap.cc:492] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:30.866703 17326 ts_tablet_manager.cc:1403] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.142s	user 0.047s	sys 0.034s
I20260709 13:19:30.874329 17326 raft_consensus.cc:359] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.875174 17326 raft_consensus.cc:740] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.875900 17326 consensus_queue.cc:260] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.878659 17326 ts_tablet_manager.cc:1434] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:30.879578 17326 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:30.907001 17326 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.908210 17326 tablet_bootstrap.cc:492] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
W20260709 13:19:30.908407 16557 consensus_peers.cc:597] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:30.909206 17326 ts_tablet_manager.cc:1403] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.003s
I20260709 13:19:30.911473 17326 raft_consensus.cc:359] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:30.912074 17326 raft_consensus.cc:740] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.912760 17326 consensus_queue.cc:260] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:30.914929 17326 ts_tablet_manager.cc:1434] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:30.916260 17326 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:30.937409 17326 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.938611 17326 tablet_bootstrap.cc:492] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:30.939642 17326 ts_tablet_manager.cc:1403] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.004s
I20260709 13:19:30.942582 17326 raft_consensus.cc:359] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.943395 17326 raft_consensus.cc:740] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.944357 17326 consensus_queue.cc:260] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:30.947870 17326 ts_tablet_manager.cc:1434] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:19:30.949062 17326 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:30.969467 17326 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:30.970432 17326 tablet_bootstrap.cc:492] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:30.971112 17326 ts_tablet_manager.cc:1403] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:19:30.973414 17326 raft_consensus.cc:359] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:30.974241 17326 raft_consensus.cc:740] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:30.974952 17326 consensus_queue.cc:260] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:30.976946 17326 ts_tablet_manager.cc:1434] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:30.978088 17326 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.000906 17326 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.002247 17326 tablet_bootstrap.cc:492] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.003173 17326 ts_tablet_manager.cc:1403] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:19:31.006088 17326 raft_consensus.cc:359] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:31.006789 17326 raft_consensus.cc:740] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.007434 17326 consensus_queue.cc:260] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:31.009653 17326 ts_tablet_manager.cc:1434] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:19:31.010464 17326 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.035591 17326 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.036731 17326 tablet_bootstrap.cc:492] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.037704 17326 ts_tablet_manager.cc:1403] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 13:19:31.040642 17326 raft_consensus.cc:359] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.041676 17326 raft_consensus.cc:740] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.042407 17326 consensus_queue.cc:260] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.044353 17326 ts_tablet_manager.cc:1434] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:19:31.045265 17326 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.077359 17326 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.078181 17326 tablet_bootstrap.cc:492] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.078863 17326 ts_tablet_manager.cc:1403] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.012s
I20260709 13:19:31.081324 17326 raft_consensus.cc:359] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.081945 17326 raft_consensus.cc:740] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.082615 17326 consensus_queue.cc:260] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.084196 17326 ts_tablet_manager.cc:1434] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:31.085248 17326 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:31.101349 16557 consensus_peers.cc:597] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:31.167253 17326 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.168437 17326 tablet_bootstrap.cc:492] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.169195 17326 ts_tablet_manager.cc:1403] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.044s
I20260709 13:19:31.172011 17326 raft_consensus.cc:359] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.172750 17326 raft_consensus.cc:740] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.173540 17326 consensus_queue.cc:260] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.176944 17326 ts_tablet_manager.cc:1434] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:31.184209 17326 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.232815 17326 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.234141 17326 tablet_bootstrap.cc:492] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.235023 17326 ts_tablet_manager.cc:1403] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.007s
I20260709 13:19:31.238148 17326 raft_consensus.cc:359] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.238956 17326 raft_consensus.cc:740] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.239749 17326 consensus_queue.cc:260] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.242497 17326 ts_tablet_manager.cc:1434] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:19:31.243448 17326 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.282094 17326 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.283218 17326 tablet_bootstrap.cc:492] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.283818 17326 ts_tablet_manager.cc:1403] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.010s
I20260709 13:19:31.286170 17326 raft_consensus.cc:359] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:31.286800 17326 raft_consensus.cc:740] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.287447 17326 consensus_queue.cc:260] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:31.290195 17326 ts_tablet_manager.cc:1434] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:19:31.291042 17326 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.335577 17326 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.336540 17326 tablet_bootstrap.cc:492] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.337236 17326 ts_tablet_manager.cc:1403] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.024s
I20260709 13:19:31.339884 17326 raft_consensus.cc:359] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.340750 17326 raft_consensus.cc:740] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.341745 17326 consensus_queue.cc:260] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.344164 17326 ts_tablet_manager.cc:1434] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:31.345011 17326 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
W20260709 13:19:31.351469 16631 consensus_peers.cc:597] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:31.361812 17434 raft_consensus.cc:3060] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.395730 17326 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.410071 17326 tablet_bootstrap.cc:492] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.416730 17326 ts_tablet_manager.cc:1403] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.072s	user 0.029s	sys 0.016s
I20260709 13:19:31.419677 17326 raft_consensus.cc:359] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.420634 17326 raft_consensus.cc:740] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.428221 17326 consensus_queue.cc:260] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.433213 17326 ts_tablet_manager.cc:1434] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:31.436339 17326 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.466048 17326 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.467633 17326 tablet_bootstrap.cc:492] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.468402 17326 ts_tablet_manager.cc:1403] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.002s
I20260709 13:19:31.470770 17326 raft_consensus.cc:359] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.471498 17326 raft_consensus.cc:740] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.472213 17326 consensus_queue.cc:260] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.474943 17326 ts_tablet_manager.cc:1434] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:19:31.477100 17326 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.507364 17326 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.508503 17326 tablet_bootstrap.cc:492] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.509342 17326 ts_tablet_manager.cc:1403] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.012s
I20260709 13:19:31.512328 17326 raft_consensus.cc:359] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.513088 17326 raft_consensus.cc:740] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.513841 17326 consensus_queue.cc:260] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.516498 17326 ts_tablet_manager.cc:1434] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:31.517755 17326 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.563059 17326 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.564144 17326 tablet_bootstrap.cc:492] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.564922 17326 ts_tablet_manager.cc:1403] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.047s	user 0.023s	sys 0.019s
I20260709 13:19:31.569820 17326 raft_consensus.cc:359] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:31.570621 17326 raft_consensus.cc:740] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.571399 17326 consensus_queue.cc:260] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:31.574193 17326 ts_tablet_manager.cc:1434] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:31.576380 17326 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.599727 17326 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.601876 17326 tablet_bootstrap.cc:492] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.602710 17326 ts_tablet_manager.cc:1403] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.027s	user 0.020s	sys 0.000s
I20260709 13:19:31.606992 17326 raft_consensus.cc:359] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.609136 17326 raft_consensus.cc:740] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.610119 17326 consensus_queue.cc:260] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.612996 17326 ts_tablet_manager.cc:1434] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:19:31.615609 17326 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.665454 17326 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.667191 17326 tablet_bootstrap.cc:492] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.667949 17326 ts_tablet_manager.cc:1403] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.024s
I20260709 13:19:31.671231 17326 raft_consensus.cc:359] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.672065 17326 raft_consensus.cc:740] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.672828 17326 consensus_queue.cc:260] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.675701 17326 ts_tablet_manager.cc:1434] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:19:31.699520 17326 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.759037 17326 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.760223 17326 tablet_bootstrap.cc:492] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.760977 17326 ts_tablet_manager.cc:1403] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.004s
I20260709 13:19:31.763955 17326 raft_consensus.cc:359] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.769083 17326 raft_consensus.cc:740] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.769901 17326 consensus_queue.cc:260] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.774839 17326 ts_tablet_manager.cc:1434] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:19:31.775934 17326 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.809417 17326 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.810906 17326 tablet_bootstrap.cc:492] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.824445 17326 ts_tablet_manager.cc:1403] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.013s
I20260709 13:19:31.827826 17326 raft_consensus.cc:359] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:31.829020 17326 raft_consensus.cc:740] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.829895 17326 consensus_queue.cc:260] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:31.860072 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 44392us
I20260709 13:19:31.863991 17326 ts_tablet_manager.cc:1434] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 13:19:31.865219 17326 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Bootstrap starting.
I20260709 13:19:31.900075 17326 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:31.901216 17326 tablet_bootstrap.cc:492] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Bootstrap complete.
I20260709 13:19:31.904824 17326 ts_tablet_manager.cc:1403] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.010s
I20260709 13:19:31.913546 17428 raft_consensus.cc:3060] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.918743 17326 raft_consensus.cc:359] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.920063 17326 raft_consensus.cc:740] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Initialized, Role: FOLLOWER
I20260709 13:19:31.920783 17326 consensus_queue.cc:260] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:31.922015 17432 raft_consensus.cc:3060] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:31.923302 17326 ts_tablet_manager.cc:1434] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.002s
I20260709 13:19:31.966928 17434 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:32.015182 17434 raft_consensus.cc:3060] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.668967  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:39.744165 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23ea494524264f8186935c55c5301bd1"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:39.745465 16662 raft_consensus.cc:606] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:39.749269 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cf203eb6e6f4850899481145884643a"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:39.749922 16662 raft_consensus.cc:606] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:39.753600 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:39.754240 16662 raft_consensus.cc:606] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:39.758474 16663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:39.759097 16663 raft_consensus.cc:606] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:39.775847 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:39.776522 16591 raft_consensus.cc:606] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:39.780191 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:39.780844 16662 raft_consensus.cc:606] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:39.782238  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:39.783468  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:39.956482 17572 raft_consensus.cc:993] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower ec4abbd5c2a54ed19180984efefd22f8 to start an election
I20260709 13:19:39.957072 17572 raft_consensus.cc:1081] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer ec4abbd5c2a54ed19180984efefd22f8 to start an election
I20260709 13:19:39.959856 16517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cf203eb6e6f4850899481145884643a"
dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:19:39.960536 16517 raft_consensus.cc:493] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:39.961158 16517 raft_consensus.cc:3060] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.971360 16517 raft_consensus.cc:515] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:39.974578 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:39.974702 16517 leader_election.cc:290] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:39.975433 16591 raft_consensus.cc:3060] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.976439 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cf203eb6e6f4850899481145884643a" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:39.977054 16662 raft_consensus.cc:3055] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:39.977337 16662 raft_consensus.cc:740] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:39.978188 16662 consensus_queue.cc:260] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:39.979713 16662 raft_consensus.cc:3060] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:39.985905 16591 raft_consensus.cc:2468] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:39.987316 16482 leader_election.cc:304] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:39.987391 16662 raft_consensus.cc:2468] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:39.988189 17577 raft_consensus.cc:2804] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:39.988636 17577 raft_consensus.cc:697] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:39.989576 17577 consensus_queue.cc:237] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:40.001612 16339 catalog_manager.cc:5697] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.068425 17573 raft_consensus.cc:993] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.069001 17573 raft_consensus.cc:1081] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.071317 17431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:40.071962 17431 raft_consensus.cc:493] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:40.072352 17431 raft_consensus.cc:3060] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.082470 17431 raft_consensus.cc:515] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.086288 17431 leader_election.cc:290] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:40.087103 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:40.087772 16662 raft_consensus.cc:3055] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:40.088038 16662 raft_consensus.cc:740] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:40.088549 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c2736d94d445fc991f12646b12edc2" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:40.089421 16517 raft_consensus.cc:3060] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.089529 16662 consensus_queue.cc:260] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.091421 16662 raft_consensus.cc:3060] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.100808 16517 raft_consensus.cc:2468] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:40.102231 16662 raft_consensus.cc:2468] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:40.103468 17321 leader_election.cc:304] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:40.107290 17589 raft_consensus.cc:2804] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:40.109441 17589 raft_consensus.cc:697] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:40.110713 17589 consensus_queue.cc:237] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.124022 16339 catalog_manager.cc:5697] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.134789 17572 raft_consensus.cc:993] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.135584 17573 raft_consensus.cc:1081] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.137533 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:40.138038 17434 raft_consensus.cc:493] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:40.138329 17434 raft_consensus.cc:3060] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.139660 17573 raft_consensus.cc:993] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower ec4abbd5c2a54ed19180984efefd22f8 to start an election
I20260709 13:19:40.140233 17572 raft_consensus.cc:1081] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer ec4abbd5c2a54ed19180984efefd22f8 to start an election
I20260709 13:19:40.142011 16517 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23ea494524264f8186935c55c5301bd1"
dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
 from {username='slave'} at 127.0.0.1:55762
I20260709 13:19:40.142513 16517 raft_consensus.cc:493] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:40.142861 16517 raft_consensus.cc:3060] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.147470 17434 raft_consensus.cc:515] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.151146 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:40.151804 16662 raft_consensus.cc:3055] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:40.152161 16662 raft_consensus.cc:740] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:40.152985 16662 consensus_queue.cc:260] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.154266 16662 raft_consensus.cc:3060] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.154516 17434 leader_election.cc:290] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:40.155965 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e49520220f904c3eb4c608cc67bc6533" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:40.156683 16512 raft_consensus.cc:3060] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.152019 16517 raft_consensus.cc:515] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:40.167160 17575 raft_consensus.cc:993] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.167739 17575 raft_consensus.cc:1081] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.171701 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ea494524264f8186935c55c5301bd1" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:40.172294 16591 raft_consensus.cc:3060] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.181217 16512 raft_consensus.cc:2468] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:40.182507 17321 leader_election.cc:304] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:40.183537 17589 raft_consensus.cc:2804] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:40.184132 17589 raft_consensus.cc:697] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:40.185425 16517 leader_election.cc:290] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:40.185104 17589 consensus_queue.cc:237] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.186769 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ea494524264f8186935c55c5301bd1" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:40.184580 16591 raft_consensus.cc:2468] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:40.187448 16665 raft_consensus.cc:3055] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:40.187822 16665 raft_consensus.cc:740] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:40.187966 16588 raft_consensus.cc:1240] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Rejecting Update request from peer ccb9eea20c4f4b309b2b16f8edb35d4f for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:40.188817 16665 consensus_queue.cc:260] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:40.190382 16665 raft_consensus.cc:3060] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:40.191556 16482 leader_election.cc:304] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:40.162531 16662 raft_consensus.cc:2468] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:40.192643 17519 raft_consensus.cc:2804] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:40.193739 17519 raft_consensus.cc:697] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Leader. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:40.194551 17519 consensus_queue.cc:237] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:40.196794 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:19:40.198340 17434 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:40.198779 17434 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:40.198938 16665 raft_consensus.cc:2468] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ec4abbd5c2a54ed19180984efefd22f8 in term 2.
I20260709 13:19:40.206319 17434 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:40.208117 16339 catalog_manager.cc:5697] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.211246 17434 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:40.212852 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:40.213423 16517 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:40.214149 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:40.214761 16591 raft_consensus.cc:3055] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:40.215034 16591 raft_consensus.cc:740] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:40.215850 16591 consensus_queue.cc:260] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:40.217219 16591 raft_consensus.cc:3060] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:40.220664 16517 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:40.223232 16340 catalog_manager.cc:5697] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "ec4abbd5c2a54ed19180984efefd22f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.224459 16591 raft_consensus.cc:2468] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:40.226022 17322 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:40.227048 17589 raft_consensus.cc:2804] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:40.227613 17589 raft_consensus.cc:697] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:40.228547 17589 consensus_queue.cc:237] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:40.242677 16340 catalog_manager.cc:5697] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 2 to 3, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.266322 17572 raft_consensus.cc:993] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.266719 17572 raft_consensus.cc:1081] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:40.268688 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:40.269207 17434 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:40.269446 17434 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:40.274484 17434 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.276726 17434 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:40.277668 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:40.278097 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52a6c0c65b0142fb8554a775fa3f87c6" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:40.278717 16517 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:40.278741 16665 raft_consensus.cc:3055] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:40.279277 16665 raft_consensus.cc:740] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:40.279939 16665 consensus_queue.cc:260] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.280967 16665 raft_consensus.cc:3060] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:40.286947 16665 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:40.287792 16517 raft_consensus.cc:2468] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:40.288424 17322 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:40.289556 17589 raft_consensus.cc:2804] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:40.290084 17589 raft_consensus.cc:697] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:40.290907 17589 consensus_queue.cc:237] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:40.310019 16340 catalog_manager.cc:5697] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 2 to 3, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:40.465332 16591 raft_consensus.cc:1275] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.466814 17519 consensus_queue.cc:1048] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:40.477968 16665 raft_consensus.cc:1275] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.481292 17577 consensus_queue.cc:1048] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:40.604782 16517 raft_consensus.cc:1275] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.606222 17589 consensus_queue.cc:1048] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:40.625666 16662 raft_consensus.cc:1275] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.628261 17589 consensus_queue.cc:1048] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:40.666301 16517 raft_consensus.cc:1275] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.668533 17589 consensus_queue.cc:1048] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:40.672263 16662 raft_consensus.cc:1275] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.674666 17519 consensus_queue.cc:1048] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:40.684005 16665 raft_consensus.cc:1275] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.685575 17590 consensus_queue.cc:1048] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:40.697667 16591 raft_consensus.cc:1275] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ec4abbd5c2a54ed19180984efefd22f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:40.699836 17577 consensus_queue.cc:1048] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:40.731213 16517 raft_consensus.cc:1275] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:40.732666 17590 consensus_queue.cc:1048] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:40.761559 16663 raft_consensus.cc:1275] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:40.764330 17589 consensus_queue.cc:1048] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:40.765782 16511 raft_consensus.cc:1275] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:40.767480 17604 consensus_queue.cc:1048] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:19:40.768389 16588 raft_consensus.cc:1275] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:40.772881 17604 consensus_queue.cc:1048] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:40.784505  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:40.911490  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:40.960724 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:40.961269 16662 raft_consensus.cc:606] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:40.964236 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:40.964805 16591 raft_consensus.cc:606] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Received request to transfer leadership to TS ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:40.967957 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:40.968541 16591 raft_consensus.cc:606] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Received request to transfer leadership to TS ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:40.972200 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:40.973037 16662 raft_consensus.cc:606] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:40.993347 16511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5"
dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:58796
I20260709 13:19:40.994011 16511 raft_consensus.cc:606] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:40.997072 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:40.997707 16662 raft_consensus.cc:606] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:40.999325  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:41.001071  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:41.023392 17573 raft_consensus.cc:993] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.023932 17572 raft_consensus.cc:1081] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.026208 17429 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:41.026873 17429 raft_consensus.cc:493] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.027199 17429 raft_consensus.cc:3060] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.033432 17429 raft_consensus.cc:515] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:41.036553 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:41.036839 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e92af3acfe4273bd9e0652d59ccc68" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:41.037341 16663 raft_consensus.cc:3055] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.036619 17429 leader_election.cc:290] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:41.037541 16511 raft_consensus.cc:3060] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.037690 16663 raft_consensus.cc:740] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:41.039170 16663 consensus_queue.cc:260] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:41.040521 16663 raft_consensus.cc:3060] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.051051 16663 raft_consensus.cc:2468] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:41.052788 17322 leader_election.cc:304] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:41.053357 16511 raft_consensus.cc:2468] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:41.053778 17604 raft_consensus.cc:2804] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.054327 17604 raft_consensus.cc:697] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:41.055241 17604 consensus_queue.cc:237] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:41.065904 16337 catalog_manager.cc:5697] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.127296 17575 raft_consensus.cc:993] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower ccb9eea20c4f4b309b2b16f8edb35d4f to start an election
I20260709 13:19:41.128216 17575 raft_consensus.cc:1081] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Signalling peer ccb9eea20c4f4b309b2b16f8edb35d4f to start an election
I20260709 13:19:41.130558 16663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
 from {username='slave'} at 127.0.0.1:38870
I20260709 13:19:41.131223 16663 raft_consensus.cc:493] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.131559 16663 raft_consensus.cc:3060] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.140138 16663 raft_consensus.cc:515] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:41.143595 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:41.146293 16663 leader_election.cc:290] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:41.144271 16591 raft_consensus.cc:3055] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.147962 16591 raft_consensus.cc:740] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:41.149183 16591 consensus_queue.cc:260] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:41.149688 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c58974f33d54a1f9028ee4990d3bb18" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:41.150358 16511 raft_consensus.cc:3060] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.150884 16591 raft_consensus.cc:3060] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.159148 16511 raft_consensus.cc:2468] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:41.159428 16591 raft_consensus.cc:2468] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:41.161065 16629 leader_election.cc:304] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:41.161985 17572 raft_consensus.cc:2804] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.164776 17572 raft_consensus.cc:697] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:41.166546 17572 consensus_queue.cc:237] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:41.171234 17573 raft_consensus.cc:993] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.171967 17573 raft_consensus.cc:1081] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.176313 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:41.177096 17434 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.177522 17434 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.190069 17577 raft_consensus.cc:993] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.190712 17577 raft_consensus.cc:1081] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.193627 17431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47224
I20260709 13:19:41.194607 17431 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.195163 17431 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:41.199194 17434 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:41.198959 16337 catalog_manager.cc:5697] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.202831 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:41.203617 16591 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.204378 17434 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:41.205968 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:41.206568 16663 raft_consensus.cc:3055] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.207022 16663 raft_consensus.cc:740] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:41.208053 16663 consensus_queue.cc:260] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:41.209918 16663 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.212056 16591 raft_consensus.cc:2468] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:41.213599 17322 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:41.209867 17431 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:41.214488 17604 raft_consensus.cc:2804] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.214977 17604 raft_consensus.cc:697] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:41.215873 17604 consensus_queue.cc:237] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:41.218205 16663 raft_consensus.cc:2468] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:41.221115 17431 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:41.221710 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:41.222393 16511 raft_consensus.cc:3055] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:41.222977 16511 raft_consensus.cc:740] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:41.223177 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bac8634695c48d1b6f03da70c4a02e5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:41.223701 16511 consensus_queue.cc:260] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:41.223734 16591 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:41.225312 16511 raft_consensus.cc:3060] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:41.234558 16591 raft_consensus.cc:2468] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:41.235920 17322 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:41.236810 17604 raft_consensus.cc:2804] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:41.237363 17604 raft_consensus.cc:697] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:41.237129 16511 raft_consensus.cc:2468] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:41.238446 17604 consensus_queue.cc:237] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:41.241762 16337 catalog_manager.cc:5697] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.260197 16337 catalog_manager.cc:5697] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 2 to 3, leader changed from ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.338959 17573 raft_consensus.cc:993] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.339630 17621 raft_consensus.cc:1081] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:41.341487 17431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:41.341933 17431 raft_consensus.cc:493] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.342171 17431 raft_consensus.cc:3060] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.349215 17431 raft_consensus.cc:515] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:41.350646 17431 leader_election.cc:290] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:41.351409 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:41.351804 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8e78b7c021a4e4eb0e85bcb9b573bf9" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:41.352074 16663 raft_consensus.cc:3055] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.352355 16511 raft_consensus.cc:3060] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.352456 16663 raft_consensus.cc:740] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:41.353744 16663 consensus_queue.cc:260] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:41.354758 16663 raft_consensus.cc:3060] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.358778 16511 raft_consensus.cc:2468] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:41.359848 16663 raft_consensus.cc:2468] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:41.360092 17321 leader_election.cc:304] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:41.361021 17604 raft_consensus.cc:2804] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.361562 17604 raft_consensus.cc:697] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:41.362541 17604 consensus_queue.cc:237] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:41.372845 16337 catalog_manager.cc:5697] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:41.456288 16511 raft_consensus.cc:1275] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.457604 17604 consensus_queue.cc:1048] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:41.470721 16662 raft_consensus.cc:1275] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.474673 17604 consensus_queue.cc:1048] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:41.586674 16511 raft_consensus.cc:1275] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.588243 17621 consensus_queue.cc:1048] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:41.591064 17582 raft_consensus.cc:993] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower ccb9eea20c4f4b309b2b16f8edb35d4f to start an election
I20260709 13:19:41.591632 17582 raft_consensus.cc:1081] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Signalling peer ccb9eea20c4f4b309b2b16f8edb35d4f to start an election
I20260709 13:19:41.593437 16663 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
 from {username='slave'} at 127.0.0.1:38870
I20260709 13:19:41.594004 16663 raft_consensus.cc:493] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:41.594439 16663 raft_consensus.cc:3060] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.602053 16663 raft_consensus.cc:515] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:41.605110 16588 raft_consensus.cc:1275] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.607136 16663 leader_election.cc:290] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:41.606925 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:41.607525 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3520d3184b6a4c918fe43f5109f4914b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:41.607860 16512 raft_consensus.cc:3060] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.606935 17604 consensus_queue.cc:1048] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:41.608199 16588 raft_consensus.cc:3055] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:41.608649 16588 raft_consensus.cc:740] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:41.609540 16588 consensus_queue.cc:260] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:41.611297 16591 raft_consensus.cc:1275] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.612967 17573 consensus_queue.cc:1048] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:41.615243 16512 raft_consensus.cc:2468] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:41.613121 16588 raft_consensus.cc:3060] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:41.620021 16591 raft_consensus.cc:1275] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:41.621464 17604 consensus_queue.cc:1048] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:41.622465 16629 leader_election.cc:304] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:41.623337 17573 raft_consensus.cc:2804] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:41.623898 17573 raft_consensus.cc:697] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:41.624779 17573 consensus_queue.cc:237] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:41.638366 16663 raft_consensus.cc:1275] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.638619 16511 raft_consensus.cc:1275] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:41.638846 16588 raft_consensus.cc:2468] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:41.643489 17590 consensus_queue.cc:1048] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:41.648636 17604 consensus_queue.cc:1048] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:19:41.824728 16337 catalog_manager.cc:5697] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:41.916234 16663 raft_consensus.cc:1275] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:41.931813 17589 consensus_queue.cc:1048] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:19:41.969682 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 72476.7us
W20260709 13:19:41.970789 16483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 94176.2us
W20260709 13:19:41.987725 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 289708us
I20260709 13:19:41.988590 16512 raft_consensus.cc:1275] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:19:41.997382 17637 log.cc:927] Time spent T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: Append to log took a long time: real 0.100s	user 0.004s	sys 0.001s
I20260709 13:19:42.000212 17590 consensus_queue.cc:1048] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:42.053509  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:42.076256 16556 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 50080.9us
W20260709 13:19:42.086066 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:46203, user_credentials={real_user=slave}} blocked reactor thread for 103752us
I20260709 13:19:42.216482 16512 raft_consensus.cc:1275] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:42.255098 17621 consensus_queue.cc:1048] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:42.265726 16583 raft_consensus.cc:1275] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:42.269106 17621 consensus_queue.cc:1048] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:42.420164  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:42.530560 16583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:42.531286 16583 raft_consensus.cc:606] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:42.534231 16583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:42.534909 16583 raft_consensus.cc:606] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:42.537621 16583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:42.538121 16583 raft_consensus.cc:606] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:42.540824 16659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:42.541570 16659 raft_consensus.cc:606] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:42.544476 16659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:42.545233 16659 raft_consensus.cc:606] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:42.548581 16511 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c"
dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
mode: GRACEFUL
new_leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
 from {username='slave'} at 127.0.0.1:58796
I20260709 13:19:42.549696 16511 raft_consensus.cc:606] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Received request to transfer leadership to TS ccb9eea20c4f4b309b2b16f8edb35d4f
I20260709 13:19:42.551168  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:19:42.553525  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:42.700500 17643 raft_consensus.cc:993] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.702610 17649 raft_consensus.cc:1081] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.704957 17431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:19:42.705544 17431 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.705938 17431 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.716066 17431 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:42.718405 17431 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:42.719306 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:42.719843 16591 raft_consensus.cc:3055] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.720059 16591 raft_consensus.cc:740] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:42.720707 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:42.720722 16591 consensus_queue.cc:260] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:42.721455 16659 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.722232 16591 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.729360 16591 raft_consensus.cc:2468] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:42.730937 16659 raft_consensus.cc:2468] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:42.731869 17322 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:42.732774 17590 raft_consensus.cc:2804] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.733314 17590 raft_consensus.cc:697] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:42.734247 17590 consensus_queue.cc:237] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:42.747440 16335 catalog_manager.cc:5697] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.762979 17649 raft_consensus.cc:993] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.763556 17643 raft_consensus.cc:1081] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.765642 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:19:42.766208 17434 raft_consensus.cc:493] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.766570 17434 raft_consensus.cc:3060] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.772245 17434 raft_consensus.cc:515] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:42.775177 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:42.775781 16511 raft_consensus.cc:3060] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.778687 17434 leader_election.cc:290] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:42.780056 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37783a4d91d641869b5677b3fab1a0ee" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:42.780831 16591 raft_consensus.cc:3055] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.781296 16591 raft_consensus.cc:740] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:42.782305 16591 consensus_queue.cc:260] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:42.783536 16591 raft_consensus.cc:3060] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.783711 16511 raft_consensus.cc:2468] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:42.784943 17321 leader_election.cc:304] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:42.785889 17590 raft_consensus.cc:2804] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.786377 17590 raft_consensus.cc:697] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:42.787503 17590 consensus_queue.cc:237] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:42.791844 16591 raft_consensus.cc:2468] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:42.800592 16335 catalog_manager.cc:5697] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:42.801496 17654 raft_consensus.cc:993] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.802066 17621 raft_consensus.cc:1081] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.803527 17431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:42.804105 17431 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.804451 17431 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.810488 17431 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:42.812075 17431 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:42.812808 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:42.813047 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:42.813587 16591 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.813738 16659 raft_consensus.cc:3055] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.814210 16659 raft_consensus.cc:740] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:42.814924 16659 consensus_queue.cc:260] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:42.815972 16659 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.819458 16591 raft_consensus.cc:2468] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:42.820719 17322 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:42.821470 17590 raft_consensus.cc:2804] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.821925 17590 raft_consensus.cc:697] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:42.822525 16659 raft_consensus.cc:2468] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:42.822672 17590 consensus_queue.cc:237] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:42.836679 16335 catalog_manager.cc:5697] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.850652 17651 raft_consensus.cc:993] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: : Instructing follower ccb9eea20c4f4b309b2b16f8edb35d4f to start an election
I20260709 13:19:42.851181 17577 raft_consensus.cc:1081] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Signalling peer ccb9eea20c4f4b309b2b16f8edb35d4f to start an election
I20260709 13:19:42.852999 16659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
 from {username='slave'} at 127.0.0.1:38872
I20260709 13:19:42.853667 16659 raft_consensus.cc:493] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.853940 16659 raft_consensus.cc:3060] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.859632 16659 raft_consensus.cc:515] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:42.861893 16659 leader_election.cc:290] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:42.862666 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:42.862926 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfedb410dfa649a4a8f9436fffc8994c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:42.863349 16511 raft_consensus.cc:3055] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:42.863426 16591 raft_consensus.cc:3060] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.863734 16511 raft_consensus.cc:740] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ec4abbd5c2a54ed19180984efefd22f8, State: Running, Role: LEADER
I20260709 13:19:42.864559 16511 consensus_queue.cc:260] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:42.865824 16511 raft_consensus.cc:3060] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:42.871007 16591 raft_consensus.cc:2468] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:42.872489 16511 raft_consensus.cc:2468] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:42.872507 16630 leader_election.cc:304] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:42.873790 17654 raft_consensus.cc:2804] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:42.874274 17654 raft_consensus.cc:697] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:42.875012 17654 consensus_queue.cc:237] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:42.889878 16335 catalog_manager.cc:5697] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 1 to 2, leader changed from ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 2 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:42.992113 17621 raft_consensus.cc:993] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.992662 17621 raft_consensus.cc:1081] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:42.994462 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47238
I20260709 13:19:42.994997 17434 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:42.995321 17434 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:43.002574 17434 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:43.004781 17434 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:43.005769 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:43.006517 16659 raft_consensus.cc:3055] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:43.006788 16659 raft_consensus.cc:740] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:43.006960 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:43.007522 16591 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:43.007560 16659 consensus_queue.cc:260] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:43.008994 16659 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:43.013211 16591 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:43.014726 17322 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:43.015067 16659 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 3.
I20260709 13:19:43.015914 17590 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:43.016412 17590 raft_consensus.cc:697] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:43.017282 17590 consensus_queue.cc:237] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:43.035221 16335 catalog_manager.cc:5697] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 2 to 3, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 3 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.041044 17643 raft_consensus.cc:993] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:43.041679 17649 raft_consensus.cc:1081] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:43.043426 17434 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:19:43.043993 17434 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:43.044386 17434 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.050410 17434 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:43.051796 17434 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:43.052826 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:43.053151 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:43.053577 16583 raft_consensus.cc:3055] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:43.053823 16659 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.053982 16583 raft_consensus.cc:740] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:43.054917 16583 consensus_queue.cc:260] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:43.056193 16583 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:43.061710 16659 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:43.064109 17322 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:43.063800 16583 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:43.065163 17636 raft_consensus.cc:2804] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:43.065769 17636 raft_consensus.cc:697] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:43.066818 17636 consensus_queue.cc:237] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:43.078414 16335 catalog_manager.cc:5697] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:43.120242 16659 raft_consensus.cc:1275] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.121580 17636 consensus_queue.cc:1048] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.160305 16583 raft_consensus.cc:1275] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.161931 17590 consensus_queue.cc:1048] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.250906 16589 raft_consensus.cc:1275] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.252645 17590 consensus_queue.cc:1048] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:43.264232 16662 raft_consensus.cc:1275] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.267848 16512 raft_consensus.cc:1275] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.267580 17636 consensus_queue.cc:1048] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:43.269637 17636 consensus_queue.cc:1048] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:43.306030 16589 raft_consensus.cc:1275] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.307960 17671 consensus_queue.cc:1048] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.324326 16589 raft_consensus.cc:1275] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.325699 17621 consensus_queue.cc:1048] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.342118 16512 raft_consensus.cc:1275] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer ccb9eea20c4f4b309b2b16f8edb35d4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.343611 17673 consensus_queue.cc:1048] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.455989 16659 raft_consensus.cc:1275] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:43.457837 17590 consensus_queue.cc:1048] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:19:43.474992 16589 raft_consensus.cc:1275] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:43.485373 17671 consensus_queue.cc:1048] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:43.528998 16589 raft_consensus.cc:1275] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.530241 17671 consensus_queue.cc:1048] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:43.539048 16659 raft_consensus.cc:1275] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:43.543089 17636 consensus_queue.cc:1048] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:43.554577  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:43.625769  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:43.683730 16659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf"
dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
mode: GRACEFUL
new_leader_uuid: "df1d541d9e6249978deccff88fdfe1a3"
 from {username='slave'} at 127.0.0.1:51706
I20260709 13:19:43.684290 16659 raft_consensus.cc:606] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Received request to transfer leadership to TS df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:43.686004  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:43.688469  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:44.170905 17654 raft_consensus.cc:993] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: : Instructing follower df1d541d9e6249978deccff88fdfe1a3 to start an election
I20260709 13:19:44.171761 17621 raft_consensus.cc:1081] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Signalling peer df1d541d9e6249978deccff88fdfe1a3 to start an election
I20260709 13:19:44.174108 16583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
 from {username='slave'} at 127.0.0.1:34764
I20260709 13:19:44.174868 16583 raft_consensus.cc:493] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:44.175583 16583 raft_consensus.cc:3060] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.185549 16583 raft_consensus.cc:515] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:44.190246 16583 leader_election.cc:290] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Requested vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:44.190572 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ec4abbd5c2a54ed19180984efefd22f8"
I20260709 13:19:44.191526 16512 raft_consensus.cc:3060] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.190908 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b78e2e576a46488776de50f005b8cf" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:44.192893 16663 raft_consensus.cc:3055] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:44.193269 16663 raft_consensus.cc:740] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:44.194207 16663 consensus_queue.cc:260] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:44.195399 16663 raft_consensus.cc:3060] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:44.199050 16512 raft_consensus.cc:2468] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 2.
I20260709 13:19:44.200645 16555 leader_election.cc:304] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8; no voters: 
I20260709 13:19:44.201541 17649 raft_consensus.cc:2804] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:44.202052 17649 raft_consensus.cc:697] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:44.202414 16663 raft_consensus.cc:2468] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 2.
I20260709 13:19:44.203296 17649 consensus_queue.cc:237] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:44.217727 16335 catalog_manager.cc:5697] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 1 to 2, leader changed from ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68) to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:44.611056 16512 raft_consensus.cc:1275] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Refusing update from remote peer df1d541d9e6249978deccff88fdfe1a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.612607 17649 consensus_queue.cc:1048] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:44.689458  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:44.708024 16663 raft_consensus.cc:1275] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer df1d541d9e6249978deccff88fdfe1a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:44.744498 17699 consensus_queue.cc:1048] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:44.815440  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:44.855595 16583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b"
dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
mode: GRACEFUL
new_leader_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:56582
I20260709 13:19:44.856117 16583 raft_consensus.cc:606] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Received request to transfer leadership to TS d663b44309664a8e85e27bcc0804d088
I20260709 13:19:44.857559  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:19:44.858973  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:45.015847 17699 raft_consensus.cc:993] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: : Instructing follower d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:45.016748 17704 raft_consensus.cc:1081] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Signalling peer d663b44309664a8e85e27bcc0804d088 to start an election
I20260709 13:19:45.018517 17431 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b"
dest_uuid: "d663b44309664a8e85e27bcc0804d088"
 from {username='slave'} at 127.0.0.1:47254
I20260709 13:19:45.019137 17431 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:45.019452 17431 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:45.025384 17431 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:45.027899 17431 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803)
I20260709 13:19:45.028479 16583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:45.029805 16583 raft_consensus.cc:3055] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:45.030011 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "d663b44309664a8e85e27bcc0804d088" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:45.030192 16583 raft_consensus.cc:740] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:45.030956 16663 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:45.031472 16583 consensus_queue.cc:260] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:45.032529 16583 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:45.036972 16663 raft_consensus.cc:2468] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:45.039753 16583 raft_consensus.cc:2468] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d663b44309664a8e85e27bcc0804d088 in term 2.
I20260709 13:19:45.039819 17322 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088; no voters: 
I20260709 13:19:45.042197 17590 raft_consensus.cc:2804] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:45.042733 17590 raft_consensus.cc:697] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Becoming Leader. State: Replica: d663b44309664a8e85e27bcc0804d088, State: Running, Role: LEADER
I20260709 13:19:45.043702 17590 consensus_queue.cc:237] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:45.055953 16335 catalog_manager.cc:5697] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 reported cstate change: term changed from 1 to 2, leader changed from df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67) to d663b44309664a8e85e27bcc0804d088 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "d663b44309664a8e85e27bcc0804d088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:45.394213 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:33429, user_credentials={real_user=slave}} blocked reactor thread for 72410.6us
I20260709 13:19:45.548089 16591 raft_consensus.cc:1275] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:45.550151 17719 consensus_queue.cc:1048] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:45.572844 16659 raft_consensus.cc:1275] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Refusing update from remote peer d663b44309664a8e85e27bcc0804d088: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:45.587445 17719 consensus_queue.cc:1048] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:45.860713  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:45.924068  7657 tablet_server.cc:179] TabletServer@127.7.122.65:46203 shutting down...
W20260709 13:19:45.983562 16631 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 369 similar messages]
W20260709 13:19:45.999838 16631 consensus_peers.cc:597] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.023882 16557 consensus_peers.cc:597] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.029286 16631 consensus_peers.cc:597] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.039639  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:46.041565  7657 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:46.045812 16631 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.045929  7657 raft_consensus.cc:2243] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.050158  7657 raft_consensus.cc:2272] T ae01c3ebc7e44b90bb66c407f8969381 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.058784 16631 consensus_peers.cc:597] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.058892  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.060138  7657 raft_consensus.cc:2243] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.061781  7657 raft_consensus.cc:2272] T ab608fbd45fe408b9eb49f4fabeb9aef P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.075119  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.077497  7657 raft_consensus.cc:2243] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.081318  7657 raft_consensus.cc:2272] T 04e92af3acfe4273bd9e0652d59ccc68 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.086360  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.087745  7657 raft_consensus.cc:2243] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.089207  7657 raft_consensus.cc:2272] T b6b6908daa7d470d9390a5833ea96825 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.093888 16483 consensus_peers.cc:597] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.094611  7657 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:46.094725 16483 consensus_peers.cc:597] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.095533 16483 consensus_peers.cc:597] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.095999  7657 raft_consensus.cc:2243] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.097021  7657 raft_consensus.cc:2272] T d4f64336673a45d99ebe7cc4736fb411 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.101132  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.102216  7657 raft_consensus.cc:2243] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.103230  7657 raft_consensus.cc:2272] T b817e005d140481c9f6ad4b49f1f0837 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.109606  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.110921  7657 raft_consensus.cc:2243] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:46.114583 16557 consensus_peers.cc:597] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.114814  7657 raft_consensus.cc:2272] T 3b250f340b854e90816317511b46db7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.117753  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.118561  7657 raft_consensus.cc:2243] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.119055  7657 raft_consensus.cc:2272] T ccf47a28b4474e56ba716e2826c931a3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.123188  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.125348  7657 raft_consensus.cc:2243] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.126468  7657 raft_consensus.cc:2272] T be1c7cede5d74f08be30f9213dc321fb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.129945  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.131093  7657 raft_consensus.cc:2243] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.132074  7657 raft_consensus.cc:2272] T 36c09a4594984fd897c2eca96506b208 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.138208  7657 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:46.141018 16483 consensus_peers.cc:597] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.141176  7657 raft_consensus.cc:2243] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.142132  7657 raft_consensus.cc:2272] T 72af2df1d2c54a47a37d3f35a497d2c9 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.145622  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.146566  7657 raft_consensus.cc:2243] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.147691  7657 raft_consensus.cc:2272] T e64cf57688fb4b35b7754c1f3083ba13 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.151389  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.152134  7657 raft_consensus.cc:2243] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.153563  7657 raft_consensus.cc:2272] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.158280  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.159312  7657 raft_consensus.cc:2243] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.160684  7657 raft_consensus.cc:2272] T 41ef175e12f7452e9bced9499cd84b9f P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.164662  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.165510  7657 raft_consensus.cc:2243] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.166074  7657 raft_consensus.cc:2272] T e727763fa55140febaf02de70b136741 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.167191 16557 consensus_peers.cc:597] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.170118  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.171085  7657 raft_consensus.cc:2243] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.172041  7657 raft_consensus.cc:2272] T 7033b0b5479941d1baab89153f09dcde P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.175025 16631 consensus_peers.cc:597] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.176442  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.177371  7657 raft_consensus.cc:2243] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.178481  7657 raft_consensus.cc:2272] T e49520220f904c3eb4c608cc67bc6533 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.182301  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.183518  7657 raft_consensus.cc:2243] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.185101  7657 raft_consensus.cc:2272] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.187371 16483 consensus_peers.cc:597] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.188774  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.189597  7657 raft_consensus.cc:2243] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.190088  7657 raft_consensus.cc:2272] T 7036dbae781d42c997f89fb211d4da89 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.194291  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.195308  7657 raft_consensus.cc:2243] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.195968  7657 raft_consensus.cc:2272] T c6fc1bb72e014b8ea956277bc60db8d3 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.198968  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.199651  7657 raft_consensus.cc:2243] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.200695  7657 raft_consensus.cc:2272] T 37783a4d91d641869b5677b3fab1a0ee P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.203323  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.204393  7657 raft_consensus.cc:2243] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.205876  7657 raft_consensus.cc:2272] T 7ed35d652d57432dad826fd2eb756c7b P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.208467  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.209295  7657 raft_consensus.cc:2243] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.209887  7657 raft_consensus.cc:2272] T 2a364606015a43f090b7dd314f4bdd35 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.212828 16557 consensus_peers.cc:597] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.213693  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.214407  7657 raft_consensus.cc:2243] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.215368  7657 raft_consensus.cc:2272] T f1c2736d94d445fc991f12646b12edc2 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.218178  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.219233  7657 raft_consensus.cc:2243] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.220314  7657 raft_consensus.cc:2272] T 52a6c0c65b0142fb8554a775fa3f87c6 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.222671  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.223575  7657 raft_consensus.cc:2243] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.224200  7657 raft_consensus.cc:2272] T 76f0c5b50daa4f20ba7f0bb8daedee02 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.228978  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.230669  7657 raft_consensus.cc:2243] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:46.230573 16483 consensus_peers.cc:597] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.232156  7657 raft_consensus.cc:2272] T 7e54c35c1a9c48d6bf87b46b0f40d984 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.236089  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.237488  7657 raft_consensus.cc:2243] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.238894  7657 raft_consensus.cc:2272] T cd0e5e0193fb4247b33d41948838a10b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.242555  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.243382  7657 raft_consensus.cc:2243] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.243930  7657 raft_consensus.cc:2272] T 0a6a4f5089ef4bae8a81840ca28efa2e P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.248214  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.249202  7657 raft_consensus.cc:2243] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.249910  7657 raft_consensus.cc:2272] T 6e667d5b79d2444a91b6666d783dc895 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.253899  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.254832  7657 raft_consensus.cc:2243] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.255530  7657 raft_consensus.cc:2272] T fa3e8e73054842b9ad74a252019d99eb P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.258081  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.258819  7657 raft_consensus.cc:2243] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.259378  7657 raft_consensus.cc:2272] T d4652fa932d845a7b78a8a57edc661fd P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.263402  7657 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:46.263394 16631 consensus_peers.cc:597] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.264362  7657 raft_consensus.cc:2243] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.265470  7657 raft_consensus.cc:2272] T 5fff1e4985884cd4a18bde63d6ba1a9c P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.268524  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.269938  7657 raft_consensus.cc:2243] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.270756  7657 raft_consensus.cc:2272] T 526828ba85d1408a8004f848e12da611 P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.274215  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.274969  7657 raft_consensus.cc:2243] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.276146  7657 raft_consensus.cc:2272] T f44d7f44495e443684c23f4af9192b0b P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.279698  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.280359  7657 raft_consensus.cc:2243] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.280936  7657 raft_consensus.cc:2272] T a68f1fff79c4430e881d7b675d2d5541 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.283902  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.284590  7657 raft_consensus.cc:2243] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.285415  7657 raft_consensus.cc:2272] T 97f75167f1ed4f1dad0bb137f05f10ee P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.288955  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.289832  7657 raft_consensus.cc:2243] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.291172  7657 raft_consensus.cc:2272] T b7a75e87ed0b40428fb757740988a196 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.291908 16483 consensus_peers.cc:597] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.295425  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.296407  7657 raft_consensus.cc:2243] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.298256  7657 raft_consensus.cc:2272] T 9bac8634695c48d1b6f03da70c4a02e5 P d663b44309664a8e85e27bcc0804d088 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.303200  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.304302  7657 raft_consensus.cc:2243] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.305214  7657 raft_consensus.cc:2272] T 22db0f6fc6e1413fb75245a35d2e4cef P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.309144  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.309876  7657 raft_consensus.cc:2243] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.310456  7657 raft_consensus.cc:2272] T e322abcf02184f63b716976eecccf24f P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.312091 16557 consensus_peers.cc:597] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.314602  7657 tablet_replica.cc:333] stopping tablet replica
W20260709 13:19:46.315294 16557 consensus_peers.cc:597] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.315603  7657 raft_consensus.cc:2243] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.316196  7657 raft_consensus.cc:2272] T 97929a85900c4b398c9e654088b6fb7d P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.320576  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.321384  7657 raft_consensus.cc:2243] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.322371  7657 raft_consensus.cc:2272] T 7370e1984b694aa99dce543ee5fffbad P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.323052 16557 consensus_peers.cc:597] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.326601  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.327809  7657 raft_consensus.cc:2243] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.328387  7657 raft_consensus.cc:2272] T ad9f159848bf47c0bb6f68a580087fcc P d663b44309664a8e85e27bcc0804d088 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.331050 16483 consensus_peers.cc:597] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.332341  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:19:46.333637  7657 raft_consensus.cc:2243] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.334354  7657 raft_consensus.cc:2272] T 67d82bece8c0482f890496c02af54926 P d663b44309664a8e85e27bcc0804d088 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.369171 16557 consensus_peers.cc:597] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.372334 16631 consensus_peers.cc:597] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.388152 16631 consensus_peers.cc:597] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.405515 16631 consensus_peers.cc:597] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.412667 16483 consensus_peers.cc:597] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.410867 16631 consensus_peers.cc:597] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.416400 16557 consensus_peers.cc:597] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.419682 16631 consensus_peers.cc:597] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.436307 16483 consensus_peers.cc:597] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.471717  7657 tablet_server.cc:196] TabletServer@127.7.122.65:46203 shutdown complete.
W20260709 13:19:46.472934 16483 consensus_peers.cc:597] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.601400 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.68:34803, user_credentials={real_user=slave}} blocked reactor thread for 48341.3us
I20260709 13:19:46.747350  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
W20260709 13:19:46.756040 16629 consensus_peers.cc:597] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.792979 16555 consensus_peers.cc:597] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.811120 16629 consensus_peers.cc:597] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.818328 16629 consensus_peers.cc:597] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.844462 16555 consensus_peers.cc:597] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.870496 16629 consensus_peers.cc:597] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.881398  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:46.885443  7657 tablet_replica.cc:333] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.886504  7657 raft_consensus.cc:2243] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:46.886807 16629 consensus_peers.cc:597] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.887176  7657 raft_consensus.cc:2272] T 04e92af3acfe4273bd9e0652d59ccc68 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.890249 16629 consensus_peers.cc:597] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.895985  7657 tablet_replica.cc:333] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.898432  7657 raft_consensus.cc:2243] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:46.902208 16555 consensus_peers.cc:597] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:46.897284 16629 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.919260  7657 raft_consensus.cc:2272] T ce763dbd25fa427992454c176ec757c4 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.925560  7657 tablet_replica.cc:333] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.926946  7657 raft_consensus.cc:2243] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.927582  7657 raft_consensus.cc:2272] T 526828ba85d1408a8004f848e12da611 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.936522  7657 tablet_replica.cc:333] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.937428  7657 raft_consensus.cc:2243] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.938242  7657 raft_consensus.cc:2272] T 37783a4d91d641869b5677b3fab1a0ee P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.941830  7657 tablet_replica.cc:333] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.942657  7657 raft_consensus.cc:2243] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.943181  7657 raft_consensus.cc:2272] T 3b250f340b854e90816317511b46db7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.946223  7657 tablet_replica.cc:333] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.947613  7657 raft_consensus.cc:2243] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.948192  7657 raft_consensus.cc:2272] T b817e005d140481c9f6ad4b49f1f0837 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.951574  7657 tablet_replica.cc:333] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.952950  7657 raft_consensus.cc:2243] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.953480  7657 raft_consensus.cc:2272] T 07fd7d385a584bb7b88bfc35cd380c4e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.955817  7657 tablet_replica.cc:333] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.956478  7657 raft_consensus.cc:2243] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.957265  7657 raft_consensus.cc:2272] T ccf47a28b4474e56ba716e2826c931a3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.960295  7657 tablet_replica.cc:333] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.961138  7657 raft_consensus.cc:2243] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.962563  7657 raft_consensus.cc:2272] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.965759  7657 tablet_replica.cc:333] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.967008  7657 raft_consensus.cc:2243] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.968631  7657 raft_consensus.cc:2272] T cfedb410dfa649a4a8f9436fffc8994c P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.971453  7657 tablet_replica.cc:333] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.972491  7657 raft_consensus.cc:2243] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.973125  7657 raft_consensus.cc:2272] T ab608fbd45fe408b9eb49f4fabeb9aef P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.977645  7657 tablet_replica.cc:333] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.978622  7657 raft_consensus.cc:2243] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.979182  7657 raft_consensus.cc:2272] T 6e444695debf458f83b39578e6b6d31d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.982697  7657 tablet_replica.cc:333] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
W20260709 13:19:46.982766 16555 consensus_peers.cc:597] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.983744  7657 raft_consensus.cc:2243] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:46.984484  7657 raft_consensus.cc:2272] T 52a6c0c65b0142fb8554a775fa3f87c6 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:46.987938 16555 consensus_peers.cc:597] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:46.991418  7657 tablet_replica.cc:333] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.992401  7657 raft_consensus.cc:2243] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.993472  7657 raft_consensus.cc:2272] T ad9f159848bf47c0bb6f68a580087fcc P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:46.997634  7657 tablet_replica.cc:333] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:46.998499  7657 raft_consensus.cc:2243] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:46.999799  7657 raft_consensus.cc:2272] T 67d82bece8c0482f890496c02af54926 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.003191  7657 tablet_replica.cc:333] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.003895  7657 raft_consensus.cc:2243] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.004371  7657 raft_consensus.cc:2272] T e49520220f904c3eb4c608cc67bc6533 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.008293  7657 tablet_replica.cc:333] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.009640  7657 raft_consensus.cc:2243] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.010607  7657 raft_consensus.cc:2272] T a4b78e2e576a46488776de50f005b8cf P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.013625  7657 tablet_replica.cc:333] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.014446  7657 raft_consensus.cc:2243] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.015126  7657 raft_consensus.cc:2272] T 6e667d5b79d2444a91b6666d783dc895 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.018239  7657 tablet_replica.cc:333] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.018822  7657 raft_consensus.cc:2243] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.019621  7657 raft_consensus.cc:2272] T 7036dbae781d42c997f89fb211d4da89 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.021898  7657 tablet_replica.cc:333] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.022470  7657 raft_consensus.cc:2243] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.022907  7657 raft_consensus.cc:2272] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.025828  7657 tablet_replica.cc:333] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.026638  7657 raft_consensus.cc:2243] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.027344  7657 raft_consensus.cc:2272] T 1c58974f33d54a1f9028ee4990d3bb18 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.030584  7657 tablet_replica.cc:333] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.031462  7657 raft_consensus.cc:2243] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.032078  7657 raft_consensus.cc:2272] T 3520d3184b6a4c918fe43f5109f4914b P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:47.033759 16555 consensus_peers.cc:597] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.035382  7657 tablet_replica.cc:333] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.036182  7657 raft_consensus.cc:2243] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.036826  7657 raft_consensus.cc:2272] T 9b55c6dbc8124cd78b036f8b92987ab1 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.040578  7657 tablet_replica.cc:333] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.041468  7657 raft_consensus.cc:2243] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.042459  7657 raft_consensus.cc:2272] T 7e54c35c1a9c48d6bf87b46b0f40d984 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.045640  7657 tablet_replica.cc:333] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.046581  7657 raft_consensus.cc:2243] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.047714  7657 raft_consensus.cc:2272] T b6b6908daa7d470d9390a5833ea96825 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.050510  7657 tablet_replica.cc:333] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.051370  7657 raft_consensus.cc:2243] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.051970  7657 raft_consensus.cc:2272] T 67ba6acf4b9542a6b6578a341ba5006b P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.056221  7657 tablet_replica.cc:333] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
W20260709 13:19:47.056314 16555 consensus_peers.cc:597] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.057013  7657 raft_consensus.cc:2243] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.057931  7657 raft_consensus.cc:2272] T c6fc1bb72e014b8ea956277bc60db8d3 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.060379  7657 tablet_replica.cc:333] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.061422  7657 raft_consensus.cc:2243] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.062572  7657 raft_consensus.cc:2272] T f66d091e1e2a4930ae11b17b39cde541 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.065475  7657 tablet_replica.cc:333] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.066752  7657 raft_consensus.cc:2243] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.069396  7657 raft_consensus.cc:2272] T 2a364606015a43f090b7dd314f4bdd35 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.073249  7657 tablet_replica.cc:333] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.074317  7657 raft_consensus.cc:2243] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.074842  7657 raft_consensus.cc:2272] T f1c2736d94d445fc991f12646b12edc2 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.076530 17706 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.078023 17706 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.079398  7657 tablet_replica.cc:333] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.080335  7657 raft_consensus.cc:2243] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.081482  7657 raft_consensus.cc:2272] T 0a6a4f5089ef4bae8a81840ca28efa2e P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.081804 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:47.085958  7657 tablet_replica.cc:333] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.087862  7657 raft_consensus.cc:2243] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.089397  7657 raft_consensus.cc:2272] T 3cf203eb6e6f4850899481145884643a P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.090303 17706 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:47.090494 16631 leader_election.cc:336] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.091339 16631 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:47.092027 17706 raft_consensus.cc:2749] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:47.093711  7657 tablet_replica.cc:333] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.095031  7657 raft_consensus.cc:2243] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.095624  7657 raft_consensus.cc:2272] T ae01c3ebc7e44b90bb66c407f8969381 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.098657  7657 tablet_replica.cc:333] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.099488  7657 raft_consensus.cc:2243] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.100520  7657 raft_consensus.cc:2272] T 9bac8634695c48d1b6f03da70c4a02e5 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.103606  7657 tablet_replica.cc:333] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.104277  7657 raft_consensus.cc:2243] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.104993  7657 raft_consensus.cc:2272] T a68f1fff79c4430e881d7b675d2d5541 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.108669  7657 tablet_replica.cc:333] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.109722  7657 raft_consensus.cc:2243] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.110427  7657 raft_consensus.cc:2272] T 97f75167f1ed4f1dad0bb137f05f10ee P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:47.113337 16555 consensus_peers.cc:597] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:47.114140 16555 consensus_peers.cc:597] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.114372  7657 tablet_replica.cc:333] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.115520  7657 raft_consensus.cc:2243] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.117208  7657 raft_consensus.cc:2272] T e727763fa55140febaf02de70b136741 P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.120818  7657 tablet_replica.cc:333] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
W20260709 13:19:47.121788 16555 consensus_peers.cc:597] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.123411  7657 raft_consensus.cc:2243] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.124728  7657 raft_consensus.cc:2272] T e322abcf02184f63b716976eecccf24f P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.128458  7657 tablet_replica.cc:333] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.129417  7657 raft_consensus.cc:2243] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.130357  7657 raft_consensus.cc:2272] T 22db0f6fc6e1413fb75245a35d2e4cef P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.132421 17577 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.132967 17577 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:47.133772  7657 tablet_replica.cc:333] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.134646  7657 raft_consensus.cc:2243] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.136042  7657 raft_consensus.cc:2272] T 23ea494524264f8186935c55c5301bd1 P ec4abbd5c2a54ed19180984efefd22f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.136560 17703 raft_consensus.cc:493] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.137295 17703 raft_consensus.cc:515] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:47.139428 17577 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:47.141417 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64cf57688fb4b35b7754c1f3083ba13" candidate_uuid: "ec4abbd5c2a54ed19180984efefd22f8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
W20260709 13:19:47.143586 16629 consensus_peers.cc:597] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:47.144148 16483 leader_election.cc:336] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.140196 17703 leader_election.cc:290] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:47.140471  7657 tablet_replica.cc:333] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.144649 16483 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec4abbd5c2a54ed19180984efefd22f8; no voters: d663b44309664a8e85e27bcc0804d088, df1d541d9e6249978deccff88fdfe1a3
I20260709 13:19:47.146337  7657 raft_consensus.cc:2243] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.148329 17577 raft_consensus.cc:2706] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Received pre-election callback for term 4 while not running: Illegal state: RaftConsensus is not running: State = Stopping
W20260709 13:19:47.148981 16629 leader_election.cc:336] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:47.149518  7657 raft_consensus.cc:2272] T e64cf57688fb4b35b7754c1f3083ba13 P ec4abbd5c2a54ed19180984efefd22f8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:47.150424 16631 leader_election.cc:336] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.151954 16631 leader_election.cc:304] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.153592 17703 raft_consensus.cc:2749] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:47.155153  7657 tablet_replica.cc:333] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
W20260709 13:19:47.155813 16629 consensus_peers.cc:597] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.156068  7657 raft_consensus.cc:2243] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.156759  7657 raft_consensus.cc:2272] T 401e752e0f07412eb1f2506a3d7e942a P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.160044  7657 tablet_replica.cc:333] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.160768  7657 raft_consensus.cc:2243] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.161944  7657 raft_consensus.cc:2272] T 7033b0b5479941d1baab89153f09dcde P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.164390  7657 tablet_replica.cc:333] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8: stopping tablet replica
I20260709 13:19:47.165021  7657 raft_consensus.cc:2243] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.165596  7657 raft_consensus.cc:2272] T 97929a85900c4b398c9e654088b6fb7d P ec4abbd5c2a54ed19180984efefd22f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.168994 17730 raft_consensus.cc:493] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.169570 17730 raft_consensus.cc:515] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:47.171551 17730 leader_election.cc:290] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:47.177055 16557 leader_election.cc:336] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:47.177682 16555 leader_election.cc:336] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:47.178419 16555 leader_election.cc:304] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.180177 17730 raft_consensus.cc:2749] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:47.368078 17702 raft_consensus.cc:493] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.369084 17702 raft_consensus.cc:515] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:47.372576 17702 leader_election.cc:290] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:47.393868 17730 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.394832 17730 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.397783 17730 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
W20260709 13:19:47.400609 16555 leader_election.cc:336] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:47.406931 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
W20260709 13:19:47.420843 16629 consensus_peers.cc:597] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.423630 17740 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.424302 17740 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.428071 17740 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.429080 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:47.447118 17741 raft_consensus.cc:493] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.447909 17741 raft_consensus.cc:515] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:47.451727 17741 leader_election.cc:290] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:47.456981 16629 consensus_peers.cc:597] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Couldn't send request to peer ec4abbd5c2a54ed19180984efefd22f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:47.459964 16629 leader_election.cc:336] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:47.468238 17621 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.468823 17621 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.471138 17621 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.491780 17621 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
W20260709 13:19:47.490139 16631 leader_election.cc:336] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.494403 17621 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.494477 16631 leader_election.cc:304] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.498620 17621 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.503046 17621 raft_consensus.cc:493] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.503549 17621 raft_consensus.cc:515] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:47.503775 17743 raft_consensus.cc:2749] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:47.513365 17621 leader_election.cc:290] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:47.516654 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:47.517475 16590 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
W20260709 13:19:47.529311 16629 connection.cc:769] client connection to 127.7.122.66:38173 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 13:19:47.530288 16629 leader_election.cc:336] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:19:47.528679 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:47.531545 16589 raft_consensus.cc:2468] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:47.532023 17702 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.533610 17702 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.537223 17702 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.538816 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:47.541093 17702 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.541927 17702 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.544116 17702 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.544939 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" is_pre_election: true
I20260709 13:19:47.545634 16663 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 2.
I20260709 13:19:47.548115 16556 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
W20260709 13:19:47.552184 16555 connection.cc:769] client connection to 127.7.122.66:38173 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:19:47.553556 16630 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:47.556658  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
W20260709 13:19:47.557737 16557 leader_election.cc:336] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.558312 16557 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
W20260709 13:19:47.558430 16631 leader_election.cc:336] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.558459 17744 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:19:47.559443 17744 raft_consensus.cc:493] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.559968 17744 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:47.561239 17702 raft_consensus.cc:2804] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:47.561697 17702 raft_consensus.cc:493] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.560096 16630 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:47.562083 17702 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.572312 17730 raft_consensus.cc:2749] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:47.572757 16557 leader_election.cc:336] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.573298 16557 leader_election.cc:304] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.573733 17742 raft_consensus.cc:2804] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:47.574118 17621 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.574515 17742 raft_consensus.cc:493] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.574960 17621 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.575084 17741 raft_consensus.cc:493] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.575937 17743 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.575831 17741 raft_consensus.cc:515] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:47.576532 17743 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.577325 17621 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.577885 17741 leader_election.cc:290] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:47.578161 16631 leader_election.cc:336] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.578655 17743 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.575089 17742 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:47.579797 16631 leader_election.cc:336] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.580291 16631 leader_election.cc:304] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.582870 17739 raft_consensus.cc:2749] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:47.584689 16557 leader_election.cc:336] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.585194 16557 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.585975 17730 raft_consensus.cc:2749] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:47.586151 17743 raft_consensus.cc:2749] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:47.590759 16629 leader_election.cc:336] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
W20260709 13:19:47.586232 16557 leader_election.cc:336] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.593991 16557 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: ccb9eea20c4f4b309b2b16f8edb35d4f, d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.596967 17739 raft_consensus.cc:2749] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:19:47.601955 16631 leader_election.cc:336] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:47.603021 16631 leader_election.cc:336] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.603592 16631 leader_election.cc:304] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.607353 17730 raft_consensus.cc:493] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.608165 17730 raft_consensus.cc:515] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:47.610260 17742 raft_consensus.cc:515] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.613440 17742 leader_election.cc:290] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.614377 17741 raft_consensus.cc:2749] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:47.614588 16631 leader_election.cc:336] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.615352 17744 raft_consensus.cc:515] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.610777 17730 leader_election.cc:290] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:47.619125 16557 leader_election.cc:336] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.623663 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:47.623524 17702 raft_consensus.cc:515] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.624964 16590 raft_consensus.cc:2468] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
W20260709 13:19:47.625984 16631 leader_election.cc:336] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.627139 17741 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.627832 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7765fb52e7dc43a4a4ea5c29cd4ae2b5" candidate_uuid: "df1d541d9e6249978deccff88fdfe1a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f"
I20260709 13:19:47.627714 17741 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.627938 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:47.628280 17744 leader_election.cc:290] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.628451 16663 raft_consensus.cc:3060] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.628679 16590 raft_consensus.cc:2468] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:47.630322 17741 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.627722 17702 leader_election.cc:290] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 election: Requested vote from peers ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68:34803), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.634810 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41ef175e12f7452e9bced9499cd84b9f" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:47.635581 16590 raft_consensus.cc:3060] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.641805 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed35d652d57432dad826fd2eb756c7b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:47.642541 16589 raft_consensus.cc:3060] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:19:47.643610 16663 raft_consensus.cc:2468] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df1d541d9e6249978deccff88fdfe1a3 in term 3.
I20260709 13:19:47.645599 16556 leader_election.cc:304] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
W20260709 13:19:47.647224 16631 leader_election.cc:336] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:47.647794 16631 leader_election.cc:336] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.648483 17730 raft_consensus.cc:2804] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:47.649451 17730 raft_consensus.cc:697] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 LEADER]: Becoming Leader. State: Replica: df1d541d9e6249978deccff88fdfe1a3, State: Running, Role: LEADER
I20260709 13:19:47.649832 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3" is_pre_election: true
I20260709 13:19:47.650818 16591 raft_consensus.cc:2468] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 2.
I20260709 13:19:47.650854 17730 consensus_queue.cc:237] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.659338 16589 raft_consensus.cc:2468] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 4.
W20260709 13:19:47.665288 16557 leader_election.cc:336] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.665010 17741 raft_consensus.cc:493] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.668190 17741 raft_consensus.cc:515] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:47.669287 16630 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.670603 17742 raft_consensus.cc:2804] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:47.671548 17742 raft_consensus.cc:493] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.672072 17742 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:47.681420 16631 leader_election.cc:336] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.685529 17741 leader_election.cc:290] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:47.685614 16630 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.688071 17741 raft_consensus.cc:2804] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:47.688562 17741 raft_consensus.cc:493] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.688956 17741 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.691923 16630 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.693598 17744 raft_consensus.cc:2804] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:19:47.694082 17744 raft_consensus.cc:493] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting leader election (detected failure of leader d663b44309664a8e85e27bcc0804d088)
I20260709 13:19:47.694517 17744 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:19:47.694487 16629 leader_election.cc:336] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:47.695461 16630 leader_election.cc:304] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.695977 16629 leader_election.cc:304] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.697165 17743 raft_consensus.cc:2804] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:19:47.697270 17621 raft_consensus.cc:2749] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:47.698019 17743 raft_consensus.cc:697] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 4 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:47.699221 17743 consensus_queue.cc:237] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:47.710747 16555 leader_election.cc:336] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
W20260709 13:19:47.711604 16557 leader_election.cc:336] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.721531 17744 raft_consensus.cc:515] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.711678 16555 leader_election.cc:304] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:47.726269 17742 raft_consensus.cc:515] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.730331 17730 raft_consensus.cc:2749] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:19:47.732592 17741 raft_consensus.cc:515] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.707297 16590 raft_consensus.cc:2468] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
I20260709 13:19:47.736719 17744 leader_election.cc:290] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.741257 16336 catalog_manager.cc:5697] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 reported cstate change: term changed from 2 to 3, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67). New cstate: current_term: 3 leader_uuid: "df1d541d9e6249978deccff88fdfe1a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.749063 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f44d7f44495e443684c23f4af9192b0b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:47.749835 16590 raft_consensus.cc:3060] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.749702 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd0e5e0193fb4247b33d41948838a10b" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:47.750486 16591 raft_consensus.cc:3060] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.757856 17742 leader_election.cc:290] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.759567 16591 raft_consensus.cc:2468] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
I20260709 13:19:47.761875 16630 leader_election.cc:304] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.762039 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5fff1e4985884cd4a18bde63d6ba1a9c" candidate_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "df1d541d9e6249978deccff88fdfe1a3"
I20260709 13:19:47.763703 16589 raft_consensus.cc:3060] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:47.768184 17743 raft_consensus.cc:2804] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:47.768743 17743 raft_consensus.cc:697] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:47.768975 17741 leader_election.cc:290] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Requested vote from peers df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429), d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203)
I20260709 13:19:47.770493 16630 leader_election.cc:304] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: 
I20260709 13:19:47.771422 17703 raft_consensus.cc:2804] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:47.771894 17703 raft_consensus.cc:697] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:47.772761 17703 consensus_queue.cc:237] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.776754 17743 consensus_queue.cc:237] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
W20260709 13:19:47.779734 16631 leader_election.cc:336] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:47.780572 16631 leader_election.cc:336] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
W20260709 13:19:47.781311 16631 leader_election.cc:336] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:47.789999 16590 raft_consensus.cc:2468] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
W20260709 13:19:47.791064 17746 log.cc:927] Time spent T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:47.812623 16630 leader_election.cc:304] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.813946 17744 raft_consensus.cc:2804] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:47.814602 17744 raft_consensus.cc:697] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:47.815965 17744 consensus_queue.cc:237] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.795210 16589 raft_consensus.cc:2468] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ccb9eea20c4f4b309b2b16f8edb35d4f in term 3.
I20260709 13:19:47.818910 16630 leader_election.cc:304] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f, df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088
I20260709 13:19:47.824002 17703 raft_consensus.cc:2804] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:47.824596 17703 raft_consensus.cc:697] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Becoming Leader. State: Replica: ccb9eea20c4f4b309b2b16f8edb35d4f, State: Running, Role: LEADER
I20260709 13:19:47.825762 17703 consensus_queue.cc:237] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } }
I20260709 13:19:47.835461  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
I20260709 13:19:47.846408 16335 catalog_manager.cc:5697] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 3 to 4, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 4 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.918567 16335 catalog_manager.cc:5697] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 2 to 3, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 3 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.920415 16335 catalog_manager.cc:5697] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 2 to 3, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 3 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.922209 16335 catalog_manager.cc:5697] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 2 to 3, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 3 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.924844 16335 catalog_manager.cc:5697] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f reported cstate change: term changed from 2 to 3, leader changed from d663b44309664a8e85e27bcc0804d088 (127.7.122.65) to ccb9eea20c4f4b309b2b16f8edb35d4f (127.7.122.68). New cstate: current_term: 3 leader_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:47.950546 16630 consensus_peers.cc:597] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.962080  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:47.964253  7657 tablet_replica.cc:333] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.965371  7657 raft_consensus.cc:2243] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.966280  7657 raft_consensus.cc:2272] T d4f64336673a45d99ebe7cc4736fb411 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.969846  7657 tablet_replica.cc:333] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.970631  7657 raft_consensus.cc:2243] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.971352  7657 raft_consensus.cc:2272] T ce763dbd25fa427992454c176ec757c4 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.974135  7657 tablet_replica.cc:333] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.974874  7657 raft_consensus.cc:2243] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.975384  7657 raft_consensus.cc:2272] T 44e3f3c16d034dc983fcc6fd01ce72e9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.978413  7657 tablet_replica.cc:333] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.979246  7657 raft_consensus.cc:2243] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.979758  7657 raft_consensus.cc:2272] T cfedb410dfa649a4a8f9436fffc8994c P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.981961  7657 tablet_replica.cc:333] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.982574  7657 raft_consensus.cc:2243] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:47.983418  7657 raft_consensus.cc:2272] T 526828ba85d1408a8004f848e12da611 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.985920  7657 tablet_replica.cc:333] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.986548  7657 raft_consensus.cc:2243] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.987082  7657 raft_consensus.cc:2272] T 3cf203eb6e6f4850899481145884643a P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.989712  7657 tablet_replica.cc:333] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.990545  7657 raft_consensus.cc:2243] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.991328  7657 raft_consensus.cc:2272] T 41ef175e12f7452e9bced9499cd84b9f P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.994400  7657 tablet_replica.cc:333] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:47.995513  7657 raft_consensus.cc:2243] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:47.996223  7657 raft_consensus.cc:2272] T 7036dbae781d42c997f89fb211d4da89 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:47.999891  7657 tablet_replica.cc:333] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
W20260709 13:19:48.000142 16630 consensus_peers.cc:597] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.000753  7657 raft_consensus.cc:2243] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.001473  7657 raft_consensus.cc:2272] T 37783a4d91d641869b5677b3fab1a0ee P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.004235  7657 tablet_replica.cc:333] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.005189 17730 raft_consensus.cc:493] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.006331  7657 raft_consensus.cc:2243] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.005941 17730 raft_consensus.cc:515] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } }
I20260709 13:19:48.006989  7657 raft_consensus.cc:2272] T 07fd7d385a584bb7b88bfc35cd380c4e P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.008482 17730 leader_election.cc:290] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:48.014015 16557 leader_election.cc:336] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:48.014052  7657 tablet_replica.cc:333] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.015292  7657 raft_consensus.cc:2243] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.016073  7657 raft_consensus.cc:2272] T e64cf57688fb4b35b7754c1f3083ba13 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.019006 16555 leader_election.cc:336] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:48.019686 16555 leader_election.cc:304] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df1d541d9e6249978deccff88fdfe1a3; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.021377  7657 tablet_replica.cc:333] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.021598 17730 raft_consensus.cc:2749] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:48.023121  7657 raft_consensus.cc:2243] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.023885  7657 raft_consensus.cc:2272] T 67d82bece8c0482f890496c02af54926 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.027774  7657 tablet_replica.cc:333] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
W20260709 13:19:48.028609 16630 consensus_peers.cc:597] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.029129  7657 raft_consensus.cc:2243] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.030488  7657 raft_consensus.cc:2272] T 7370e1984b694aa99dce543ee5fffbad P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.030778 16630 consensus_peers.cc:597] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.034873  7657 tablet_replica.cc:333] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.035665  7657 raft_consensus.cc:2243] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:48.036309 16630 consensus_peers.cc:597] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.038277  7657 raft_consensus.cc:2272] T 6e444695debf458f83b39578e6b6d31d P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.042429  7657 tablet_replica.cc:333] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.043560  7657 raft_consensus.cc:2243] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.044792  7657 raft_consensus.cc:2272] T 401e752e0f07412eb1f2506a3d7e942a P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.048626  7657 tablet_replica.cc:333] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.049494  7657 raft_consensus.cc:2243] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.051172  7657 raft_consensus.cc:2272] T 36c09a4594984fd897c2eca96506b208 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.052440 16557 consensus_peers.cc:597] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.053251 17744 raft_consensus.cc:493] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.053831 17744 raft_consensus.cc:515] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:48.054418  7657 tablet_replica.cc:333] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.055348  7657 raft_consensus.cc:2243] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.055900  7657 raft_consensus.cc:2272] T be1c7cede5d74f08be30f9213dc321fb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.056051 17744 leader_election.cc:290] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
I20260709 13:19:48.059090  7657 tablet_replica.cc:333] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.060070  7657 raft_consensus.cc:2243] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:19:48.060528 16630 leader_election.cc:336] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:48.061231  7657 raft_consensus.cc:2272] T 72af2df1d2c54a47a37d3f35a497d2c9 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.061474 16629 leader_election.cc:336] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:48.062142 16629 leader_election.cc:304] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.062791 17744 raft_consensus.cc:2749] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:48.064299  7657 tablet_replica.cc:333] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.065261  7657 raft_consensus.cc:2243] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.065940  7657 raft_consensus.cc:2272] T e322abcf02184f63b716976eecccf24f P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.068509  7657 tablet_replica.cc:333] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.069423  7657 raft_consensus.cc:2243] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.070031  7657 raft_consensus.cc:2272] T 23ea494524264f8186935c55c5301bd1 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.072494  7657 tablet_replica.cc:333] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.073236  7657 raft_consensus.cc:2243] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.074453  7657 raft_consensus.cc:2272] T 22db0f6fc6e1413fb75245a35d2e4cef P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.077301  7657 tablet_replica.cc:333] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.078164  7657 raft_consensus.cc:2243] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.078845  7657 raft_consensus.cc:2272] T 7ed35d652d57432dad826fd2eb756c7b P df1d541d9e6249978deccff88fdfe1a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.081472  7657 tablet_replica.cc:333] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.082327  7657 raft_consensus.cc:2243] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.082979  7657 raft_consensus.cc:2272] T 2a364606015a43f090b7dd314f4bdd35 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.086107 16630 consensus_peers.cc:597] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.087168  7657 tablet_replica.cc:333] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.087888  7657 raft_consensus.cc:2243] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.088449  7657 raft_consensus.cc:2272] T fa3e8e73054842b9ad74a252019d99eb P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.091070  7657 tablet_replica.cc:333] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.091706  7657 raft_consensus.cc:2243] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.092597  7657 raft_consensus.cc:2272] T d4652fa932d845a7b78a8a57edc661fd P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.095356  7657 tablet_replica.cc:333] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.096230  7657 raft_consensus.cc:2243] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.097353  7657 raft_consensus.cc:2272] T 6e667d5b79d2444a91b6666d783dc895 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.101114  7657 tablet_replica.cc:333] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
W20260709 13:19:48.101450 16630 consensus_peers.cc:597] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.102155  7657 raft_consensus.cc:2243] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.104004  7657 raft_consensus.cc:2272] T a4b78e2e576a46488776de50f005b8cf P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.106988  7657 tablet_replica.cc:333] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.107837  7657 raft_consensus.cc:2243] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.108340  7657 raft_consensus.cc:2272] T 7033b0b5479941d1baab89153f09dcde P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.110947  7657 tablet_replica.cc:333] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.111548  7657 raft_consensus.cc:2243] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.112391  7657 raft_consensus.cc:2272] T 9b55c6dbc8124cd78b036f8b92987ab1 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.115394  7657 tablet_replica.cc:333] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.116515  7657 raft_consensus.cc:2243] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.117823  7657 raft_consensus.cc:2272] T e727763fa55140febaf02de70b136741 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.121475  7657 tablet_replica.cc:333] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.122483  7657 raft_consensus.cc:2243] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.123396  7657 raft_consensus.cc:2272] T 67ba6acf4b9542a6b6578a341ba5006b P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.125167 17744 raft_consensus.cc:493] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.125953 17744 raft_consensus.cc:515] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:48.127360  7657 tablet_replica.cc:333] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.128274  7657 raft_consensus.cc:2243] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.128463 17744 leader_election.cc:290] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:48.128984  7657 raft_consensus.cc:2272] T 7e54c35c1a9c48d6bf87b46b0f40d984 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.133277  7657 tablet_replica.cc:333] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
W20260709 13:19:48.134400 16631 leader_election.cc:336] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:48.134496  7657 raft_consensus.cc:2243] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.135675  7657 raft_consensus.cc:2272] T 76f0c5b50daa4f20ba7f0bb8daedee02 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.136003 16629 leader_election.cc:336] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:48.136603 16629 leader_election.cc:304] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
W20260709 13:19:48.136912 16631 consensus_peers.cc:597] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.137451 17744 raft_consensus.cc:2749] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:48.138615  7657 tablet_replica.cc:333] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.139330  7657 raft_consensus.cc:2243] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.139909  7657 raft_consensus.cc:2272] T 1c58974f33d54a1f9028ee4990d3bb18 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.142392  7657 tablet_replica.cc:333] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.143358  7657 raft_consensus.cc:2243] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.143940  7657 raft_consensus.cc:2272] T 3520d3184b6a4c918fe43f5109f4914b P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.144914 16663 raft_consensus.cc:1275] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Refusing update from remote peer df1d541d9e6249978deccff88fdfe1a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:19:48.146461  7657 tablet_replica.cc:333] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.146245 17730 consensus_queue.cc:1048] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:19:48.147290  7657 raft_consensus.cc:2243] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.148150  7657 pending_rounds.cc:70] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: Trying to abort 1 pending ops.
I20260709 13:19:48.148428  7657 pending_rounds.cc:77] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638656633397248 op_type: NO_OP noop_request { }
I20260709 13:19:48.148968  7657 raft_consensus.cc:2889] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.149302  7657 raft_consensus.cc:2272] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.153136  7657 tablet_replica.cc:333] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.154003  7657 raft_consensus.cc:2243] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.155068  7657 raft_consensus.cc:2272] T f66d091e1e2a4930ae11b17b39cde541 P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.157389  7657 tablet_replica.cc:333] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.157964  7657 raft_consensus.cc:2243] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.158491  7657 raft_consensus.cc:2272] T 5fff1e4985884cd4a18bde63d6ba1a9c P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.160512  7657 tablet_replica.cc:333] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.161158  7657 raft_consensus.cc:2243] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.161674  7657 raft_consensus.cc:2272] T 9bac8634695c48d1b6f03da70c4a02e5 P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.164947  7657 tablet_replica.cc:333] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.165655  7657 raft_consensus.cc:2243] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.166558  7657 raft_consensus.cc:2272] T b7a75e87ed0b40428fb757740988a196 P df1d541d9e6249978deccff88fdfe1a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.169296  7657 tablet_replica.cc:333] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.169986  7657 raft_consensus.cc:2243] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.170490  7657 raft_consensus.cc:2272] T f44d7f44495e443684c23f4af9192b0b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.173581  7657 tablet_replica.cc:333] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.174176  7657 raft_consensus.cc:2243] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.174994  7657 raft_consensus.cc:2272] T 97f75167f1ed4f1dad0bb137f05f10ee P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.177184  7657 tablet_replica.cc:333] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.177711  7657 raft_consensus.cc:2243] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.178177  7657 raft_consensus.cc:2272] T cd0e5e0193fb4247b33d41948838a10b P df1d541d9e6249978deccff88fdfe1a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.180310  7657 tablet_replica.cc:333] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3: stopping tablet replica
I20260709 13:19:48.180814  7657 raft_consensus.cc:2243] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.181357  7657 raft_consensus.cc:2272] T 0a6a4f5089ef4bae8a81840ca28efa2e P df1d541d9e6249978deccff88fdfe1a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:48.189851 16630 consensus_peers.cc:597] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.201822 17744 raft_consensus.cc:493] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.202512 17744 raft_consensus.cc:515] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:48.204515 17744 leader_election.cc:290] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:48.209131 16629 leader_election.cc:336] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
W20260709 13:19:48.210016 16630 leader_election.cc:336] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:48.210600 16630 leader_election.cc:304] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.211352 17744 raft_consensus.cc:2749] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:48.238517 16631 consensus_peers.cc:597] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:48.253808 16630 consensus_peers.cc:597] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.274551  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
W20260709 13:19:48.302186 16630 consensus_peers.cc:597] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.67:33429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:48.306411 16631 consensus_peers.cc:597] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.310948 17744 raft_consensus.cc:493] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.311584 17744 raft_consensus.cc:515] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:48.313954 17744 leader_election.cc:290] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:48.319451 16630 leader_election.cc:336] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Network error: Client connection negotiation failed: client connection to 127.7.122.67:33429: connect: Connection refused (error 111)
W20260709 13:19:48.320032 16629 leader_election.cc:336] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:48.320518 16629 leader_election.cc:304] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.321470 17744 raft_consensus.cc:2749] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:19:48.346498 16631 consensus_peers.cc:597] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:48.348673 16630 consensus_peers.cc:597] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.67:33429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:48.365645 17743 raft_consensus.cc:493] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.367569 17743 raft_consensus.cc:515] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } } peers { permanent_uuid: "df1d541d9e6249978deccff88fdfe1a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33429 } } peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } }
I20260709 13:19:48.374625 17743 leader_election.cc:290] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173), df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429)
W20260709 13:19:48.378728 16631 consensus_peers.cc:597] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:48.382653 16631 consensus_peers.cc:597] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:48.384392  7657 tablet_server.cc:179] TabletServer@127.7.122.68:0 shutting down...
W20260709 13:19:48.384466 16630 leader_election.cc:336] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Network error: Client connection negotiation failed: client connection to 127.7.122.67:33429: connect: Connection refused (error 111)
W20260709 13:19:48.387128 16630 consensus_peers.cc:597] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.67:33429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:48.396768 16630 consensus_peers.cc:597] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer df1d541d9e6249978deccff88fdfe1a3 (127.7.122.67:33429): Couldn't send request to peer df1d541d9e6249978deccff88fdfe1a3. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.67:33429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:48.402555 16629 leader_election.cc:336] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:48.403148 16629 leader_election.cc:304] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: df1d541d9e6249978deccff88fdfe1a3, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.404177 17703 raft_consensus.cc:2749] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:48.404897 16686 debug-util.cc:398] Leaking SignalData structure 0x7b08002485a0 after lost signal to thread 7660
W20260709 13:19:48.406504 16686 debug-util.cc:398] Leaking SignalData structure 0x7b0800220980 after lost signal to thread 16374
W20260709 13:19:48.409647 16686 debug-util.cc:398] Leaking SignalData structure 0x7b0800213b00 after lost signal to thread 16689
I20260709 13:19:48.413097 17703 raft_consensus.cc:493] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.413857 17703 raft_consensus.cc:515] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
I20260709 13:19:48.416415 17703 leader_election.cc:290] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
I20260709 13:19:48.418805 17703 raft_consensus.cc:493] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ec4abbd5c2a54ed19180984efefd22f8)
I20260709 13:19:48.419348 17703 raft_consensus.cc:515] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ccb9eea20c4f4b309b2b16f8edb35d4f" member_type: VOTER last_known_addr { host: "127.7.122.68" port: 34803 } } peers { permanent_uuid: "d663b44309664a8e85e27bcc0804d088" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 46203 } } peers { permanent_uuid: "ec4abbd5c2a54ed19180984efefd22f8" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38173 } }
W20260709 13:19:48.427383 16629 leader_election.cc:336] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
I20260709 13:19:48.428822 17703 leader_election.cc:290] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203), ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173)
W20260709 13:19:48.431578 16631 leader_election.cc:336] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:48.432078 16631 leader_election.cc:304] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.436841 17703 raft_consensus.cc:2749] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:48.442340 16629 leader_election.cc:336] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ec4abbd5c2a54ed19180984efefd22f8 (127.7.122.66:38173): Network error: Client connection negotiation failed: client connection to 127.7.122.66:38173: connect: Connection refused (error 111)
W20260709 13:19:48.443048 16631 leader_election.cc:336] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111)
I20260709 13:19:48.443506 16631 leader_election.cc:304] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ccb9eea20c4f4b309b2b16f8edb35d4f; no voters: d663b44309664a8e85e27bcc0804d088, ec4abbd5c2a54ed19180984efefd22f8
I20260709 13:19:48.444370 17703 raft_consensus.cc:2749] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:48.461544  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:48.463121  7657 tablet_replica.cc:333] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.464233  7657 raft_consensus.cc:2243] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.465629  7657 raft_consensus.cc:2272] T d4f64336673a45d99ebe7cc4736fb411 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.469795  7657 tablet_replica.cc:333] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.470715  7657 raft_consensus.cc:2243] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.471334  7657 raft_consensus.cc:2272] T ce763dbd25fa427992454c176ec757c4 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.474560  7657 tablet_replica.cc:333] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.475508  7657 raft_consensus.cc:2243] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.476171  7657 raft_consensus.cc:2272] T 04e92af3acfe4273bd9e0652d59ccc68 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.479439  7657 tablet_replica.cc:333] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.480198  7657 raft_consensus.cc:2243] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.480707  7657 raft_consensus.cc:2272] T ad9f159848bf47c0bb6f68a580087fcc P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.483456  7657 tablet_replica.cc:333] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.484364  7657 raft_consensus.cc:2243] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.484962  7657 raft_consensus.cc:2272] T 401e752e0f07412eb1f2506a3d7e942a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.488193  7657 tablet_replica.cc:333] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.489102  7657 raft_consensus.cc:2243] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.490049  7657 pending_rounds.cc:70] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: Trying to abort 1 pending ops.
I20260709 13:19:48.490229  7657 pending_rounds.cc:77] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638657148973056 op_type: NO_OP noop_request { }
I20260709 13:19:48.490552  7657 raft_consensus.cc:2889] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.490860  7657 raft_consensus.cc:2272] T 41ef175e12f7452e9bced9499cd84b9f P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.494094  7657 tablet_replica.cc:333] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.495154  7657 raft_consensus.cc:2243] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.496594  7657 raft_consensus.cc:2272] T b7a75e87ed0b40428fb757740988a196 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.500473  7657 tablet_replica.cc:333] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.501411  7657 raft_consensus.cc:2243] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.502676  7657 raft_consensus.cc:2272] T a68f1fff79c4430e881d7b675d2d5541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.505560  7657 tablet_replica.cc:333] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.506294  7657 raft_consensus.cc:2243] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.507292  7657 pending_rounds.cc:70] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: Trying to abort 1 pending ops.
I20260709 13:19:48.507529  7657 pending_rounds.cc:77] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638657368657920 op_type: NO_OP noop_request { }
I20260709 13:19:48.507825  7657 raft_consensus.cc:2889] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.508145  7657 raft_consensus.cc:2272] T f44d7f44495e443684c23f4af9192b0b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.512629  7657 tablet_replica.cc:333] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.513456  7657 raft_consensus.cc:2243] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.514088  7657 raft_consensus.cc:2272] T 6e444695debf458f83b39578e6b6d31d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.517246  7657 tablet_replica.cc:333] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
W20260709 13:19:48.517760 16631 consensus_peers.cc:597] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f -> Peer d663b44309664a8e85e27bcc0804d088 (127.7.122.65:46203): Couldn't send request to peer d663b44309664a8e85e27bcc0804d088. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:46203: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:48.518399  7657 raft_consensus.cc:2243] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.519009  7657 raft_consensus.cc:2272] T 52a6c0c65b0142fb8554a775fa3f87c6 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.523569  7657 tablet_replica.cc:333] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.525379  7657 raft_consensus.cc:2243] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.526628  7657 raft_consensus.cc:2272] T 44e3f3c16d034dc983fcc6fd01ce72e9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.530854  7657 tablet_replica.cc:333] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.531749  7657 raft_consensus.cc:2243] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.532671  7657 raft_consensus.cc:2272] T ab608fbd45fe408b9eb49f4fabeb9aef P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.535328  7657 tablet_replica.cc:333] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.536130  7657 raft_consensus.cc:2243] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.537104  7657 raft_consensus.cc:2272] T cfedb410dfa649a4a8f9436fffc8994c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.539604  7657 tablet_replica.cc:333] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.540403  7657 raft_consensus.cc:2243] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.541004  7657 raft_consensus.cc:2272] T 76f0c5b50daa4f20ba7f0bb8daedee02 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.544349  7657 tablet_replica.cc:333] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.545198  7657 raft_consensus.cc:2243] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.546136  7657 raft_consensus.cc:2272] T ccf47a28b4474e56ba716e2826c931a3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.549152  7657 tablet_replica.cc:333] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.549832  7657 raft_consensus.cc:2243] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.550661  7657 pending_rounds.cc:70] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: Trying to abort 1 pending ops.
I20260709 13:19:48.550838  7657 pending_rounds.cc:77] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638657374158848 op_type: NO_OP noop_request { }
I20260709 13:19:48.551156  7657 raft_consensus.cc:2889] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.551446  7657 raft_consensus.cc:2272] T 5fff1e4985884cd4a18bde63d6ba1a9c P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.554239  7657 tablet_replica.cc:333] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.554980  7657 raft_consensus.cc:2243] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.555526  7657 raft_consensus.cc:2272] T e49520220f904c3eb4c608cc67bc6533 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.557833  7657 tablet_replica.cc:333] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.558435  7657 raft_consensus.cc:2243] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.559415  7657 raft_consensus.cc:2272] T fa3e8e73054842b9ad74a252019d99eb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.561983  7657 tablet_replica.cc:333] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.562599  7657 raft_consensus.cc:2243] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.563058  7657 raft_consensus.cc:2272] T d4652fa932d845a7b78a8a57edc661fd P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.565229  7657 tablet_replica.cc:333] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.565881  7657 raft_consensus.cc:2243] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.566351  7657 raft_consensus.cc:2272] T a4b78e2e576a46488776de50f005b8cf P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.568997  7657 tablet_replica.cc:333] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.569583  7657 raft_consensus.cc:2243] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.570083  7657 raft_consensus.cc:2272] T 9b55c6dbc8124cd78b036f8b92987ab1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.572721  7657 tablet_replica.cc:333] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.573422  7657 raft_consensus.cc:2243] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.574374  7657 raft_consensus.cc:2272] T 36c09a4594984fd897c2eca96506b208 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.577131  7657 tablet_replica.cc:333] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.577765  7657 raft_consensus.cc:2243] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.578351  7657 raft_consensus.cc:2272] T 72af2df1d2c54a47a37d3f35a497d2c9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.581142  7657 tablet_replica.cc:333] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.582216  7657 raft_consensus.cc:2243] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.583103  7657 raft_consensus.cc:2272] T be1c7cede5d74f08be30f9213dc321fb P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.585597  7657 tablet_replica.cc:333] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.586227  7657 raft_consensus.cc:2243] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.586758  7657 raft_consensus.cc:2272] T 3cf203eb6e6f4850899481145884643a P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.589293  7657 tablet_replica.cc:333] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.589916  7657 raft_consensus.cc:2243] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.590745  7657 raft_consensus.cc:2272] T ae01c3ebc7e44b90bb66c407f8969381 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.593194  7657 tablet_replica.cc:333] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.593847  7657 raft_consensus.cc:2243] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.594946  7657 pending_rounds.cc:70] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: Trying to abort 1 pending ops.
I20260709 13:19:48.595201  7657 pending_rounds.cc:77] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638657126375424 op_type: NO_OP noop_request { }
I20260709 13:19:48.595558  7657 raft_consensus.cc:2889] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.596128  7657 raft_consensus.cc:2272] T cd0e5e0193fb4247b33d41948838a10b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.600351  7657 tablet_replica.cc:333] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.601372  7657 raft_consensus.cc:2243] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.602458  7657 raft_consensus.cc:2272] T 3b250f340b854e90816317511b46db7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.605922  7657 tablet_replica.cc:333] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.606544  7657 raft_consensus.cc:2243] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.607372  7657 raft_consensus.cc:2272] T b817e005d140481c9f6ad4b49f1f0837 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.610502  7657 tablet_replica.cc:333] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.611141  7657 raft_consensus.cc:2243] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.612335  7657 raft_consensus.cc:2272] T 07fd7d385a584bb7b88bfc35cd380c4e P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.614853  7657 tablet_replica.cc:333] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.615537  7657 raft_consensus.cc:2243] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.616050  7657 raft_consensus.cc:2272] T c6fc1bb72e014b8ea956277bc60db8d3 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.619050  7657 tablet_replica.cc:333] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.619861  7657 raft_consensus.cc:2243] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.620373  7657 raft_consensus.cc:2272] T 67ba6acf4b9542a6b6578a341ba5006b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.623481  7657 tablet_replica.cc:333] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.624330  7657 raft_consensus.cc:2243] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.625195  7657 raft_consensus.cc:2272] T 23ea494524264f8186935c55c5301bd1 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.627538  7657 tablet_replica.cc:333] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.628479  7657 raft_consensus.cc:2243] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.629071  7657 raft_consensus.cc:2272] T 7370e1984b694aa99dce543ee5fffbad P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.632989  7657 tablet_replica.cc:333] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.633628  7657 raft_consensus.cc:2243] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.634476  7657 raft_consensus.cc:2272] T 97929a85900c4b398c9e654088b6fb7d P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.636788  7657 tablet_replica.cc:333] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.637809  7657 raft_consensus.cc:2243] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.638382  7657 raft_consensus.cc:2272] T f66d091e1e2a4930ae11b17b39cde541 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.641970  7657 tablet_replica.cc:333] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.642630  7657 raft_consensus.cc:2243] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.643615  7657 pending_rounds.cc:70] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Trying to abort 1 pending ops.
I20260709 13:19:48.643918  7657 pending_rounds.cc:77] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305638656895098880 op_type: NO_OP noop_request { }
I20260709 13:19:48.644272  7657 raft_consensus.cc:2889] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.645152  7657 raft_consensus.cc:2272] T 7ed35d652d57432dad826fd2eb756c7b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.647701  7657 tablet_replica.cc:333] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.648590  7657 raft_consensus.cc:2243] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.649121  7657 raft_consensus.cc:2272] T f1c2736d94d445fc991f12646b12edc2 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.651467  7657 tablet_replica.cc:333] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.652076  7657 raft_consensus.cc:2243] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.653100  7657 raft_consensus.cc:2272] T 1c58974f33d54a1f9028ee4990d3bb18 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.655269  7657 tablet_replica.cc:333] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.655858  7657 raft_consensus.cc:2243] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:48.656721  7657 raft_consensus.cc:2272] T 3520d3184b6a4c918fe43f5109f4914b P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.658984  7657 tablet_replica.cc:333] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.659673  7657 raft_consensus.cc:2243] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.660099  7657 pending_rounds.cc:70] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: Trying to abort 1 pending ops.
I20260709 13:19:48.660269  7657 pending_rounds.cc:77] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638656633397248 op_type: NO_OP noop_request { }
I20260709 13:19:48.660597  7657 raft_consensus.cc:2889] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:48.660919  7657 raft_consensus.cc:2272] T 7765fb52e7dc43a4a4ea5c29cd4ae2b5 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.663950  7657 tablet_replica.cc:333] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.664623  7657 raft_consensus.cc:2243] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.665140  7657 raft_consensus.cc:2272] T b6b6908daa7d470d9390a5833ea96825 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:48.667759  7657 tablet_replica.cc:333] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f: stopping tablet replica
I20260709 13:19:48.668305  7657 raft_consensus.cc:2243] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:48.668766  7657 raft_consensus.cc:2272] T a8e78b7c021a4e4eb0e85bcb9b573bf9 P ccb9eea20c4f4b309b2b16f8edb35d4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.555675  7657 tablet_server.cc:196] TabletServer@127.7.122.68:0 shutdown complete.
I20260709 13:19:49.630752  7657 master.cc:562] Master@127.7.122.126:36181 shutting down...
I20260709 13:19:49.664613  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:49.665305  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:49.665638  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4f56caaa066745888d5a1da07cac52dc: stopping tablet replica
I20260709 13:19:49.693832  7657 master.cc:584] Master@127.7.122.126:36181 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (42534 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:19:49.807227  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:44995
I20260709 13:19:49.808501  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:49.816102 17760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:49.816322 17761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:49.817010  7657 server_base.cc:1061] running on GCE node
W20260709 13:19:49.817031 17763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:49.818590  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:49.818848  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:49.819149  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603189819129 us; error 0 us; skew 500 ppm
I20260709 13:19:49.819782  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:49.822991  7657 webserver.cc:533] Webserver started at http://127.7.122.126:35739/ using document root <none> and password file <none>
I20260709 13:19:49.823553  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:49.823781  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:49.824092  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:49.825316  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "ef45d9720b33454188d13ffa92bea30c"
format_stamp: "Formatted at 2026-07-09 13:19:49 on dist-test-slave-078m"
I20260709 13:19:49.830581  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:49.834980 17768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:49.836436  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:19:49.836836  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "ef45d9720b33454188d13ffa92bea30c"
format_stamp: "Formatted at 2026-07-09 13:19:49 on dist-test-slave-078m"
I20260709 13:19:49.837252  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:49.851115  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:49.852799  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:49.899711  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:44995
I20260709 13:19:49.899842 17819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:44995 every 8 connection(s)
I20260709 13:19:49.904523 17820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:49.917659 17820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c: Bootstrap starting.
I20260709 13:19:49.924000 17820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.929596 17820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c: No bootstrap required, opened a new log
I20260709 13:19:49.932047 17820 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef45d9720b33454188d13ffa92bea30c" member_type: VOTER }
I20260709 13:19:49.932485 17820 raft_consensus.cc:385] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.932667 17820 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef45d9720b33454188d13ffa92bea30c, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.933375 17820 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef45d9720b33454188d13ffa92bea30c" member_type: VOTER }
I20260709 13:19:49.933830 17820 raft_consensus.cc:399] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:49.934093 17820 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:49.934320 17820 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.940594 17820 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef45d9720b33454188d13ffa92bea30c" member_type: VOTER }
I20260709 13:19:49.941437 17820 leader_election.cc:304] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef45d9720b33454188d13ffa92bea30c; no voters: 
I20260709 13:19:49.943305 17820 leader_election.cc:290] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:49.944274 17823 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.946148 17823 raft_consensus.cc:697] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 1 LEADER]: Becoming Leader. State: Replica: ef45d9720b33454188d13ffa92bea30c, State: Running, Role: LEADER
I20260709 13:19:49.946834 17820 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:49.946928 17823 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef45d9720b33454188d13ffa92bea30c" member_type: VOTER }
I20260709 13:19:49.956383 17824 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef45d9720b33454188d13ffa92bea30c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef45d9720b33454188d13ffa92bea30c" member_type: VOTER } }
I20260709 13:19:49.956604 17825 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef45d9720b33454188d13ffa92bea30c. Latest consensus state: current_term: 1 leader_uuid: "ef45d9720b33454188d13ffa92bea30c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef45d9720b33454188d13ffa92bea30c" member_type: VOTER } }
I20260709 13:19:49.957345 17824 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:49.957460 17825 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:49.962644 17831 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:49.969971 17831 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:49.971669  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:49.982046 17831 catalog_manager.cc:1383] Generated new cluster ID: 5d570592d4134ae3a948cd312b3858fd
I20260709 13:19:49.982406 17831 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:50.000551 17831 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:50.002017 17831 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:50.025767 17831 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c: Generated new TSK 0
I20260709 13:19:50.026479 17831 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:50.043056  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:50.053009 17841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.053571 17842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.057824  7657 server_base.cc:1061] running on GCE node
W20260709 13:19:50.057571 17844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.059544  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:50.059772  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:50.059906  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603190059893 us; error 0 us; skew 500 ppm
I20260709 13:19:50.060510  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:50.063731  7657 webserver.cc:533] Webserver started at http://127.7.122.65:33903/ using document root <none> and password file <none>
I20260709 13:19:50.064213  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:50.064365  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:50.064842  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:50.066339  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "4621deea6f41418eb0609ff4506501fc"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:50.071631  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:19:50.076053 17849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.077067  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:50.077445  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "4621deea6f41418eb0609ff4506501fc"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:50.078524  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:50.094842  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:50.096201  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.098001  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:50.100504  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:50.100790  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.101150  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:50.101361  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.165746  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:42121
I20260709 13:19:50.165866 17911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:42121 every 8 connection(s)
I20260709 13:19:50.174062  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:50.184087 17916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.184547 17917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.188433 17919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.189388  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:50.190578  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:50.191195  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:50.191437  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603190191413 us; error 0 us; skew 500 ppm
I20260709 13:19:50.192313  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:50.195060  7657 webserver.cc:533] Webserver started at http://127.7.122.66:34423/ using document root <none> and password file <none>
I20260709 13:19:50.195591  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:50.195809  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:50.196086  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:50.197314  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "822b99165eea41539abbd8a7cbfe9e61"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:50.200973 17912 heartbeater.cc:344] Connected to a master server at 127.7.122.126:44995
I20260709 13:19:50.201444 17912 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:50.202195 17912 heartbeater.cc:507] Master 127.7.122.126:44995 requested a full tablet report, sending...
I20260709 13:19:50.203151  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:50.204588 17785 ts_manager.cc:194] Registered new tserver with Master: 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121)
I20260709 13:19:50.206581 17785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34852
I20260709 13:19:50.207719 17924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.209055  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:50.209411  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "822b99165eea41539abbd8a7cbfe9e61"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:50.209764  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:50.220604  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:50.221980  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.223668  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:50.226540  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:50.226760  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.226953  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:50.227082  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.283087  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:40275
I20260709 13:19:50.283295 17986 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:40275 every 8 connection(s)
I20260709 13:19:50.289381  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:50.299132 17990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:50.304226 17991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.306334  7657 server_base.cc:1061] running on GCE node
W20260709 13:19:50.308990 17993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:50.309523 17987 heartbeater.cc:344] Connected to a master server at 127.7.122.126:44995
I20260709 13:19:50.310267 17987 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:50.310894  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:50.311309  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:50.311518  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603190311497 us; error 0 us; skew 500 ppm
I20260709 13:19:50.311698 17987 heartbeater.cc:507] Master 127.7.122.126:44995 requested a full tablet report, sending...
I20260709 13:19:50.312553  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:50.315078 17785 ts_manager.cc:194] Registered new tserver with Master: 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:50.315758  7657 webserver.cc:533] Webserver started at http://127.7.122.67:39205/ using document root <none> and password file <none>
I20260709 13:19:50.316385  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:50.316630  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:50.316985  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:50.316847 17785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34862
I20260709 13:19:50.318930  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "82a7f5e9239544ec8db562af81af2a40"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:50.325177  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:19:50.331130 17998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.332253  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:50.332789  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "82a7f5e9239544ec8db562af81af2a40"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:50.333209  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:50.368258  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:50.370092  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:50.372673  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:50.375772  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:50.376056  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.376339  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:50.376538  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:50.434654  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:33967
I20260709 13:19:50.434964 18060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:33967 every 8 connection(s)
I20260709 13:19:50.451413 18061 heartbeater.cc:344] Connected to a master server at 127.7.122.126:44995
I20260709 13:19:50.452132 18061 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:50.453054 18061 heartbeater.cc:507] Master 127.7.122.126:44995 requested a full tablet report, sending...
I20260709 13:19:50.455691 17785 ts_manager.cc:194] Registered new tserver with Master: 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:50.455832  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017099611s
I20260709 13:19:50.457784 17785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34872
I20260709 13:19:50.496397 17785 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34876:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:19:50.499903 17785 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:19:50.585978 17951 tablet_service.cc:1511] Processing CreateTablet for tablet 1b677add51d243bbb597fb1dfffc8f5a (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:50.590759 17950 tablet_service.cc:1511] Processing CreateTablet for tablet 1334bc44c6204d11857a97c5d93a2b65 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:50.593864 17949 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9de9aeeefe4683b685f9cc99fe9d6e (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:50.594667 17952 tablet_service.cc:1511] Processing CreateTablet for tablet 2bfb4ab87f4b4346b53eab5807bb85d7 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:50.596726 17951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b677add51d243bbb597fb1dfffc8f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.599133 17948 tablet_service.cc:1511] Processing CreateTablet for tablet 4a84311f7f114de290c0abe9217d400f (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:50.601193 17952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bfb4ab87f4b4346b53eab5807bb85d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.605046 17949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9de9aeeefe4683b685f9cc99fe9d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.609936 17948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a84311f7f114de290c0abe9217d400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.611104 17947 tablet_service.cc:1511] Processing CreateTablet for tablet 0a94aa6be88b4182b138602c398e05ca (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:50.612769 17947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a94aa6be88b4182b138602c398e05ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.617552 17950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1334bc44c6204d11857a97c5d93a2b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.638368 18076 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:50.641829 17876 tablet_service.cc:1511] Processing CreateTablet for tablet 1b677add51d243bbb597fb1dfffc8f5a (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:50.639969 17877 tablet_service.cc:1511] Processing CreateTablet for tablet 2bfb4ab87f4b4346b53eab5807bb85d7 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:50.648398 18023 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9de9aeeefe4683b685f9cc99fe9d6e (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:50.649849 18076 tablet_bootstrap.cc:654] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.650384 18024 tablet_service.cc:1511] Processing CreateTablet for tablet 1334bc44c6204d11857a97c5d93a2b65 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:50.653231 17952 tablet_service.cc:1511] Processing CreateTablet for tablet 232b608558a742e6a6718d264854bb24 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:50.654917 17952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232b608558a742e6a6718d264854bb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.654524 18025 tablet_service.cc:1511] Processing CreateTablet for tablet 1b677add51d243bbb597fb1dfffc8f5a (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:19:50.657153 18026 tablet_service.cc:1511] Processing CreateTablet for tablet 2bfb4ab87f4b4346b53eab5807bb85d7 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:19:50.653128 18022 tablet_service.cc:1511] Processing CreateTablet for tablet 4a84311f7f114de290c0abe9217d400f (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:50.659605 18021 tablet_service.cc:1511] Processing CreateTablet for tablet 0a94aa6be88b4182b138602c398e05ca (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:50.663004 18020 tablet_service.cc:1511] Processing CreateTablet for tablet 232b608558a742e6a6718d264854bb24 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:50.666554 18019 tablet_service.cc:1511] Processing CreateTablet for tablet 1071921c3cd049f0ae16750d19911a53 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:50.666365 17946 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e40305b8342a0b89ca28a545c68f4 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:50.669989 17946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e40305b8342a0b89ca28a545c68f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.671986 18018 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e40305b8342a0b89ca28a545c68f4 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:50.643498 17876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b677add51d243bbb597fb1dfffc8f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.677455 17877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bfb4ab87f4b4346b53eab5807bb85d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.673589 17947 tablet_service.cc:1511] Processing CreateTablet for tablet 1071921c3cd049f0ae16750d19911a53 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:50.650437 18023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9de9aeeefe4683b685f9cc99fe9d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.682896 17947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1071921c3cd049f0ae16750d19911a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.683410 17945 tablet_service.cc:1511] Processing CreateTablet for tablet 29b65968b8964f88bdc73f8865aecb81 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:50.684823 17945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b65968b8964f88bdc73f8865aecb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.685261 18026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bfb4ab87f4b4346b53eab5807bb85d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.689486 18020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232b608558a742e6a6718d264854bb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.694617 18018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e40305b8342a0b89ca28a545c68f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.695334 18024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1334bc44c6204d11857a97c5d93a2b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.701273 18021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a94aa6be88b4182b138602c398e05ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.700505 18017 tablet_service.cc:1511] Processing CreateTablet for tablet 29b65968b8964f88bdc73f8865aecb81 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:50.706184 18017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b65968b8964f88bdc73f8865aecb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.717423 18025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b677add51d243bbb597fb1dfffc8f5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.722059 18019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1071921c3cd049f0ae16750d19911a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.728835 17874 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9de9aeeefe4683b685f9cc99fe9d6e (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:19:50.729557 17873 tablet_service.cc:1511] Processing CreateTablet for tablet 4a84311f7f114de290c0abe9217d400f (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:19:50.730609 17874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9de9aeeefe4683b685f9cc99fe9d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.732108 17872 tablet_service.cc:1511] Processing CreateTablet for tablet 0a94aa6be88b4182b138602c398e05ca (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:19:50.733520 17872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a94aa6be88b4182b138602c398e05ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.731606 17875 tablet_service.cc:1511] Processing CreateTablet for tablet 1334bc44c6204d11857a97c5d93a2b65 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:19:50.737123 17875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1334bc44c6204d11857a97c5d93a2b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.738277 17873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a84311f7f114de290c0abe9217d400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.749372 18078 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:50.749322 18022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a84311f7f114de290c0abe9217d400f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.751878 17871 tablet_service.cc:1511] Processing CreateTablet for tablet 232b608558a742e6a6718d264854bb24 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:19:50.754206 17870 tablet_service.cc:1511] Processing CreateTablet for tablet 1071921c3cd049f0ae16750d19911a53 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:19:50.756659 17869 tablet_service.cc:1511] Processing CreateTablet for tablet ff8e40305b8342a0b89ca28a545c68f4 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:19:50.759577 17868 tablet_service.cc:1511] Processing CreateTablet for tablet 29b65968b8964f88bdc73f8865aecb81 (DEFAULT_TABLE table=test-workload [id=dfd0c3ee96ea48b9bbbc7ecfc899f059]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:19:50.761555 17871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 232b608558a742e6a6718d264854bb24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.768589 17870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1071921c3cd049f0ae16750d19911a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.794864 18078 tablet_bootstrap.cc:654] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.805156 17868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b65968b8964f88bdc73f8865aecb81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.815977 18076 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:50.817323 18076 ts_tablet_manager.cc:1403] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.023s
I20260709 13:19:50.821982 18076 raft_consensus.cc:359] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:50.823061 18076 raft_consensus.cc:385] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.823474 18076 raft_consensus.cc:740] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.825109 17869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff8e40305b8342a0b89ca28a545c68f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:50.850622 18076 consensus_queue.cc:260] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:50.864636 18079 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:50.873991 18079 tablet_bootstrap.cc:654] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.883553 18078 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:50.884135 18078 ts_tablet_manager.cc:1403] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.138s	user 0.006s	sys 0.012s
I20260709 13:19:50.888026 18078 raft_consensus.cc:359] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:50.888900 18078 raft_consensus.cc:385] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.889207 18078 raft_consensus.cc:740] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.894898 18076 ts_tablet_manager.cc:1434] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.077s	user 0.016s	sys 0.014s
I20260709 13:19:50.895771 17987 heartbeater.cc:499] Master 127.7.122.126:44995 was elected leader, sending a full tablet report...
I20260709 13:19:50.896977 18076 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:50.902611 18078 consensus_queue.cc:260] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:50.920917 18076 tablet_bootstrap.cc:654] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.922029 18079 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:50.922737 18079 ts_tablet_manager.cc:1403] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.009s
I20260709 13:19:50.924530 18083 raft_consensus.cc:493] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.925380 18061 heartbeater.cc:499] Master 127.7.122.126:44995 was elected leader, sending a full tablet report...
I20260709 13:19:50.925287 18083 raft_consensus.cc:515] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:50.928253 18079 raft_consensus.cc:359] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:50.929558 18079 raft_consensus.cc:385] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.931370 18079 raft_consensus.cc:740] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.932920 18079 consensus_queue.cc:260] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:50.936434 18083 leader_election.cc:290] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:50.959121 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
W20260709 13:19:50.964362 18000 leader_election.cc:343] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:50.965423 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:50.967226 18078 ts_tablet_manager.cc:1434] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.083s	user 0.008s	sys 0.007s
I20260709 13:19:50.974963 18078 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:50.990993 18078 tablet_bootstrap.cc:654] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.995005 18076 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:50.995746 18076 ts_tablet_manager.cc:1403] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.099s	user 0.032s	sys 0.027s
I20260709 13:19:50.999686 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.000057 18076 raft_consensus.cc:359] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
W20260709 13:19:51.001657 18001 leader_election.cc:343] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.002215 18076 raft_consensus.cc:385] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.002347 18001 leader_election.cc:304] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:51.002666 18076 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.002854 17912 heartbeater.cc:499] Master 127.7.122.126:44995 was elected leader, sending a full tablet report...
I20260709 13:19:51.001784 18088 raft_consensus.cc:493] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.003687 18083 raft_consensus.cc:2749] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.003952 18076 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.004148 18088 raft_consensus.cc:515] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.005003 18078 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.006301 18078 ts_tablet_manager.cc:1403] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.011s
I20260709 13:19:51.006795 18079 ts_tablet_manager.cc:1434] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.083s	user 0.030s	sys 0.035s
I20260709 13:19:51.008345 18079 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.011282 18078 raft_consensus.cc:359] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.012068 18078 raft_consensus.cc:385] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.012812 18078 raft_consensus.cc:740] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.014122 18078 consensus_queue.cc:260] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.017220 18078 ts_tablet_manager.cc:1434] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.010s	user 0.011s	sys 0.000s
I20260709 13:19:51.017954 18076 ts_tablet_manager.cc:1434] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.022s	user 0.013s	sys 0.000s
I20260709 13:19:51.018807 18078 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.024091 18076 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.027741 18079 tablet_bootstrap.cc:654] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.030414 18078 tablet_bootstrap.cc:654] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.032295 18088 leader_election.cc:290] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
W20260709 13:19:51.039076 17988 tablet.cc:2406] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:51.041066 18076 tablet_bootstrap.cc:654] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.048898 18083 raft_consensus.cc:493] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.050170 18083 raft_consensus.cc:515] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.056011 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.064170 18079 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.064893 17887 raft_consensus.cc:2468] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 0.
I20260709 13:19:51.068096 18083 leader_election.cc:290] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.068188 18079 ts_tablet_manager.cc:1403] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.016s
I20260709 13:19:51.069653 18000 leader_election.cc:304] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:51.071419 18083 raft_consensus.cc:2804] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.071393 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.072518 18083 raft_consensus.cc:493] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.072983 18083 raft_consensus.cc:3060] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.073299 18079 raft_consensus.cc:359] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.074096 18079 raft_consensus.cc:385] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.074381 18079 raft_consensus.cc:740] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
W20260709 13:19:51.074401 18001 leader_election.cc:343] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.075554 18079 consensus_queue.cc:260] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.078811 18079 ts_tablet_manager.cc:1434] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:19:51.079873 18079 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.082058 18083 raft_consensus.cc:515] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.087565 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.088195 18079 tablet_bootstrap.cc:654] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.088469 17887 raft_consensus.cc:3060] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.094966 18078 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.096330 18078 ts_tablet_manager.cc:1403] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.010s
I20260709 13:19:51.098922 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:51.100521 18078 raft_consensus.cc:359] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.102721 18078 raft_consensus.cc:385] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.103034 18078 raft_consensus.cc:740] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
W20260709 13:19:51.103518 18001 leader_election.cc:343] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.103783 18078 consensus_queue.cc:260] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.103741 18076 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.104737 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.105057 18076 ts_tablet_manager.cc:1403] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.081s	user 0.021s	sys 0.009s
I20260709 13:19:51.105759 17887 raft_consensus.cc:2468] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 1.
I20260709 13:19:51.106845 18078 ts_tablet_manager.cc:1434] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:19:51.107467 18000 leader_election.cc:304] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:51.108543 18078 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.109548 18084 raft_consensus.cc:2804] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.109894 18076 raft_consensus.cc:359] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.110828 18076 raft_consensus.cc:385] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:51.111651 17852 leader_election.cc:343] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.111521 18076 raft_consensus.cc:740] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.114300 18076 consensus_queue.cc:260] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.114770 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.115175 18083 leader_election.cc:290] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.118460 18076 ts_tablet_manager.cc:1434] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 13:19:51.118498 18078 tablet_bootstrap.cc:654] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.120162 18076 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.131565 18076 tablet_bootstrap.cc:654] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.133381 18079 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.134053 18079 ts_tablet_manager.cc:1403] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.001s
I20260709 13:19:51.135191 18078 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.136360 18078 ts_tablet_manager.cc:1403] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 13:19:51.137293 18084 raft_consensus.cc:697] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:51.139649 18076 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.138846 18084 consensus_queue.cc:237] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.140300 18076 ts_tablet_manager.cc:1403] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.015s
I20260709 13:19:51.140949 18078 raft_consensus.cc:359] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.141877 18078 raft_consensus.cc:385] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.142217 18078 raft_consensus.cc:740] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.143329 18079 raft_consensus.cc:359] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.143217 18078 consensus_queue.cc:260] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.143940 18076 raft_consensus.cc:359] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.145428 18081 raft_consensus.cc:493] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.144516 18079 raft_consensus.cc:385] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.146257 18079 raft_consensus.cc:740] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.145993 18081 raft_consensus.cc:515] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.147503 18079 consensus_queue.cc:260] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.148512 18078 ts_tablet_manager.cc:1434] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:19:51.151407 18078 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.162091 18081 leader_election.cc:290] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.162396 18078 tablet_bootstrap.cc:654] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.163317 18079 ts_tablet_manager.cc:1434] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.004s
I20260709 13:19:51.171594 18076 raft_consensus.cc:385] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.172068 18076 raft_consensus.cc:740] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.174706 18079 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.177109 18078 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.177974 18078 ts_tablet_manager.cc:1403] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 13:19:51.173067 18076 consensus_queue.cc:260] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.183712 18078 raft_consensus.cc:359] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.184648 18079 tablet_bootstrap.cc:654] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.184829 18078 raft_consensus.cc:385] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.185482 18078 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.186795 18078 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.191375 18076 ts_tablet_manager.cc:1434] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:19:51.192613 18078 ts_tablet_manager.cc:1434] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:19:51.194258 18078 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.204160 18078 tablet_bootstrap.cc:654] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.209842 18076 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.211669 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.212229 18079 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.212508 18035 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.213032 18079 ts_tablet_manager.cc:1403] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.011s
I20260709 13:19:51.214090 17927 leader_election.cc:304] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:51.214923 18081 raft_consensus.cc:2804] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.215332 18081 raft_consensus.cc:493] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.215672 18081 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.218231 18079 raft_consensus.cc:359] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.219376 18079 raft_consensus.cc:385] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.219755 18079 raft_consensus.cc:740] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.220938 17852 leader_election.cc:304] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc; no voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:51.220806 18079 consensus_queue.cc:260] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.223760 18087 raft_consensus.cc:2749] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.225080 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.225926 18078 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.226011 17887 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.226656 18078 ts_tablet_manager.cc:1403] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.015s
I20260709 13:19:51.226557 18079 ts_tablet_manager.cc:1434] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:19:51.233843 18079 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.233151 18081 raft_consensus.cc:515] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.234545 18076 tablet_bootstrap.cc:654] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.236923 18081 leader_election.cc:290] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.236006 17785 catalog_manager.cc:5697] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.238291 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.238519 18078 raft_consensus.cc:359] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.239341 18078 raft_consensus.cc:385] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.239652 18078 raft_consensus.cc:740] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.239982 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:51.238945 17887 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.240594 18078 consensus_queue.cc:260] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.244513 18078 ts_tablet_manager.cc:1434] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:19:51.246037 18078 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.240658 18036 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.250900 18079 tablet_bootstrap.cc:654] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.255983 18078 tablet_bootstrap.cc:654] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.260412 17887 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.263213 17926 leader_election.cc:304] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:51.264261 18081 raft_consensus.cc:2804] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.265393 18079 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.267139 18079 ts_tablet_manager.cc:1403] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.007s
I20260709 13:19:51.269593 18078 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.270747 18036 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.271675 18078 ts_tablet_manager.cc:1403] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.008s
I20260709 13:19:51.272786 18079 raft_consensus.cc:359] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.273700 18079 raft_consensus.cc:385] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.274003 18079 raft_consensus.cc:740] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.274381 18108 raft_consensus.cc:493] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.274891 18079 consensus_queue.cc:260] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.275064 18081 raft_consensus.cc:697] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:51.275141 18078 raft_consensus.cc:359] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.276172 18078 raft_consensus.cc:385] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.275164 18108 raft_consensus.cc:515] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.276544 18078 raft_consensus.cc:740] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.277400 18078 consensus_queue.cc:260] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.279302 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.277967 18081 consensus_queue.cc:237] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.288064 18108 leader_election.cc:290] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967), 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121)
I20260709 13:19:51.295113 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.295914 18079 ts_tablet_manager.cc:1434] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.007s
I20260709 13:19:51.280051 18036 raft_consensus.cc:2468] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.297101 18079 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
W20260709 13:19:51.297056 17926 leader_election.cc:343] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.298542 17927 leader_election.cc:304] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc
I20260709 13:19:51.299772 18108 raft_consensus.cc:2804] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.300267 18108 raft_consensus.cc:493] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.300738 18108 raft_consensus.cc:3060] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.302542 18078 ts_tablet_manager.cc:1434] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 13:19:51.303900 18078 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.314893 18078 tablet_bootstrap.cc:654] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.312705 18076 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.315863 18076 ts_tablet_manager.cc:1403] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.012s
I20260709 13:19:51.316589 18079 tablet_bootstrap.cc:654] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.319936 18076 raft_consensus.cc:359] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.321229 18076 raft_consensus.cc:385] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.321663 18076 raft_consensus.cc:740] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.322126 18108 raft_consensus.cc:515] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.323480 18076 consensus_queue.cc:260] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.325093 18081 raft_consensus.cc:493] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.325713 18081 raft_consensus.cc:515] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.326192 18108 leader_election.cc:290] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Requested vote from peers 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967), 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121)
I20260709 13:19:51.326613 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:51.327270 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.328684 18081 leader_election.cc:290] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
W20260709 13:19:51.329727 17926 leader_election.cc:343] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.330518 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.331246 18076 ts_tablet_manager.cc:1434] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:19:51.332638 18079 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
W20260709 13:19:51.333062 17927 leader_election.cc:343] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.333349 18079 ts_tablet_manager.cc:1403] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 13:19:51.327454 18036 raft_consensus.cc:3060] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.334839 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.335830 17887 raft_consensus.cc:2468] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.337888 18079 raft_consensus.cc:359] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.333400 18076 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.339342 17783 catalog_manager.cc:5697] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.338784 18079 raft_consensus.cc:385] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.337949 17926 leader_election.cc:304] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:51.341707 18079 raft_consensus.cc:740] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.342583 18081 raft_consensus.cc:2804] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.343060 18081 raft_consensus.cc:493] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.342648 18079 consensus_queue.cc:260] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.343516 18081 raft_consensus.cc:3060] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.349565 18036 raft_consensus.cc:2468] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.351526 17927 leader_election.cc:304] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc
I20260709 13:19:51.353006 18108 raft_consensus.cc:2804] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.354564 18081 raft_consensus.cc:515] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.355064 18079 ts_tablet_manager.cc:1434] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:19:51.356650 18079 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.357321 18081 leader_election.cc:290] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.359179 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
W20260709 13:19:51.361716 17927 leader_election.cc:343] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.363456 18076 tablet_bootstrap.cc:654] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.364321 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.365460 17887 raft_consensus.cc:3060] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.366561 18079 tablet_bootstrap.cc:654] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.375788 18108 raft_consensus.cc:697] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:51.377586 18108 consensus_queue.cc:237] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.399340 17887 raft_consensus.cc:2468] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.401000 17926 leader_election.cc:304] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:51.402428 18078 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.402472 18108 raft_consensus.cc:2804] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.403393 18078 ts_tablet_manager.cc:1403] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.100s	user 0.034s	sys 0.036s
I20260709 13:19:51.403625 18108 raft_consensus.cc:697] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:51.404187 17783 catalog_manager.cc:5697] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.404618 18108 consensus_queue.cc:237] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.405516 18079 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.406191 18079 ts_tablet_manager.cc:1403] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.015s
I20260709 13:19:51.406908 18078 raft_consensus.cc:359] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.407667 18078 raft_consensus.cc:385] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.407929 18078 raft_consensus.cc:740] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.402873 18076 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.408763 18078 consensus_queue.cc:260] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.409670 18076 ts_tablet_manager.cc:1403] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.077s	user 0.020s	sys 0.009s
I20260709 13:19:51.412361 18078 ts_tablet_manager.cc:1434] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:51.413275 18115 raft_consensus.cc:493] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.413877 18115 raft_consensus.cc:515] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.414608 18076 raft_consensus.cc:359] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.415854 18076 raft_consensus.cc:385] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.416303 18115 leader_election.cc:290] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.416209 18076 raft_consensus.cc:740] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.416731 18078 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.420089 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.419569 18076 consensus_queue.cc:260] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.418522 18079 raft_consensus.cc:359] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.422094 18079 raft_consensus.cc:385] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.422506 18079 raft_consensus.cc:740] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.422676 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1334bc44c6204d11857a97c5d93a2b65" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.424276 17887 raft_consensus.cc:2393] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822b99165eea41539abbd8a7cbfe9e61 in current term 1: Already voted for candidate 82a7f5e9239544ec8db562af81af2a40 in this term.
I20260709 13:19:51.423733 18079 consensus_queue.cc:260] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.426549 17926 leader_election.cc:304] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61; no voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:51.427215 18078 tablet_bootstrap.cc:654] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.427484 18115 raft_consensus.cc:3060] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.428117 18084 raft_consensus.cc:493] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.428805 18084 raft_consensus.cc:515] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.433671 17886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.435021 17886 raft_consensus.cc:2468] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 0.
I20260709 13:19:51.436421 18096 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.437070 18096 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.437990 18076 ts_tablet_manager.cc:1434] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:19:51.440301 18078 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.441010 18079 ts_tablet_manager.cc:1434] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.004s
I20260709 13:19:51.441025 18078 ts_tablet_manager.cc:1403] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 13:19:51.442514 18079 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.443181 18000 leader_election.cc:304] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:51.444152 18081 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.444679 18081 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.447580 18081 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.448944 18076 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.450090 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.450477 18083 raft_consensus.cc:2804] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.451076 18036 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.451095 18083 raft_consensus.cc:493] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.453027 18083 raft_consensus.cc:3060] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.453097 17885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.455742 17927 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:51.456588 18115 raft_consensus.cc:2749] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:51.457340 17926 leader_election.cc:343] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.457656 18115 raft_consensus.cc:2804] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.458300 18115 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.458700 18115 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.459097 18084 leader_election.cc:290] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.461617 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.461858 17886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.462551 18083 raft_consensus.cc:515] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
W20260709 13:19:51.463505 18000 leader_election.cc:343] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.463563 18001 leader_election.cc:343] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.464536 18096 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.466223 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.450011 18078 raft_consensus.cc:359] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.466642 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.469295 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
W20260709 13:19:51.471287 18001 leader_election.cc:343] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.466882 18078 raft_consensus.cc:385] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.472303 18078 raft_consensus.cc:740] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.473825 18078 consensus_queue.cc:260] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.476213 18078 ts_tablet_manager.cc:1434] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:19:51.476513 18076 tablet_bootstrap.cc:654] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.477375 18078 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40: Bootstrap starting.
I20260709 13:19:51.466621 18079 tablet_bootstrap.cc:654] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.466866 17887 raft_consensus.cc:3060] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.482967 18083 leader_election.cc:290] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.484246 18078 tablet_bootstrap.cc:654] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.475778 18115 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.490551 17962 raft_consensus.cc:2393] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82a7f5e9239544ec8db562af81af2a40 in current term 1: Already voted for candidate 822b99165eea41539abbd8a7cbfe9e61 in this term.
I20260709 13:19:51.493403 18001 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:51.494936 18083 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.495100 18081 raft_consensus.cc:493] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.496106 17886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.496568 18081 raft_consensus.cc:515] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
W20260709 13:19:51.497779 17926 leader_election.cc:343] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.501557 17886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a84311f7f114de290c0abe9217d400f" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.502243 17886 raft_consensus.cc:2468] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.502308 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a84311f7f114de290c0abe9217d400f" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.503443 18036 raft_consensus.cc:2468] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 0.
I20260709 13:19:51.503633 17926 leader_election.cc:304] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:51.504262 18083 raft_consensus.cc:2749] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.505280 18108 raft_consensus.cc:2804] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.505859 18108 raft_consensus.cc:493] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.505908 18081 leader_election.cc:290] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.494231 17887 raft_consensus.cc:2468] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 1.
I20260709 13:19:51.508405 18000 leader_election.cc:304] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:51.509358 18083 raft_consensus.cc:2804] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.510308 18083 raft_consensus.cc:697] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:51.506460 18108 raft_consensus.cc:3060] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.513758 18079 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.514367 18079 ts_tablet_manager.cc:1403] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.002s
I20260709 13:19:51.513118 18083 consensus_queue.cc:237] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.519289 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:51.488054 17782 catalog_manager.cc:5697] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.528275 18115 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.528429 18036 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.532603 17927 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc
I20260709 13:19:51.534155 18078 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40: No bootstrap required, opened a new log
I20260709 13:19:51.534444 18115 raft_consensus.cc:2804] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.534895 18078 ts_tablet_manager.cc:1403] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40: Time spent bootstrapping tablet: real 0.058s	user 0.035s	sys 0.015s
I20260709 13:19:51.535207 18115 raft_consensus.cc:697] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:51.536190 18115 consensus_queue.cc:237] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.540539 18078 raft_consensus.cc:359] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.541638 18078 raft_consensus.cc:385] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.541311 18076 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.542004 18078 raft_consensus.cc:740] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.542963 18079 raft_consensus.cc:359] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.543663 18076 ts_tablet_manager.cc:1403] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.007s
I20260709 13:19:51.543749 18079 raft_consensus.cc:385] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.544088 18108 raft_consensus.cc:515] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.544205 18079 raft_consensus.cc:740] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.549177 17887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a84311f7f114de290c0abe9217d400f" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.549331 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a84311f7f114de290c0abe9217d400f" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:51.549923 18036 raft_consensus.cc:3060] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.549887 17887 raft_consensus.cc:3060] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.550582 18076 raft_consensus.cc:359] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.551360 18076 raft_consensus.cc:385] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.551637 18076 raft_consensus.cc:740] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.552418 18076 consensus_queue.cc:260] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.553184 18079 consensus_queue.cc:260] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.554675 18078 consensus_queue.cc:260] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.555351 18079 ts_tablet_manager.cc:1434] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:19:51.548799 18108 leader_election.cc:290] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.557902 18078 ts_tablet_manager.cc:1434] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:19:51.558012 18079 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.556757 17782 catalog_manager.cc:5697] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.562589 18076 ts_tablet_manager.cc:1434] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:19:51.563809 18076 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.569751 17887 raft_consensus.cc:2468] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.571698 18076 tablet_bootstrap.cc:654] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.573498 17785 catalog_manager.cc:5697] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.574700 17926 leader_election.cc:304] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:51.575990 18115 raft_consensus.cc:2804] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.576659 18115 raft_consensus.cc:697] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:51.577085 18083 consensus_queue.cc:1048] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.577653 18115 consensus_queue.cc:237] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.579041 18088 raft_consensus.cc:493] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.579588 18088 raft_consensus.cc:515] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.582084 18088 leader_election.cc:290] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.582085 18036 raft_consensus.cc:2468] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:51.585378 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.593510 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.595404 18036 raft_consensus.cc:2468] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4621deea6f41418eb0609ff4506501fc in term 0.
I20260709 13:19:51.598778 17852 leader_election.cc:304] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
W20260709 13:19:51.600694 17852 leader_election.cc:343] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.603472 18088 raft_consensus.cc:2804] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.604291 18088 raft_consensus.cc:493] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.604758 18088 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.611114 18076 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.612087 18076 ts_tablet_manager.cc:1403] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.006s
I20260709 13:19:51.616217 18079 tablet_bootstrap.cc:654] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.616261 18076 raft_consensus.cc:359] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.617714 18076 raft_consensus.cc:385] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.617983 18076 raft_consensus.cc:740] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.618880 18076 consensus_queue.cc:260] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.613583 17785 catalog_manager.cc:5697] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.621055 18076 ts_tablet_manager.cc:1434] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:19:51.622339 18088 raft_consensus.cc:515] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.627990 18088 leader_election.cc:290] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 election: Requested vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.628710 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:51.629575 18036 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.631146 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
W20260709 13:19:51.634380 17852 leader_election.cc:343] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.636000 18084 raft_consensus.cc:493] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.637216 18076 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.636801 18084 raft_consensus.cc:515] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.644025 17886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65968b8964f88bdc73f8865aecb81" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc" is_pre_election: true
I20260709 13:19:51.645093 17886 raft_consensus.cc:2468] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 0.
I20260709 13:19:51.647256 18000 leader_election.cc:304] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:51.648440 18096 raft_consensus.cc:2804] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.649466 18096 raft_consensus.cc:493] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.650110 18084 leader_election.cc:290] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.650126 18096 raft_consensus.cc:3060] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.651881 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65968b8964f88bdc73f8865aecb81" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.652642 17962 raft_consensus.cc:2468] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 0.
I20260709 13:19:51.654749 18076 tablet_bootstrap.cc:654] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.661033 18084 consensus_queue.cc:1048] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.660674 18036 raft_consensus.cc:2468] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4621deea6f41418eb0609ff4506501fc in term 1.
I20260709 13:19:51.665007 17852 leader_election.cc:304] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:51.666437 18088 raft_consensus.cc:2804] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.668582 18088 raft_consensus.cc:697] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 LEADER]: Becoming Leader. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Running, Role: LEADER
I20260709 13:19:51.669514 18088 consensus_queue.cc:237] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.676090 18096 raft_consensus.cc:515] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.681543 17886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65968b8964f88bdc73f8865aecb81" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:51.682552 17886 raft_consensus.cc:3060] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.684314 17784 catalog_manager.cc:5697] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4621deea6f41418eb0609ff4506501fc (127.7.122.65). New cstate: current_term: 1 leader_uuid: "4621deea6f41418eb0609ff4506501fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.694881 18079 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.697755 18079 ts_tablet_manager.cc:1403] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.140s	user 0.038s	sys 0.007s
I20260709 13:19:51.707062 17886 raft_consensus.cc:2468] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 1.
I20260709 13:19:51.708987 18000 leader_election.cc:304] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:51.708983 18079 raft_consensus.cc:359] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.710611 18079 raft_consensus.cc:385] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.711697 18083 raft_consensus.cc:2804] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.712796 18083 raft_consensus.cc:697] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:51.712550 18079 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.714033 18083 consensus_queue.cc:237] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.714632 18079 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.717680 18079 ts_tablet_manager.cc:1434] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:19:51.720336 18079 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:51.723193 18076 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.725487 18076 ts_tablet_manager.cc:1403] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.003s
I20260709 13:19:51.723877 18096 leader_election.cc:290] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 1 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:51.726862 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29b65968b8964f88bdc73f8865aecb81" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:51.727905 17962 raft_consensus.cc:3060] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.742036 17962 raft_consensus.cc:2468] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 1.
I20260709 13:19:51.742301 18076 raft_consensus.cc:359] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.741775 17784 catalog_manager.cc:5697] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:51.743290 18076 raft_consensus.cc:385] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.743649 18076 raft_consensus.cc:740] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.744704 18076 consensus_queue.cc:260] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.749207 18079 tablet_bootstrap.cc:654] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.752094 18076 ts_tablet_manager.cc:1434] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:19:51.753465 18076 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61: Bootstrap starting.
I20260709 13:19:51.761416 18076 tablet_bootstrap.cc:654] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.766068 18079 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: No bootstrap required, opened a new log
I20260709 13:19:51.766916 18079 ts_tablet_manager.cc:1403] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.006s
I20260709 13:19:51.769366 18076 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61: No bootstrap required, opened a new log
I20260709 13:19:51.770191 18076 ts_tablet_manager.cc:1403] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 13:19:51.770444 18079 raft_consensus.cc:359] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.771540 18079 raft_consensus.cc:385] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.771808 18079 raft_consensus.cc:740] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.772626 18079 consensus_queue.cc:260] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:51.773778 18076 raft_consensus.cc:359] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.774566 18076 raft_consensus.cc:385] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.774842 18076 raft_consensus.cc:740] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.774986 18079 ts_tablet_manager.cc:1434] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:19:51.775701 18076 consensus_queue.cc:260] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.779203 18076 ts_tablet_manager.cc:1434] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:19:51.826074 18115 consensus_queue.cc:1048] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.826289 17886 raft_consensus.cc:3060] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.835556 18108 consensus_queue.cc:1048] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.840338 18108 consensus_queue.cc:1048] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.866964 18108 consensus_queue.cc:1048] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.868300 18088 raft_consensus.cc:493] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.869661 18088 raft_consensus.cc:515] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.872591 18087 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.875146 18088 leader_election.cc:290] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.874989 18087 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.876693 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.877713 18087 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.878712 18035 raft_consensus.cc:3060] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.877791 17962 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4621deea6f41418eb0609ff4506501fc in term 0.
I20260709 13:19:51.882431 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:51.882838 18034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.883249 18033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:51.883603 18034 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4621deea6f41418eb0609ff4506501fc in term 0.
I20260709 13:19:51.884186 18033 raft_consensus.cc:2393] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4621deea6f41418eb0609ff4506501fc in current term 1: Already voted for candidate 822b99165eea41539abbd8a7cbfe9e61 in this term.
I20260709 13:19:51.885278 17852 leader_election.cc:304] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:51.889036 18087 raft_consensus.cc:2804] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.889612 18087 raft_consensus.cc:493] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.890337 18087 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.889182 17852 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc; no voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:51.891418 18088 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.899214 18124 consensus_queue.cc:1048] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.900707 18088 raft_consensus.cc:2749] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.902993 18087 raft_consensus.cc:515] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.907858 18087 leader_election.cc:290] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 election: Requested vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:51.910018 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:51.910698 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "4621deea6f41418eb0609ff4506501fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:51.911646 17961 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.911727 18036 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.920382 17961 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4621deea6f41418eb0609ff4506501fc in term 1.
I20260709 13:19:51.922145 17852 leader_election.cc:304] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:51.923112 18087 raft_consensus.cc:2804] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.923897 18087 raft_consensus.cc:697] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 LEADER]: Becoming Leader. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Running, Role: LEADER
I20260709 13:19:51.924789 18087 consensus_queue.cc:237] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:51.926846 18036 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4621deea6f41418eb0609ff4506501fc in term 1.
I20260709 13:19:51.937705 18124 consensus_queue.cc:1048] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.941354 17782 catalog_manager.cc:5697] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 4621deea6f41418eb0609ff4506501fc (127.7.122.65). New cstate: current_term: 1 leader_uuid: "4621deea6f41418eb0609ff4506501fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.009259  7657 ts_manager.cc:295] Set tserver state for 4621deea6f41418eb0609ff4506501fc to MAINTENANCE_MODE
I20260709 13:19:52.010116  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
I20260709 13:19:52.017721 18115 raft_consensus.cc:493] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.018478 18115 raft_consensus.cc:515] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:52.021591 18115 leader_election.cc:290] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:52.023073 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
W20260709 13:19:52.028270 17926 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 260 similar messages]
W20260709 13:19:52.039927 17926 leader_election.cc:336] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:52.040581 17926 leader_election.cc:304] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61; no voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40
W20260709 13:19:52.042613 17926 consensus_peers.cc:597] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:52.042960 18115 raft_consensus.cc:2749] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:19:52.051126 18000 consensus_peers.cc:597] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:52.063951  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:52.065140  7657 tablet_replica.cc:333] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.066524  7657 raft_consensus.cc:2243] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.067315  7657 raft_consensus.cc:2272] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.070489  7657 tablet_replica.cc:333] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.071494  7657 raft_consensus.cc:2243] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.072489  7657 raft_consensus.cc:2272] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.075362 18115 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.076171  7657 tablet_replica.cc:333] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.076318 17961 raft_consensus.cc:3060] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.077279  7657 raft_consensus.cc:2243] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.078199  7657 raft_consensus.cc:2272] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.080552 18115 raft_consensus.cc:493] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.081465 18115 raft_consensus.cc:515] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:52.084180  7657 tablet_replica.cc:333] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.086341  7657 raft_consensus.cc:2243] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.086278 18115 leader_election.cc:290] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:52.087219  7657 raft_consensus.cc:2272] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.087301 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:52.088124 18035 raft_consensus.cc:2393] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 822b99165eea41539abbd8a7cbfe9e61 in current term 1: Already voted for candidate 4621deea6f41418eb0609ff4506501fc in this term.
I20260709 13:19:52.091009  7657 tablet_replica.cc:333] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.092213  7657 raft_consensus.cc:2243] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.093209  7657 raft_consensus.cc:2272] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:52.095587 17926 leader_election.cc:336] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:52.096525 17926 leader_election.cc:304] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61; no voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:52.098865 18115 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.101931  7657 tablet_replica.cc:333] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.102974  7657 raft_consensus.cc:2243] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.103576  7657 raft_consensus.cc:2272] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.106199  7657 tablet_replica.cc:333] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.108417  7657 raft_consensus.cc:2243] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.108989  7657 raft_consensus.cc:2272] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.113940  7657 tablet_replica.cc:333] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
W20260709 13:19:52.114084 17926 consensus_peers.cc:597] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:52.114848  7657 raft_consensus.cc:2243] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.115581 18115 raft_consensus.cc:2749] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.115963  7657 pending_rounds.cc:70] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Trying to abort 1 pending ops.
I20260709 13:19:52.116469  7657 pending_rounds.cc:77] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638674134351872 op_type: NO_OP noop_request { }
I20260709 13:19:52.106165 18083 consensus_queue.cc:1048] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:52.117436  7657 raft_consensus.cc:2889] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:52.117852  7657 raft_consensus.cc:2272] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.123338  7657 tablet_replica.cc:333] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.124212  7657 raft_consensus.cc:2243] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:52.127424  7657 pending_rounds.cc:70] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Trying to abort 1 pending ops.
I20260709 13:19:52.128023  7657 pending_rounds.cc:77] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638673091448832 op_type: NO_OP noop_request { }
I20260709 13:19:52.128479  7657 raft_consensus.cc:2889] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:52.130131  7657 raft_consensus.cc:2272] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.134488  7657 tablet_replica.cc:333] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: stopping tablet replica
I20260709 13:19:52.136130  7657 raft_consensus.cc:2243] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:52.136709  7657 raft_consensus.cc:2272] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:52.170735 18115 consensus_queue.cc:1048] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.179625  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
I20260709 13:19:52.216969 18083 consensus_queue.cc:1048] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:52.238647 18000 consensus_peers.cc:597] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:52.252614 18000 consensus_peers.cc:597] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:52.278074 17926 consensus_peers.cc:597] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:52.289857 17926 consensus_peers.cc:597] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:52.461941 17926 consensus_peers.cc:597] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:52.983664 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:53.645154 18124 raft_consensus.cc:493] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.645771 18124 raft_consensus.cc:515] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:53.648077 18124 leader_election.cc:290] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:53.649621 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40" is_pre_election: true
I20260709 13:19:53.650439 18036 raft_consensus.cc:2468] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 1.
I20260709 13:19:53.651981 17927 leader_election.cc:304] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:53.653049 18124 raft_consensus.cc:2804] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:19:53.653535 17926 leader_election.cc:336] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111)
I20260709 13:19:53.653446 18124 raft_consensus.cc:493] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.654161 18124 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.661497 18124 raft_consensus.cc:515] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:53.663867 18124 leader_election.cc:290] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:53.665200 18036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:53.666437 18036 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:53.669870 17926 leader_election.cc:336] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111)
I20260709 13:19:53.673236 18036 raft_consensus.cc:2468] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 2.
I20260709 13:19:53.674670 17927 leader_election.cc:304] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc
I20260709 13:19:53.675559 18124 raft_consensus.cc:2804] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:53.676575 18124 raft_consensus.cc:697] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:53.677500 18124 consensus_queue.cc:237] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:53.688597 17782 catalog_manager.cc:5697] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 1 to 2, leader changed from 4621deea6f41418eb0609ff4506501fc (127.7.122.65) to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.805011 18096 raft_consensus.cc:493] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.805490 18096 raft_consensus.cc:515] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:53.807945 18096 leader_election.cc:290] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:53.809197 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61" is_pre_election: true
I20260709 13:19:53.809933 17961 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 1.
I20260709 13:19:53.811954 18001 leader_election.cc:304] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:53.812985 18096 raft_consensus.cc:2804] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:19:53.813313 18000 leader_election.cc:336] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111)
I20260709 13:19:53.813351 18096 raft_consensus.cc:493] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.814177 18096 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:53.821146 18096 raft_consensus.cc:515] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:53.823637 18096 leader_election.cc:290] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:53.825531 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:53.826583 17961 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:19:53.829517 18000 leader_election.cc:336] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111)
I20260709 13:19:53.835165 17961 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:19:53.837065 18001 leader_election.cc:304] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc
I20260709 13:19:53.837903 18096 raft_consensus.cc:2804] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:53.840476 18096 raft_consensus.cc:697] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:53.841429 18096 consensus_queue.cc:237] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:53.853001 17782 catalog_manager.cc:5697] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 1 to 2, leader changed from 4621deea6f41418eb0609ff4506501fc (127.7.122.65) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:53.985046 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:54.191430 18036 raft_consensus.cc:1275] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:54.193356 18124 consensus_queue.cc:1048] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:54.209849 17926 consensus_peers.cc:597] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.391562 17961 raft_consensus.cc:1275] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:54.393278 18096 consensus_queue.cc:1048] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:54.394145 17926 consensus_peers.cc:597] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.411211 18000 consensus_peers.cc:597] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:54.444938 18000 consensus_peers.cc:597] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.585517 17926 consensus_peers.cc:597] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.594736 17926 consensus_peers.cc:597] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.618433 17926 consensus_peers.cc:597] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.708073 18000 consensus_peers.cc:597] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.783136 18000 consensus_peers.cc:597] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.968494 17926 consensus_peers.cc:597] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:54.985956 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:55.987500 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:56.597534 17926 consensus_peers.cc:597] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.806689 18000 consensus_peers.cc:597] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:56.881219 18000 consensus_peers.cc:597] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:56.989024 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:19:56.993268 17926 consensus_peers.cc:597] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:57.042284 17926 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111) [suppressed 99 similar messages]
W20260709 13:19:57.044706 17926 consensus_peers.cc:597] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:57.062372 18000 consensus_peers.cc:597] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:57.122959 18000 consensus_peers.cc:597] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:57.180369 17926 consensus_peers.cc:597] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:57.217216  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:57.228454 18175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:57.228454 18176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:57.231530 18178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:57.231843  7657 server_base.cc:1061] running on GCE node
I20260709 13:19:57.233198  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:57.233490  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:57.233721  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603197233702 us; error 0 us; skew 500 ppm
I20260709 13:19:57.234359  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:57.238740  7657 webserver.cc:533] Webserver started at http://127.7.122.65:33903/ using document root <none> and password file <none>
I20260709 13:19:57.239498  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:57.240113  7657 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:57.246838  7657 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:19:57.252753 18183 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:57.254155  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 13:19:57.254769  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "4621deea6f41418eb0609ff4506501fc"
format_stamp: "Formatted at 2026-07-09 13:19:50 on dist-test-slave-078m"
I20260709 13:19:57.255347  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:57.277263  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:57.279037  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:57.280969  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:57.285439 18190 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:19:57.321954 17926 consensus_peers.cc:597] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:57.349848  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:19:57.350299  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.066s	user 0.000s	sys 0.004s
I20260709 13:19:57.350566  7657 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:19:57.357298 18190 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.373682 18190 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:19:57.374557 18190 tablet_bootstrap.cc:492] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.375191 18190 ts_tablet_manager.cc:1403] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:19:57.378055 18190 raft_consensus.cc:359] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.379258 18190 raft_consensus.cc:740] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.380285 18190 consensus_queue.cc:260] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.383291 18190 ts_tablet_manager.cc:1434] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:19:57.384078 18190 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.397512 18190 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.398320 18190 tablet_bootstrap.cc:492] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.398940 18190 ts_tablet_manager.cc:1403] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:19:57.401233 18190 raft_consensus.cc:359] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.401821 18190 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.402498 18190 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.403242  7657 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:19:57.403715  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.053s	user 0.047s	sys 0.004s
I20260709 13:19:57.404608 18190 ts_tablet_manager.cc:1434] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:57.405684 18190 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.421717 18190 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.422802 18190 tablet_bootstrap.cc:492] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.423507 18190 ts_tablet_manager.cc:1403] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 13:19:57.426697 18190 raft_consensus.cc:359] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.427348 18190 raft_consensus.cc:740] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.428043 18190 consensus_queue.cc:260] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.430132 18190 ts_tablet_manager.cc:1434] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:19:57.431479 18190 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.451179 18190 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.452284 18190 tablet_bootstrap.cc:492] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.453910 18190 ts_tablet_manager.cc:1403] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:19:57.458622 18190 raft_consensus.cc:359] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:57.459456 18190 raft_consensus.cc:740] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.460280 18190 consensus_queue.cc:260] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:19:57.462178 18190 ts_tablet_manager.cc:1434] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:19:57.462911 18190 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.475018 18190 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.475927 18190 tablet_bootstrap.cc:492] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.476745 18190 ts_tablet_manager.cc:1403] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:19:57.478068  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:42121
I20260709 13:19:57.478207 18252 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:42121 every 8 connection(s)
I20260709 13:19:57.479292 18190 raft_consensus.cc:359] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.480230 18190 raft_consensus.cc:740] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.480938 18190 consensus_queue.cc:260] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.482455 18190 ts_tablet_manager.cc:1434] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:19:57.483188 18190 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.485447  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.505184 18190 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.506659 18190 tablet_bootstrap.cc:492] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.508127 18190 ts_tablet_manager.cc:1403] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 13:19:57.512646 18190 raft_consensus.cc:359] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.513384 18190 raft_consensus.cc:740] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.514266 18190 consensus_queue.cc:260] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.516067 18190 ts_tablet_manager.cc:1434] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:57.516906 18253 heartbeater.cc:344] Connected to a master server at 127.7.122.126:44995
I20260709 13:19:57.517067 18190 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.517509 18253 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:57.518786 18253 heartbeater.cc:507] Master 127.7.122.126:44995 requested a full tablet report, sending...
I20260709 13:19:57.526780 17782 ts_manager.cc:194] Re-registered known tserver with Master: 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121)
I20260709 13:19:57.529197 17961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
mode: GRACEFUL
new_leader_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:19:57.530001 17961 raft_consensus.cc:606] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Received request to transfer leadership to TS 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:57.533192 18190 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:19:57.533295 17961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
mode: GRACEFUL
new_leader_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:19:57.534124 17961 raft_consensus.cc:606] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Received request to transfer leadership to TS 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:57.534451 18190 tablet_bootstrap.cc:492] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.535053 18173 raft_consensus.cc:993] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: : Instructing follower 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:19:57.535486 18190 ts_tablet_manager.cc:1403] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:19:57.535601 18173 raft_consensus.cc:1081] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Signalling peer 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:19:57.535903  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:57.537061  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:57.537899  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:57.538043 18035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:40168
I20260709 13:19:57.538739 18035 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.538522 18190 raft_consensus.cc:359] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.539211 18035 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.539346 17782 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55964
I20260709 13:19:57.539408 18190 raft_consensus.cc:740] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.540666 18190 consensus_queue.cc:260] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.543380 18190 ts_tablet_manager.cc:1434] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:57.543594 18253 heartbeater.cc:499] Master 127.7.122.126:44995 was elected leader, sending a full tablet report...
I20260709 13:19:57.544456 18190 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.550460 18035 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.555613 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:57.556424 17961 raft_consensus.cc:3055] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.556960 17961 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:57.558799 17961 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.560724 17961 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.572839 18226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:57.573974 18226 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.580157 18190 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.580102 17961 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:19:57.581034 18035 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:57.581550 18190 tablet_bootstrap.cc:492] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.582541 18190 ts_tablet_manager.cc:1403] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.004s
I20260709 13:19:57.584525 18001 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:57.586143 18169 raft_consensus.cc:2804] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.585763 18190 raft_consensus.cc:359] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.586661 18190 raft_consensus.cc:740] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.587585 18190 consensus_queue.cc:260] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.590287 18190 ts_tablet_manager.cc:1434] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:57.591691 18190 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.591907 18226 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:19:57.593578 18169 raft_consensus.cc:697] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:57.597702 18169 consensus_queue.cc:237] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.623901 18174 raft_consensus.cc:993] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: : Instructing follower 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:19:57.625480 18174 raft_consensus.cc:1081] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Signalling peer 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:19:57.628768 18035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:40168
I20260709 13:19:57.629448 18035 raft_consensus.cc:493] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:57.630079 18190 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.630044 18035 raft_consensus.cc:3060] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.631650 18190 tablet_bootstrap.cc:492] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.632462 18190 ts_tablet_manager.cc:1403] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.041s	user 0.028s	sys 0.004s
I20260709 13:19:57.647780 17782 catalog_manager.cc:5697] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 1 to 2, leader changed from 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.650287 18190 raft_consensus.cc:359] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.651182 18190 raft_consensus.cc:740] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.652073 18190 consensus_queue.cc:260] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.646333 18035 raft_consensus.cc:515] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.654800 18190 ts_tablet_manager.cc:1434] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:19:57.655834 18190 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Bootstrap starting.
I20260709 13:19:57.656432 18035 leader_election.cc:290] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:57.656479 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:57.658356 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9de9aeeefe4683b685f9cc99fe9d6e" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:57.659587 17961 raft_consensus.cc:3055] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:57.660050 17961 raft_consensus.cc:740] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
W20260709 13:19:57.658383 18000 leader_election.cc:343] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:57.662364 17961 consensus_queue.cc:260] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.665748 17961 raft_consensus.cc:3060] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.681298 18190 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:19:57.682416 18190 tablet_bootstrap.cc:492] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Bootstrap complete.
I20260709 13:19:57.683139 18190 ts_tablet_manager.cc:1403] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 13:19:57.683099 17961 raft_consensus.cc:2468] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:19:57.684769 18001 leader_election.cc:304] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 822b99165eea41539abbd8a7cbfe9e61, 82a7f5e9239544ec8db562af81af2a40; no voters: 4621deea6f41418eb0609ff4506501fc
I20260709 13:19:57.685851 18169 raft_consensus.cc:2804] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:57.686407 18169 raft_consensus.cc:697] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:57.687971 18169 consensus_queue.cc:237] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.689105 18190 raft_consensus.cc:359] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.690305 18190 raft_consensus.cc:740] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4621deea6f41418eb0609ff4506501fc, State: Initialized, Role: FOLLOWER
I20260709 13:19:57.691049 18190 consensus_queue.cc:260] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:57.696439 18190 ts_tablet_manager.cc:1434] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:19:57.701102 17782 catalog_manager.cc:5697] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 1 to 2, leader changed from 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.873972 18224 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:57.879870 18224 pending_rounds.cc:85] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Aborting all ops after (but not including) 0
I20260709 13:19:57.880102 18224 pending_rounds.cc:107] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:19:57.880301 18224 raft_consensus.cc:2889] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:57.990269 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:58.060173 18224 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.067543 18224 pending_rounds.cc:85] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Aborting all ops after (but not including) 0
I20260709 13:19:58.067788 18224 pending_rounds.cc:107] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:19:58.068069 18224 raft_consensus.cc:2889] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:58.090886 17961 raft_consensus.cc:1275] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.092525 18169 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.104471 18224 raft_consensus.cc:1275] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.107878 18265 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:58.168390 18224 raft_consensus.cc:3060] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:58.175622 18224 raft_consensus.cc:1275] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.177271 18169 consensus_queue.cc:1048] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.188233 17961 raft_consensus.cc:1275] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:58.190956 18169 consensus_queue.cc:1048] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:58.549162  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:58.568477 18035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "232b608558a742e6a6718d264854bb24"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
mode: GRACEFUL
new_leader_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:19:58.569214 18035 raft_consensus.cc:606] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Received request to transfer leadership to TS 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:58.572571 18035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
mode: GRACEFUL
new_leader_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:19:58.573248 18035 raft_consensus.cc:606] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Received request to transfer leadership to TS 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:19:58.575505  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:58.576125  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:58.577365  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:19:58.991326 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:19:59.020037 18169 raft_consensus.cc:993] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: : Instructing follower 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:19:59.020687 18287 raft_consensus.cc:1081] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Signalling peer 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:19:59.022691 17961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "232b608558a742e6a6718d264854bb24"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:36340
I20260709 13:19:59.023227 17961 raft_consensus.cc:493] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:59.023830 17961 raft_consensus.cc:3060] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:59.034127 17961 raft_consensus.cc:515] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.037607 17961 leader_election.cc:290] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:59.038168 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:59.038910 18224 raft_consensus.cc:3060] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:59.039805 18287 raft_consensus.cc:993] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: : Instructing follower 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:19:59.040272 18265 raft_consensus.cc:1081] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Signalling peer 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:19:59.039359 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "232b608558a742e6a6718d264854bb24" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:59.041039 18035 raft_consensus.cc:3055] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:59.041579 18035 raft_consensus.cc:740] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:59.042609 18035 consensus_queue.cc:260] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.043191 17961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:36340
I20260709 13:19:59.044608 17961 raft_consensus.cc:493] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:59.045684 18035 raft_consensus.cc:3060] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:59.045749 17961 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:59.048223 18224 raft_consensus.cc:2468] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 2.
I20260709 13:19:59.051676 17926 leader_election.cc:304] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:59.053190 18289 raft_consensus.cc:2804] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:59.056278 18289 raft_consensus.cc:697] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:59.056975 18035 raft_consensus.cc:2468] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 2.
I20260709 13:19:59.057366 17961 raft_consensus.cc:515] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.058998 18289 consensus_queue.cc:237] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.061329 17961 leader_election.cc:290] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 3 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:19:59.062361 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:59.062618 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff8e40305b8342a0b89ca28a545c68f4" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:19:59.063180 18224 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:59.063251 18035 raft_consensus.cc:3055] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:19:59.064332 18035 raft_consensus.cc:740] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:59.065639 18035 consensus_queue.cc:260] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.068390 18035 raft_consensus.cc:3060] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:19:59.070433 17783 catalog_manager.cc:5697] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 1 to 2, leader changed from 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67) to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.075441 18224 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 3.
I20260709 13:19:59.077384 17926 leader_election.cc:304] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:19:59.078718 18289 raft_consensus.cc:2804] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:19:59.079595 18289 raft_consensus.cc:697] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:59.081597 18035 raft_consensus.cc:2468] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 3.
I20260709 13:19:59.081216 18289 consensus_queue.cc:237] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.104256 17783 catalog_manager.cc:5697] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 2 to 3, leader changed from 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67) to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:59.455679 18035 raft_consensus.cc:1275] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.457442 18289 consensus_queue.cc:1048] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:59.470587 18224 raft_consensus.cc:1275] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:59.472249 18301 consensus_queue.cc:1048] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:59.526201 18224 raft_consensus.cc:1275] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:59.527745 18301 consensus_queue.cc:1048] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:19:59.541563 18035 raft_consensus.cc:1275] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:19:59.544417 18307 consensus_queue.cc:1048] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:19:59.584285  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:59.593408 17961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
mode: GRACEFUL
new_leader_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:19:59.594038 17961 raft_consensus.cc:606] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Received request to transfer leadership to TS 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:59.597621 17961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
mode: GRACEFUL
new_leader_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:19:59.598301 17961 raft_consensus.cc:606] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Received request to transfer leadership to TS 82a7f5e9239544ec8db562af81af2a40
I20260709 13:19:59.599763  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:19:59.600389  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:59.601052  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:59.870556 18292 raft_consensus.cc:993] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: : Instructing follower 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:19:59.871315 18292 raft_consensus.cc:1081] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Signalling peer 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:19:59.873272 18035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:40168
I20260709 13:19:59.873800 18035 raft_consensus.cc:493] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:59.874096 18035 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:59.880062 18035 raft_consensus.cc:515] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.881901 18035 leader_election.cc:290] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:19:59.883044 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:19:59.883041 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:19:59.883971 17961 raft_consensus.cc:3055] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:59.884018 18224 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:59.884272 17961 raft_consensus.cc:740] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:19:59.885278 17961 consensus_queue.cc:260] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.886425 17961 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:59.890383 18224 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:19:59.891990 18000 leader_election.cc:304] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:19:59.892396 17961 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:19:59.892889 18265 raft_consensus.cc:2804] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:59.894119 18265 raft_consensus.cc:697] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:19:59.894979 18265 consensus_queue.cc:237] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:19:59.903519 17782 catalog_manager.cc:5697] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 1 to 2, leader changed from 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:59.992590 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:00.028534 18307 raft_consensus.cc:993] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: : Instructing follower 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:20:00.029151 18307 raft_consensus.cc:1081] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Signalling peer 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:20:00.031642 18035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:40168
I20260709 13:20:00.032281 18035 raft_consensus.cc:493] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.032665 18035 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.041157 18035 raft_consensus.cc:515] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.044486 18035 leader_election.cc:290] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 3 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:20:00.045519 17961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:20:00.045548 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1071921c3cd049f0ae16750d19911a53" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:20:00.046327 17961 raft_consensus.cc:3055] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:00.046689 17961 raft_consensus.cc:740] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:20:00.046458 18224 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.047514 17961 consensus_queue.cc:260] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.048767 17961 raft_consensus.cc:3060] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.055137 18224 raft_consensus.cc:2468] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 3.
I20260709 13:20:00.056936 17961 raft_consensus.cc:2468] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 3.
I20260709 13:20:00.057143 18000 leader_election.cc:304] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:20:00.058553 18265 raft_consensus.cc:2804] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:00.060266 18265 raft_consensus.cc:697] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 3 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:20:00.061280 18265 consensus_queue.cc:237] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.069710 17782 catalog_manager.cc:5697] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 2 to 3, leader changed from 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 3 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:00.442296 17962 raft_consensus.cc:1275] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:00.443961 18265 consensus_queue.cc:1048] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:00.457373 18224 raft_consensus.cc:1275] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:00.460107 18314 consensus_queue.cc:1048] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:00.508409 18224 raft_consensus.cc:1275] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:00.510587 18314 consensus_queue.cc:1048] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:00.514320 17962 raft_consensus.cc:1275] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:00.515650 18314 consensus_queue.cc:1048] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:00.607774  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:00.618145 18035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
mode: GRACEFUL
new_leader_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:20:00.618898 18035 raft_consensus.cc:606] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Received request to transfer leadership to TS 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:20:00.621721 18035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
mode: GRACEFUL
new_leader_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:38444
I20260709 13:20:00.622488 18035 raft_consensus.cc:606] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Received request to transfer leadership to TS 822b99165eea41539abbd8a7cbfe9e61
I20260709 13:20:00.624207  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:00.624815  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:00.625496  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:00.668147 18314 raft_consensus.cc:993] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: : Instructing follower 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:20:00.669160 18265 raft_consensus.cc:1081] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Signalling peer 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:20:00.670970 17962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:36340
I20260709 13:20:00.671439 17962 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.671689 17962 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.677419 17962 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.679164 17962 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 3 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:20:00.680119 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:20:00.680333 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:20:00.680824 18224 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.680855 18035 raft_consensus.cc:3055] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:00.681526 18035 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:20:00.682435 18035 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.683817 18035 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.689527 18224 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 3.
I20260709 13:20:00.691061 17926 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:20:00.691886 18307 raft_consensus.cc:2804] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:00.692260 18035 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 3.
I20260709 13:20:00.692436 18307 raft_consensus.cc:697] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:20:00.693933 18307 consensus_queue.cc:237] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.703665 17784 catalog_manager.cc:5697] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 2 to 3, leader changed from 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67) to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:00.977977 18314 raft_consensus.cc:993] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: : Instructing follower 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:20:00.978736 18265 raft_consensus.cc:1081] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Signalling peer 822b99165eea41539abbd8a7cbfe9e61 to start an election
I20260709 13:20:00.980599 17962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
 from {username='slave'} at 127.0.0.1:36340
I20260709 13:20:00.981220 17962 raft_consensus.cc:493] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:00.981570 17962 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.988391 17962 raft_consensus.cc:515] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:00.990106 17962 leader_election.cc:290] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 3 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67:33967)
I20260709 13:20:00.991148 18224 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:20:00.991159 18035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b677add51d243bbb597fb1dfffc8f5a" candidate_uuid: "822b99165eea41539abbd8a7cbfe9e61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
I20260709 13:20:00.991941 18224 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.992138 18035 raft_consensus.cc:3055] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:00.992508 18035 raft_consensus.cc:740] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:20:00.993307 18035 consensus_queue.cc:260] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
W20260709 13:20:00.993721 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:00.994370 18035 raft_consensus.cc:3060] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.997749 18224 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 3.
I20260709 13:20:00.999274 17926 leader_election.cc:304] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 822b99165eea41539abbd8a7cbfe9e61; no voters: 
I20260709 13:20:01.000067 18307 raft_consensus.cc:2804] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.000625 18307 raft_consensus.cc:697] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Becoming Leader. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:20:01.000671 18035 raft_consensus.cc:2468] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 822b99165eea41539abbd8a7cbfe9e61 in term 3.
I20260709 13:20:01.002490 18307 consensus_queue.cc:237] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:01.013006 17784 catalog_manager.cc:5697] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 reported cstate change: term changed from 2 to 3, leader changed from 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67) to 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "822b99165eea41539abbd8a7cbfe9e61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.099502 18226 raft_consensus.cc:1275] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:01.101272 18307 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:01.114123 18035 raft_consensus.cc:1275] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:01.116122 18307 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:01.606541 18035 raft_consensus.cc:1275] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:01.608116 18307 consensus_queue.cc:1048] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:01.627022 18226 raft_consensus.cc:1275] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Refusing update from remote peer 822b99165eea41539abbd8a7cbfe9e61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:01.628667 18307 consensus_queue.cc:1048] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:01.632432  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:01.646551 17962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
mode: GRACEFUL
new_leader_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:20:01.648114 17962 raft_consensus.cc:606] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Received request to transfer leadership to TS 82a7f5e9239544ec8db562af81af2a40
I20260709 13:20:01.654860 17962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7"
dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
mode: GRACEFUL
new_leader_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:51896
I20260709 13:20:01.655257 18335 raft_consensus.cc:993] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: : Instructing follower 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:20:01.655582 17962 raft_consensus.cc:606] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Received request to transfer leadership to TS 82a7f5e9239544ec8db562af81af2a40
I20260709 13:20:01.655807 18335 raft_consensus.cc:1081] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Signalling peer 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:20:01.657244  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:01.658891  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:01.660214  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:01.660673 18035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:40168
I20260709 13:20:01.662159 18035 raft_consensus.cc:493] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:01.662616 18035 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.670770 18035 raft_consensus.cc:515] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:01.672848 18035 leader_election.cc:290] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 4 election: Requested vote from peers 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121), 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275)
I20260709 13:20:01.674507 18226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:20:01.674607 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a94aa6be88b4182b138602c398e05ca" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:20:01.675542 18226 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.676138 17962 raft_consensus.cc:3055] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:01.676719 17962 raft_consensus.cc:740] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:20:01.677667 17962 consensus_queue.cc:260] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:01.678686 17962 raft_consensus.cc:3060] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:01.681629 18226 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 4.
I20260709 13:20:01.683292 18000 leader_election.cc:304] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:20:01.684504 18265 raft_consensus.cc:2804] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:01.685046 18265 raft_consensus.cc:697] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 4 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:20:01.686062 17962 raft_consensus.cc:2468] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 4.
I20260709 13:20:01.686393 18265 consensus_queue.cc:237] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } }
I20260709 13:20:01.698123 17783 catalog_manager.cc:5697] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 3 to 4, leader changed from 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 4 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.749039 18335 raft_consensus.cc:993] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: : Instructing follower 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:20:01.749963 18307 raft_consensus.cc:1081] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Signalling peer 82a7f5e9239544ec8db562af81af2a40 to start an election
I20260709 13:20:01.752132 18035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7"
dest_uuid: "82a7f5e9239544ec8db562af81af2a40"
 from {username='slave'} at 127.0.0.1:40168
I20260709 13:20:01.752663 18035 raft_consensus.cc:493] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:01.753006 18035 raft_consensus.cc:3060] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.760020 18035 raft_consensus.cc:515] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:20:01.762609 18035 leader_election.cc:290] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Requested vote from peers 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275), 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121)
I20260709 13:20:01.763770 18226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4621deea6f41418eb0609ff4506501fc"
I20260709 13:20:01.763828 17962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfb4ab87f4b4346b53eab5807bb85d7" candidate_uuid: "82a7f5e9239544ec8db562af81af2a40" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "822b99165eea41539abbd8a7cbfe9e61"
I20260709 13:20:01.764745 17962 raft_consensus.cc:3055] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:01.764429 18226 raft_consensus.cc:3060] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.765066 17962 raft_consensus.cc:740] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 822b99165eea41539abbd8a7cbfe9e61, State: Running, Role: LEADER
I20260709 13:20:01.766220 17962 consensus_queue.cc:260] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:20:01.767598 17962 raft_consensus.cc:3060] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.773317 18226 raft_consensus.cc:2468] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:20:01.774837 18000 leader_election.cc:304] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4621deea6f41418eb0609ff4506501fc, 82a7f5e9239544ec8db562af81af2a40; no voters: 
I20260709 13:20:01.776232 18265 raft_consensus.cc:2804] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.776235 17962 raft_consensus.cc:2468] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82a7f5e9239544ec8db562af81af2a40 in term 2.
I20260709 13:20:01.778254 18265 raft_consensus.cc:697] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Becoming Leader. State: Replica: 82a7f5e9239544ec8db562af81af2a40, State: Running, Role: LEADER
I20260709 13:20:01.779340 18265 consensus_queue.cc:237] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } }
I20260709 13:20:01.790421 17783 catalog_manager.cc:5697] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 reported cstate change: term changed from 1 to 2, leader changed from 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66) to 82a7f5e9239544ec8db562af81af2a40 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "82a7f5e9239544ec8db562af81af2a40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82a7f5e9239544ec8db562af81af2a40" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 33967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:01.995218 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:02.088153 18224 raft_consensus.cc:1275] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 4 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:02.090018 18265 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:02.100893 17962 raft_consensus.cc:1275] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 4 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:02.102445 18344 consensus_queue.cc:1048] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:02.213382 17962 raft_consensus.cc:1275] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.215471 18344 consensus_queue.cc:1048] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "822b99165eea41539abbd8a7cbfe9e61" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 40275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.227217 18224 raft_consensus.cc:1275] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Refusing update from remote peer 82a7f5e9239544ec8db562af81af2a40: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.228967 18314 consensus_queue.cc:1048] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4621deea6f41418eb0609ff4506501fc" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 42121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.671919  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:02.709343  7657 tablet_server.cc:179] TabletServer@127.7.122.65:42121 shutting down...
W20260709 13:20:02.716324 18000 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 13:20:02.724223 18000 consensus_peers.cc:597] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.750347  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:02.751721  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.753152  7657 raft_consensus.cc:2243] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.753688  7657 raft_consensus.cc:2272] T 232b608558a742e6a6718d264854bb24 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.756259  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.757432  7657 raft_consensus.cc:2243] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.758255  7657 raft_consensus.cc:2272] T 29b65968b8964f88bdc73f8865aecb81 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.760618  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.761410  7657 raft_consensus.cc:2243] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:02.761406 18000 consensus_peers.cc:597] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.762284  7657 raft_consensus.cc:2272] T 4a84311f7f114de290c0abe9217d400f P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.765552  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.766203  7657 raft_consensus.cc:2243] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.767031  7657 raft_consensus.cc:2272] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.770730  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.771489  7657 raft_consensus.cc:2243] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.772073  7657 raft_consensus.cc:2272] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 4621deea6f41418eb0609ff4506501fc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:02.773906 18000 consensus_peers.cc:597] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.775243  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.776171  7657 raft_consensus.cc:2243] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.776600  7657 raft_consensus.cc:2272] T 1334bc44c6204d11857a97c5d93a2b65 P 4621deea6f41418eb0609ff4506501fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.779434  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.780737  7657 raft_consensus.cc:2243] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.781559  7657 raft_consensus.cc:2272] T 0a94aa6be88b4182b138602c398e05ca P 4621deea6f41418eb0609ff4506501fc [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.784823  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.785775  7657 raft_consensus.cc:2243] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:02.786238 17926 consensus_peers.cc:597] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.786441  7657 raft_consensus.cc:2272] T 1b677add51d243bbb597fb1dfffc8f5a P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.790022  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.790642  7657 raft_consensus.cc:2243] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.791181  7657 raft_consensus.cc:2272] T 1071921c3cd049f0ae16750d19911a53 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.794159  7657 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:02.795248  7657 raft_consensus.cc:2243] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.796125  7657 raft_consensus.cc:2272] T ff8e40305b8342a0b89ca28a545c68f4 P 4621deea6f41418eb0609ff4506501fc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.827456  7657 tablet_server.cc:196] TabletServer@127.7.122.65:42121 shutdown complete.
I20260709 13:20:02.854192  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
W20260709 13:20:02.897163 17926 consensus_peers.cc:597] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.902704  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:02.903803  7657 tablet_replica.cc:333] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.904736  7657 raft_consensus.cc:2243] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.905764  7657 raft_consensus.cc:2272] T 232b608558a742e6a6718d264854bb24 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.908259  7657 tablet_replica.cc:333] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.909049  7657 raft_consensus.cc:2243] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.909567  7657 raft_consensus.cc:2272] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.912496  7657 tablet_replica.cc:333] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.913281  7657 raft_consensus.cc:2243] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.913815  7657 raft_consensus.cc:2272] T 1334bc44c6204d11857a97c5d93a2b65 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.916512  7657 tablet_replica.cc:333] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.917166  7657 raft_consensus.cc:2243] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.917639  7657 raft_consensus.cc:2272] T 0a94aa6be88b4182b138602c398e05ca P 822b99165eea41539abbd8a7cbfe9e61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.922116  7657 tablet_replica.cc:333] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.923418  7657 raft_consensus.cc:2243] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.924503  7657 raft_consensus.cc:2272] T ff8e40305b8342a0b89ca28a545c68f4 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.927524  7657 tablet_replica.cc:333] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.928943  7657 raft_consensus.cc:2243] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.929919  7657 raft_consensus.cc:2272] T 1071921c3cd049f0ae16750d19911a53 P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.932188  7657 tablet_replica.cc:333] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.932736  7657 raft_consensus.cc:2243] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.933874  7657 raft_consensus.cc:2272] T 1b677add51d243bbb597fb1dfffc8f5a P 822b99165eea41539abbd8a7cbfe9e61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.936332  7657 tablet_replica.cc:333] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.937232  7657 raft_consensus.cc:2243] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.937791  7657 raft_consensus.cc:2272] T 29b65968b8964f88bdc73f8865aecb81 P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.941051  7657 tablet_replica.cc:333] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.941601  7657 raft_consensus.cc:2243] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:02.942421  7657 raft_consensus.cc:2272] T 4a84311f7f114de290c0abe9217d400f P 822b99165eea41539abbd8a7cbfe9e61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.945614  7657 tablet_replica.cc:333] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61: stopping tablet replica
I20260709 13:20:02.946244  7657 raft_consensus.cc:2243] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:02.946764  7657 raft_consensus.cc:2272] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 822b99165eea41539abbd8a7cbfe9e61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:02.989603  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
W20260709 13:20:02.994238 18001 consensus_peers.cc:597] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Couldn't send request to peer 822b99165eea41539abbd8a7cbfe9e61. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:40275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.996351 17833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:03.018311  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
W20260709 13:20:03.027995 18001 consensus_peers.cc:597] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 822b99165eea41539abbd8a7cbfe9e61 (127.7.122.66:40275): Couldn't send request to peer 822b99165eea41539abbd8a7cbfe9e61. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:40275: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:03.053148 18000 consensus_peers.cc:597] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.063104  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:03.064152  7657 tablet_replica.cc:333] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.064999  7657 raft_consensus.cc:2243] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.065442  7657 raft_consensus.cc:2272] T 232b608558a742e6a6718d264854bb24 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.067827  7657 tablet_replica.cc:333] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.068670  7657 raft_consensus.cc:2243] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.069247  7657 raft_consensus.cc:2272] T 4a84311f7f114de290c0abe9217d400f P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.072222  7657 tablet_replica.cc:333] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.072835  7657 raft_consensus.cc:2243] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:20:03.072988 18000 consensus_peers.cc:597] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 -> Peer 4621deea6f41418eb0609ff4506501fc (127.7.122.65:42121): Couldn't send request to peer 4621deea6f41418eb0609ff4506501fc. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:42121: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:03.073863  7657 raft_consensus.cc:2272] T 2bfb4ab87f4b4346b53eab5807bb85d7 P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.076824  7657 tablet_replica.cc:333] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.077571  7657 raft_consensus.cc:2243] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.078428  7657 raft_consensus.cc:2272] T 29b65968b8964f88bdc73f8865aecb81 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.080720  7657 tablet_replica.cc:333] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.081419  7657 raft_consensus.cc:2243] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.082240  7657 raft_consensus.cc:2272] T 1071921c3cd049f0ae16750d19911a53 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.084260  7657 tablet_replica.cc:333] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.084928  7657 raft_consensus.cc:2243] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.085387  7657 raft_consensus.cc:2272] T ff8e40305b8342a0b89ca28a545c68f4 P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.087611  7657 tablet_replica.cc:333] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.088196  7657 raft_consensus.cc:2243] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:03.088692  7657 raft_consensus.cc:2272] T 1b677add51d243bbb597fb1dfffc8f5a P 82a7f5e9239544ec8db562af81af2a40 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.090919  7657 tablet_replica.cc:333] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.091629  7657 raft_consensus.cc:2243] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.093181  7657 raft_consensus.cc:2272] T 0a94aa6be88b4182b138602c398e05ca P 82a7f5e9239544ec8db562af81af2a40 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.096328  7657 tablet_replica.cc:333] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.097003  7657 raft_consensus.cc:2243] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.097837  7657 raft_consensus.cc:2272] T 8b9de9aeeefe4683b685f9cc99fe9d6e P 82a7f5e9239544ec8db562af81af2a40 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.100055  7657 tablet_replica.cc:333] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40: stopping tablet replica
I20260709 13:20:03.100553  7657 raft_consensus.cc:2243] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.101442  7657 raft_consensus.cc:2272] T 1334bc44c6204d11857a97c5d93a2b65 P 82a7f5e9239544ec8db562af81af2a40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.141840  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
I20260709 13:20:03.171279  7657 master.cc:562] Master@127.7.122.126:44995 shutting down...
I20260709 13:20:03.203965  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:03.204559  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:03.205020  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P ef45d9720b33454188d13ffa92bea30c: stopping tablet replica
I20260709 13:20:03.227854  7657 master.cc:584] Master@127.7.122.126:44995 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13470 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:20:03.277598  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:45901
I20260709 13:20:03.278896  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:03.285099 18355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.285184 18354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.286376 18357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:03.287156  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:03.288288  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:03.288472  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:03.288653  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603203288638 us; error 0 us; skew 500 ppm
I20260709 13:20:03.289347  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:03.292521  7657 webserver.cc:533] Webserver started at http://127.7.122.126:34273/ using document root <none> and password file <none>
I20260709 13:20:03.293184  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:03.293385  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:03.293726  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:03.294876  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.299751  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:03.304525 18362 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.305694  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:03.306166  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.306483  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:03.319375  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:03.320623  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:03.369424  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:45901
I20260709 13:20:03.369522 18413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:45901 every 8 connection(s)
I20260709 13:20:03.373570 18414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:03.386691 18414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e: Bootstrap starting.
I20260709 13:20:03.391813 18414 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:03.396696 18414 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e: No bootstrap required, opened a new log
I20260709 13:20:03.399718 18414 raft_consensus.cc:359] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" member_type: VOTER }
I20260709 13:20:03.400182 18414 raft_consensus.cc:385] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:03.400472 18414 raft_consensus.cc:740] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b35f3f6aeb0c4c4682cbb39d5ac0af3e, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.401314 18414 consensus_queue.cc:260] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" member_type: VOTER }
I20260709 13:20:03.401804 18414 raft_consensus.cc:399] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:03.402024 18414 raft_consensus.cc:493] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:03.402346 18414 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:03.407851 18414 raft_consensus.cc:515] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" member_type: VOTER }
I20260709 13:20:03.409258 18414 leader_election.cc:304] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b35f3f6aeb0c4c4682cbb39d5ac0af3e; no voters: 
I20260709 13:20:03.410897 18414 leader_election.cc:290] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:03.411275 18417 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:03.412773 18417 raft_consensus.cc:697] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 1 LEADER]: Becoming Leader. State: Replica: b35f3f6aeb0c4c4682cbb39d5ac0af3e, State: Running, Role: LEADER
I20260709 13:20:03.413468 18417 consensus_queue.cc:237] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" member_type: VOTER }
I20260709 13:20:03.413975 18414 sys_catalog.cc:565] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:03.419993 18419 sys_catalog.cc:455] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader b35f3f6aeb0c4c4682cbb39d5ac0af3e. Latest consensus state: current_term: 1 leader_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" member_type: VOTER } }
I20260709 13:20:03.420346 18418 sys_catalog.cc:455] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b35f3f6aeb0c4c4682cbb39d5ac0af3e" member_type: VOTER } }
I20260709 13:20:03.420920 18419 sys_catalog.cc:458] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:03.421175 18418 sys_catalog.cc:458] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:03.424517 18425 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:03.432294 18425 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:03.433585  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:03.444077 18425 catalog_manager.cc:1383] Generated new cluster ID: e82e65fe5fed4aae9a4aac53abc568f4
I20260709 13:20:03.444402 18425 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:03.470654 18425 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:03.472458 18425 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:03.491971 18425 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e: Generated new TSK 0
I20260709 13:20:03.492614 18425 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:03.501286  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:03.508697 18435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.510141 18436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.512943 18438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:03.513639  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:03.514606  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:03.514801  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:03.514989  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603203514975 us; error 0 us; skew 500 ppm
I20260709 13:20:03.515651  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:03.518396  7657 webserver.cc:533] Webserver started at http://127.7.122.65:44325/ using document root <none> and password file <none>
I20260709 13:20:03.519141  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:03.519340  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:03.519752  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:03.521261  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "949bc7108a56498684eed9672f5d07b6"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.526176  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:03.530299 18443 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.531551  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:03.531975  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "949bc7108a56498684eed9672f5d07b6"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.532372  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:03.547282  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:03.549245  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:03.550789  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:03.553411  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:03.553644  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.553928  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:03.554160  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.609898  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:38197
I20260709 13:20:03.610049 18505 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:38197 every 8 connection(s)
I20260709 13:20:03.616305  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:03.626427 18510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.627326 18511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.631302 18513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:03.634181  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:03.636487  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:03.636543 18506 heartbeater.cc:344] Connected to a master server at 127.7.122.126:45901
W20260709 13:20:03.636814  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:03.637141  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603203637122 us; error 0 us; skew 500 ppm
I20260709 13:20:03.637171 18506 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:03.637811  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:03.638069 18506 heartbeater.cc:507] Master 127.7.122.126:45901 requested a full tablet report, sending...
I20260709 13:20:03.640307 18379 ts_manager.cc:194] Registered new tserver with Master: 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197)
I20260709 13:20:03.641002  7657 webserver.cc:533] Webserver started at http://127.7.122.66:36957/ using document root <none> and password file <none>
I20260709 13:20:03.641558  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:03.641777  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:03.642140  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:03.642936 18379 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53650
I20260709 13:20:03.643503  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "7777cc0b91d54cce811f8ea37ef00be1"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.648672  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:20:03.653494 18518 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.654997  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:03.655500  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "7777cc0b91d54cce811f8ea37ef00be1"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.655831  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:03.666761  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:03.668020  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:03.669615  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:03.672331  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:03.672605  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.672998  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:03.673182  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.728010  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:36635
I20260709 13:20:03.728135 18580 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:36635 every 8 connection(s)
I20260709 13:20:03.733922  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:03.744016 18584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:03.746577 18585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:03.753223 18581 heartbeater.cc:344] Connected to a master server at 127.7.122.126:45901
I20260709 13:20:03.753288  7657 server_base.cc:1061] running on GCE node
W20260709 13:20:03.753464 18587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:03.754204 18581 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:03.755007  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:03.755278 18581 heartbeater.cc:507] Master 127.7.122.126:45901 requested a full tablet report, sending...
W20260709 13:20:03.755350  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:03.755712  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603203755691 us; error 0 us; skew 500 ppm
I20260709 13:20:03.756830  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:03.758451 18379 ts_manager.cc:194] Registered new tserver with Master: 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:03.760227  7657 webserver.cc:533] Webserver started at http://127.7.122.67:35805/ using document root <none> and password file <none>
I20260709 13:20:03.760910  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:03.761189  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:03.761482  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:03.761533 18379 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53662
I20260709 13:20:03.763546  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "509f5650120f4b5c998884d571f72dd5"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.770707  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:20:03.776484 18592 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.778825  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:20:03.779201  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "509f5650120f4b5c998884d571f72dd5"
format_stamp: "Formatted at 2026-07-09 13:20:03 on dist-test-slave-078m"
I20260709 13:20:03.779757  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:03.817749  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:03.819656  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:03.821084  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:03.823868  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:03.824185  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:20:03.824445  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:03.824626  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:03.879262  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:42105
I20260709 13:20:03.879383 18654 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:42105 every 8 connection(s)
I20260709 13:20:03.897782 18655 heartbeater.cc:344] Connected to a master server at 127.7.122.126:45901
I20260709 13:20:03.898561 18655 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:03.899516 18655 heartbeater.cc:507] Master 127.7.122.126:45901 requested a full tablet report, sending...
I20260709 13:20:03.902443 18379 ts_manager.cc:194] Registered new tserver with Master: 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:03.902611  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019924046s
I20260709 13:20:03.904341 18379 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53674
I20260709 13:20:03.937305 18379 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53684:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:03.940325 18379 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:04.005786 18620 tablet_service.cc:1511] Processing CreateTablet for tablet 68aa0123403a4b3a968012f9098d9083 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16b38e4bee644aba9ca8f2ed6e5f37fd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:04.006402 18619 tablet_service.cc:1511] Processing CreateTablet for tablet 163166443940432a9fbc766a8931f6fb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16b38e4bee644aba9ca8f2ed6e5f37fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:04.007436 18620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aa0123403a4b3a968012f9098d9083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.008082 18619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163166443940432a9fbc766a8931f6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.016640 18546 tablet_service.cc:1511] Processing CreateTablet for tablet 68aa0123403a4b3a968012f9098d9083 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16b38e4bee644aba9ca8f2ed6e5f37fd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:04.018307 18546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aa0123403a4b3a968012f9098d9083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.019832 18545 tablet_service.cc:1511] Processing CreateTablet for tablet 163166443940432a9fbc766a8931f6fb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16b38e4bee644aba9ca8f2ed6e5f37fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:04.022472 18471 tablet_service.cc:1511] Processing CreateTablet for tablet 68aa0123403a4b3a968012f9098d9083 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16b38e4bee644aba9ca8f2ed6e5f37fd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:04.024179 18471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68aa0123403a4b3a968012f9098d9083. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.020469 18470 tablet_service.cc:1511] Processing CreateTablet for tablet 163166443940432a9fbc766a8931f6fb (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=16b38e4bee644aba9ca8f2ed6e5f37fd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:04.026141 18470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163166443940432a9fbc766a8931f6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.026959 18545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 163166443940432a9fbc766a8931f6fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.037036 18670 tablet_bootstrap.cc:492] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5: Bootstrap starting.
I20260709 13:20:04.047227 18670 tablet_bootstrap.cc:654] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.064205 18672 tablet_bootstrap.cc:492] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6: Bootstrap starting.
I20260709 13:20:04.072829 18670 tablet_bootstrap.cc:492] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5: No bootstrap required, opened a new log
I20260709 13:20:04.073547 18670 ts_tablet_manager.cc:1403] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.011s
I20260709 13:20:04.072942 18673 tablet_bootstrap.cc:492] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: Bootstrap starting.
I20260709 13:20:04.078574 18670 raft_consensus.cc:359] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.079787 18670 raft_consensus.cc:385] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.080031 18672 tablet_bootstrap.cc:654] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.080458 18670 raft_consensus.cc:740] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.081426 18670 consensus_queue.cc:260] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.084110 18673 tablet_bootstrap.cc:654] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.084666 18655 heartbeater.cc:499] Master 127.7.122.126:45901 was elected leader, sending a full tablet report...
I20260709 13:20:04.085553 18670 ts_tablet_manager.cc:1434] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 13:20:04.086773 18670 tablet_bootstrap.cc:492] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5: Bootstrap starting.
I20260709 13:20:04.101269 18670 tablet_bootstrap.cc:654] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.108794 18673 tablet_bootstrap.cc:492] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: No bootstrap required, opened a new log
I20260709 13:20:04.109398 18673 ts_tablet_manager.cc:1403] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.017s
I20260709 13:20:04.109902 18672 tablet_bootstrap.cc:492] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6: No bootstrap required, opened a new log
I20260709 13:20:04.110576 18672 ts_tablet_manager.cc:1403] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.012s
I20260709 13:20:04.112792 18673 raft_consensus.cc:359] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.113776 18673 raft_consensus.cc:385] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.114298 18673 raft_consensus.cc:740] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.114634 18672 raft_consensus.cc:359] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.115684 18672 raft_consensus.cc:385] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.115396 18673 consensus_queue.cc:260] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.116074 18672 raft_consensus.cc:740] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.117637 18672 consensus_queue.cc:260] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.119247 18581 heartbeater.cc:499] Master 127.7.122.126:45901 was elected leader, sending a full tablet report...
I20260709 13:20:04.128105 18673 ts_tablet_manager.cc:1434] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 13:20:04.129732 18673 tablet_bootstrap.cc:492] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1: Bootstrap starting.
I20260709 13:20:04.131050 18670 tablet_bootstrap.cc:492] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5: No bootstrap required, opened a new log
I20260709 13:20:04.132210 18670 ts_tablet_manager.cc:1403] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.027s
I20260709 13:20:04.135931 18672 ts_tablet_manager.cc:1434] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.015s
I20260709 13:20:04.136332 18506 heartbeater.cc:499] Master 127.7.122.126:45901 was elected leader, sending a full tablet report...
I20260709 13:20:04.137135 18672 tablet_bootstrap.cc:492] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6: Bootstrap starting.
I20260709 13:20:04.139266 18670 raft_consensus.cc:359] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.140403 18670 raft_consensus.cc:385] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.140774 18670 raft_consensus.cc:740] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.141636 18673 tablet_bootstrap.cc:654] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.141700 18670 consensus_queue.cc:260] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.146858 18670 ts_tablet_manager.cc:1434] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:20:04.151194 18672 tablet_bootstrap.cc:654] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.163960 18673 tablet_bootstrap.cc:492] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1: No bootstrap required, opened a new log
I20260709 13:20:04.164832 18673 ts_tablet_manager.cc:1403] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1: Time spent bootstrapping tablet: real 0.035s	user 0.024s	sys 0.008s
I20260709 13:20:04.164055 18672 tablet_bootstrap.cc:492] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6: No bootstrap required, opened a new log
I20260709 13:20:04.166148 18672 ts_tablet_manager.cc:1403] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 13:20:04.169483 18673 raft_consensus.cc:359] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.171008 18673 raft_consensus.cc:385] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.171816 18673 raft_consensus.cc:740] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.171132 18672 raft_consensus.cc:359] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.172504 18672 raft_consensus.cc:385] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.172892 18672 raft_consensus.cc:740] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.172951 18673 consensus_queue.cc:260] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.173784 18672 consensus_queue.cc:260] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.175918 18673 ts_tablet_manager.cc:1434] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.006s
I20260709 13:20:04.176318 18672 ts_tablet_manager.cc:1434] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:04.231108 18679 raft_consensus.cc:493] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.232066 18679 raft_consensus.cc:515] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.234947 18679 leader_election.cc:290] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105), 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:04.247298 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aa0123403a4b3a968012f9098d9083" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509f5650120f4b5c998884d571f72dd5" is_pre_election: true
I20260709 13:20:04.248099 18630 raft_consensus.cc:2468] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 0.
I20260709 13:20:04.249678 18446 leader_election.cc:304] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:04.250567 18679 raft_consensus.cc:2804] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:04.250941 18679 raft_consensus.cc:493] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.251369 18679 raft_consensus.cc:3060] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.252350 18556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aa0123403a4b3a968012f9098d9083" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1" is_pre_election: true
I20260709 13:20:04.253072 18556 raft_consensus.cc:2468] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 0.
I20260709 13:20:04.259457 18679 raft_consensus.cc:515] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.261577 18679 leader_election.cc:290] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 election: Requested vote from peers 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105), 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:04.262678 18556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aa0123403a4b3a968012f9098d9083" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
I20260709 13:20:04.262692 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68aa0123403a4b3a968012f9098d9083" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509f5650120f4b5c998884d571f72dd5"
I20260709 13:20:04.263336 18556 raft_consensus.cc:3060] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.263870 18630 raft_consensus.cc:3060] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.270437 18630 raft_consensus.cc:2468] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 1.
I20260709 13:20:04.270438 18556 raft_consensus.cc:2468] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 1.
I20260709 13:20:04.271838 18446 leader_election.cc:304] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:04.272699 18679 raft_consensus.cc:2804] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:04.273756 18679 raft_consensus.cc:697] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 1 LEADER]: Becoming Leader. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Running, Role: LEADER
I20260709 13:20:04.274607 18679 consensus_queue.cc:237] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } }
I20260709 13:20:04.284749 18379 catalog_manager.cc:5697] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 949bc7108a56498684eed9672f5d07b6 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "949bc7108a56498684eed9672f5d07b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:04.428622 18427 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:04.487190 18678 raft_consensus.cc:493] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.487969 18678 raft_consensus.cc:515] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.490978 18678 leader_election.cc:290] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:04.503027 18481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "7777cc0b91d54cce811f8ea37ef00be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bc7108a56498684eed9672f5d07b6" is_pre_election: true
I20260709 13:20:04.503894 18481 raft_consensus.cc:2468] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7777cc0b91d54cce811f8ea37ef00be1 in term 0.
I20260709 13:20:04.504773 18674 raft_consensus.cc:493] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.505366 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "7777cc0b91d54cce811f8ea37ef00be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509f5650120f4b5c998884d571f72dd5" is_pre_election: true
I20260709 13:20:04.505393 18521 leader_election.cc:304] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7777cc0b91d54cce811f8ea37ef00be1, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:04.505394 18674 raft_consensus.cc:515] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.506613 18678 raft_consensus.cc:2804] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:04.506852 18630 raft_consensus.cc:2468] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7777cc0b91d54cce811f8ea37ef00be1 in term 0.
I20260709 13:20:04.507087 18678 raft_consensus.cc:493] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.507516 18678 raft_consensus.cc:3060] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.508649 18674 leader_election.cc:290] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:04.518036 18678 raft_consensus.cc:515] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.521806 18481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "7777cc0b91d54cce811f8ea37ef00be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bc7108a56498684eed9672f5d07b6"
I20260709 13:20:04.522468 18481 raft_consensus.cc:3060] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.523432 18678 leader_election.cc:290] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [CANDIDATE]: Term 1 election: Requested vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:04.523782 18480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bc7108a56498684eed9672f5d07b6" is_pre_election: true
I20260709 13:20:04.525437 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "7777cc0b91d54cce811f8ea37ef00be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509f5650120f4b5c998884d571f72dd5"
I20260709 13:20:04.526147 18630 raft_consensus.cc:3060] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.530215 18556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1" is_pre_election: true
I20260709 13:20:04.531109 18556 raft_consensus.cc:2393] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 509f5650120f4b5c998884d571f72dd5 in current term 1: Already voted for candidate 7777cc0b91d54cce811f8ea37ef00be1 in this term.
I20260709 13:20:04.532213 18481 raft_consensus.cc:2468] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7777cc0b91d54cce811f8ea37ef00be1 in term 1.
I20260709 13:20:04.532369 18593 leader_election.cc:304] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5; no voters: 7777cc0b91d54cce811f8ea37ef00be1, 949bc7108a56498684eed9672f5d07b6
I20260709 13:20:04.533763 18521 leader_election.cc:304] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7777cc0b91d54cce811f8ea37ef00be1, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:04.534704 18630 raft_consensus.cc:2468] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7777cc0b91d54cce811f8ea37ef00be1 in term 1.
I20260709 13:20:04.534700 18678 raft_consensus.cc:2804] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:04.535349 18674 raft_consensus.cc:2749] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:04.536335 18678 raft_consensus.cc:697] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 LEADER]: Becoming Leader. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Running, Role: LEADER
I20260709 13:20:04.537376 18678 consensus_queue.cc:237] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.548139 18379 catalog_manager.cc:5697] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "7777cc0b91d54cce811f8ea37ef00be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:04.665110 18379 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53686:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:04.667140 18379 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:04.696151 18471 tablet_service.cc:1511] Processing CreateTablet for tablet 30aac02da70c451b9413a8dd45a13510 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=686972d6862341f8b2f370d60c0dcc2c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:04.697600 18471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30aac02da70c451b9413a8dd45a13510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.697487 18546 tablet_service.cc:1511] Processing CreateTablet for tablet 30aac02da70c451b9413a8dd45a13510 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=686972d6862341f8b2f370d60c0dcc2c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:04.698971 18546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30aac02da70c451b9413a8dd45a13510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.700649 18620 tablet_service.cc:1511] Processing CreateTablet for tablet 30aac02da70c451b9413a8dd45a13510 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=686972d6862341f8b2f370d60c0dcc2c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:04.702046 18470 tablet_service.cc:1511] Processing CreateTablet for tablet 8242e98873a343019e59a0c0afe01dd7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=686972d6862341f8b2f370d60c0dcc2c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:04.702069 18620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30aac02da70c451b9413a8dd45a13510. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.703709 18470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8242e98873a343019e59a0c0afe01dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.712111 18545 tablet_service.cc:1511] Processing CreateTablet for tablet 8242e98873a343019e59a0c0afe01dd7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=686972d6862341f8b2f370d60c0dcc2c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:04.713936 18545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8242e98873a343019e59a0c0afe01dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.721521 18619 tablet_service.cc:1511] Processing CreateTablet for tablet 8242e98873a343019e59a0c0afe01dd7 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=686972d6862341f8b2f370d60c0dcc2c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:04.723026 18619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8242e98873a343019e59a0c0afe01dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:04.735955 18699 tablet_bootstrap.cc:492] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: Bootstrap starting.
I20260709 13:20:04.742588 18700 tablet_bootstrap.cc:492] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: Bootstrap starting.
I20260709 13:20:04.753131 18684 consensus_queue.cc:1048] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:04.748746 18699 tablet_bootstrap.cc:654] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.757526 18700 tablet_bootstrap.cc:654] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.769965 18699 tablet_bootstrap.cc:492] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: No bootstrap required, opened a new log
I20260709 13:20:04.770788 18699 ts_tablet_manager.cc:1403] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.007s
I20260709 13:20:04.772308 18698 tablet_bootstrap.cc:492] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: Bootstrap starting.
I20260709 13:20:04.774650 18700 tablet_bootstrap.cc:492] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: No bootstrap required, opened a new log
I20260709 13:20:04.775463 18700 ts_tablet_manager.cc:1403] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.002s
I20260709 13:20:04.779211 18700 raft_consensus.cc:359] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.780110 18700 raft_consensus.cc:385] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.780486 18700 raft_consensus.cc:740] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.774650 18699 raft_consensus.cc:359] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.782135 18699 raft_consensus.cc:385] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.781769 18700 consensus_queue.cc:260] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.782523 18699 raft_consensus.cc:740] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.783524 18699 consensus_queue.cc:260] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.784480 18700 ts_tablet_manager.cc:1434] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:20:04.785750 18700 tablet_bootstrap.cc:492] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1: Bootstrap starting.
I20260709 13:20:04.793892 18700 tablet_bootstrap.cc:654] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.800148 18699 ts_tablet_manager.cc:1434] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:20:04.801999 18699 tablet_bootstrap.cc:492] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5: Bootstrap starting.
I20260709 13:20:04.810499 18698 tablet_bootstrap.cc:654] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.812436 18699 tablet_bootstrap.cc:654] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.812021 18700 tablet_bootstrap.cc:492] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1: No bootstrap required, opened a new log
I20260709 13:20:04.812795 18679 consensus_queue.cc:1048] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:04.813671 18700 ts_tablet_manager.cc:1403] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.013s
I20260709 13:20:04.817782 18700 raft_consensus.cc:359] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.819041 18699 tablet_bootstrap.cc:492] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5: No bootstrap required, opened a new log
I20260709 13:20:04.820957 18700 raft_consensus.cc:385] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.821203 18699 ts_tablet_manager.cc:1403] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 13:20:04.821821 18700 raft_consensus.cc:740] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.826671 18699 raft_consensus.cc:359] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.827394 18698 tablet_bootstrap.cc:492] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: No bootstrap required, opened a new log
I20260709 13:20:04.827543 18699 raft_consensus.cc:385] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.828064 18699 raft_consensus.cc:740] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.828130 18698 ts_tablet_manager.cc:1403] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.005s
I20260709 13:20:04.824559 18700 consensus_queue.cc:260] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.829355 18699 consensus_queue.cc:260] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.832655 18699 ts_tablet_manager.cc:1434] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:20:04.833873 18700 ts_tablet_manager.cc:1434] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:20:04.833477 18698 raft_consensus.cc:359] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.836654 18698 raft_consensus.cc:385] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.837209 18698 raft_consensus.cc:740] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.839673 18674 raft_consensus.cc:493] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:04.840293 18674 raft_consensus.cc:515] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.846015 18481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bc7108a56498684eed9672f5d07b6" is_pre_election: true
I20260709 13:20:04.846710 18555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1" is_pre_election: true
I20260709 13:20:04.846019 18674 leader_election.cc:290] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:04.847856 18555 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509f5650120f4b5c998884d571f72dd5 in term 0.
I20260709 13:20:04.849843 18593 leader_election.cc:304] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5, 7777cc0b91d54cce811f8ea37ef00be1; no voters: 
I20260709 13:20:04.851157 18674 raft_consensus.cc:2804] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:04.851677 18674 raft_consensus.cc:493] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:04.852120 18674 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.838111 18698 consensus_queue.cc:260] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.857465 18481 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 509f5650120f4b5c998884d571f72dd5 in term 0.
I20260709 13:20:04.864804 18698 ts_tablet_manager.cc:1434] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:20:04.865207 18674 raft_consensus.cc:515] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.867857 18698 tablet_bootstrap.cc:492] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6: Bootstrap starting.
I20260709 13:20:04.870622 18481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "949bc7108a56498684eed9672f5d07b6"
I20260709 13:20:04.871683 18481 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.878073 18698 tablet_bootstrap.cc:654] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:04.879421 18674 leader_election.cc:290] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 1 election: Requested vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:04.881073 18555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
I20260709 13:20:04.881788 18555 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:04.885601 18481 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509f5650120f4b5c998884d571f72dd5 in term 1.
I20260709 13:20:04.892634 18555 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509f5650120f4b5c998884d571f72dd5 in term 1.
I20260709 13:20:04.894054 18593 leader_election.cc:304] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5, 7777cc0b91d54cce811f8ea37ef00be1; no voters: 
I20260709 13:20:04.894174 18698 tablet_bootstrap.cc:492] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6: No bootstrap required, opened a new log
I20260709 13:20:04.895011 18712 raft_consensus.cc:2804] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:04.895010 18698 ts_tablet_manager.cc:1403] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.005s
I20260709 13:20:04.895941 18712 raft_consensus.cc:697] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 LEADER]: Becoming Leader. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Running, Role: LEADER
I20260709 13:20:04.897001 18712 consensus_queue.cc:237] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.900665 18698 raft_consensus.cc:359] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.901675 18698 raft_consensus.cc:385] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:04.902441 18698 raft_consensus.cc:740] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.903565 18698 consensus_queue.cc:260] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:04.906232 18698 ts_tablet_manager.cc:1434] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:20:04.909010 18379 catalog_manager.cc:5697] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 509f5650120f4b5c998884d571f72dd5 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "509f5650120f4b5c998884d571f72dd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:04.921566 18678 consensus_queue.cc:1048] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:04.937310 18678 consensus_queue.cc:1048] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:05.106264 18707 raft_consensus.cc:493] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:05.106741 18707 raft_consensus.cc:515] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.109733 18707 leader_election.cc:290] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635), 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:05.111073 18555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8242e98873a343019e59a0c0afe01dd7" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1" is_pre_election: true
I20260709 13:20:05.111807 18555 raft_consensus.cc:2468] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 0.
I20260709 13:20:05.111392 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8242e98873a343019e59a0c0afe01dd7" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509f5650120f4b5c998884d571f72dd5" is_pre_election: true
I20260709 13:20:05.112443 18630 raft_consensus.cc:2468] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 0.
I20260709 13:20:05.113085 18444 leader_election.cc:304] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7777cc0b91d54cce811f8ea37ef00be1, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:05.114580 18707 raft_consensus.cc:2804] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:05.114976 18707 raft_consensus.cc:493] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:05.115520 18707 raft_consensus.cc:3060] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.122366 18707 raft_consensus.cc:515] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.124287 18707 leader_election.cc:290] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 election: Requested vote from peers 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635), 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:05.125479 18555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8242e98873a343019e59a0c0afe01dd7" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
I20260709 13:20:05.125696 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8242e98873a343019e59a0c0afe01dd7" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "509f5650120f4b5c998884d571f72dd5"
I20260709 13:20:05.126308 18630 raft_consensus.cc:3060] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.126308 18555 raft_consensus.cc:3060] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:05.135365 18630 raft_consensus.cc:2468] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 1.
I20260709 13:20:05.135387 18555 raft_consensus.cc:2468] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 1.
I20260709 13:20:05.137144 18444 leader_election.cc:304] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7777cc0b91d54cce811f8ea37ef00be1, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:05.138232 18707 raft_consensus.cc:2804] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:05.139073 18707 raft_consensus.cc:697] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 1 LEADER]: Becoming Leader. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Running, Role: LEADER
I20260709 13:20:05.140070 18707 consensus_queue.cc:237] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.147873 18379 catalog_manager.cc:5697] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 949bc7108a56498684eed9672f5d07b6 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "949bc7108a56498684eed9672f5d07b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:05.239574 18555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "163166443940432a9fbc766a8931f6fb"
dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
mode: GRACEFUL
new_leader_uuid: "509f5650120f4b5c998884d571f72dd5"
 from {username='slave'} at 127.0.0.1:43314
I20260709 13:20:05.240267 18555 raft_consensus.cc:606] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 LEADER]: Received request to transfer leadership to TS 509f5650120f4b5c998884d571f72dd5
I20260709 13:20:05.257867 18630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510"
dest_uuid: "509f5650120f4b5c998884d571f72dd5"
mode: GRACEFUL
new_leader_uuid: "949bc7108a56498684eed9672f5d07b6"
 from {username='slave'} at 127.0.0.1:49050
I20260709 13:20:05.258618 18630 raft_consensus.cc:606] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 LEADER]: Received request to transfer leadership to TS 949bc7108a56498684eed9672f5d07b6
I20260709 13:20:05.449872 18690 raft_consensus.cc:993] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: : Instructing follower 509f5650120f4b5c998884d571f72dd5 to start an election
I20260709 13:20:05.451246 18690 raft_consensus.cc:1081] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 LEADER]: Signalling peer 509f5650120f4b5c998884d571f72dd5 to start an election
I20260709 13:20:05.454440 18630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "163166443940432a9fbc766a8931f6fb"
dest_uuid: "509f5650120f4b5c998884d571f72dd5"
 from {username='slave'} at 127.0.0.1:49044
I20260709 13:20:05.455585 18630 raft_consensus.cc:493] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:05.455075 18723 consensus_queue.cc:1048] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:05.456274 18630 raft_consensus.cc:3060] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.459088 18724 consensus_queue.cc:1048] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:05.481426 18724 raft_consensus.cc:993] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: : Instructing follower 949bc7108a56498684eed9672f5d07b6 to start an election
I20260709 13:20:05.480486 18630 raft_consensus.cc:515] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.490945 18723 raft_consensus.cc:1081] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 LEADER]: Signalling peer 949bc7108a56498684eed9672f5d07b6 to start an election
I20260709 13:20:05.496317 18480 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510"
dest_uuid: "949bc7108a56498684eed9672f5d07b6"
 from {username='slave'} at 127.0.0.1:57158
I20260709 13:20:05.502463 18480 raft_consensus.cc:493] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:05.502916 18480 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.497151 18630 leader_election.cc:290] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 2 election: Requested vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635)
I20260709 13:20:05.499495 18556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
I20260709 13:20:05.500649 18481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "163166443940432a9fbc766a8931f6fb" candidate_uuid: "509f5650120f4b5c998884d571f72dd5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "949bc7108a56498684eed9672f5d07b6"
I20260709 13:20:05.505985 18556 raft_consensus.cc:3055] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:05.506369 18556 raft_consensus.cc:740] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Running, Role: LEADER
I20260709 13:20:05.507823 18556 consensus_queue.cc:260] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.510106 18481 raft_consensus.cc:3060] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.510689 18556 raft_consensus.cc:3060] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.528201 18481 raft_consensus.cc:2468] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509f5650120f4b5c998884d571f72dd5 in term 2.
I20260709 13:20:05.530539 18595 leader_election.cc:304] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:05.531795 18728 raft_consensus.cc:2804] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:05.532322 18728 raft_consensus.cc:697] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 2 LEADER]: Becoming Leader. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Running, Role: LEADER
I20260709 13:20:05.533664 18728 consensus_queue.cc:237] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.534687 18556 raft_consensus.cc:2468] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 509f5650120f4b5c998884d571f72dd5 in term 2.
I20260709 13:20:05.545502 18377 catalog_manager.cc:5697] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 reported cstate change: term changed from 1 to 2, leader changed from 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66) to 509f5650120f4b5c998884d571f72dd5 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "509f5650120f4b5c998884d571f72dd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:05.546818 18480 raft_consensus.cc:515] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.559407 18555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
I20260709 13:20:05.560171 18555 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.560402 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "949bc7108a56498684eed9672f5d07b6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "509f5650120f4b5c998884d571f72dd5"
I20260709 13:20:05.561173 18630 raft_consensus.cc:3055] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:05.561535 18630 raft_consensus.cc:740] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 509f5650120f4b5c998884d571f72dd5, State: Running, Role: LEADER
I20260709 13:20:05.562678 18630 consensus_queue.cc:260] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.563902 18630 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.569128 18480 leader_election.cc:290] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 2 election: Requested vote from peers 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635), 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:05.571884 18555 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 2.
I20260709 13:20:05.572518 18630 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 949bc7108a56498684eed9672f5d07b6 in term 2.
I20260709 13:20:05.573427 18444 leader_election.cc:304] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7777cc0b91d54cce811f8ea37ef00be1, 949bc7108a56498684eed9672f5d07b6; no voters: 
I20260709 13:20:05.574536 18707 raft_consensus.cc:2804] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:05.574975 18707 raft_consensus.cc:697] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 LEADER]: Becoming Leader. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Running, Role: LEADER
I20260709 13:20:05.576224 18707 consensus_queue.cc:237] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:05.583300 18379 catalog_manager.cc:5697] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 reported cstate change: term changed from 1 to 2, leader changed from 509f5650120f4b5c998884d571f72dd5 (127.7.122.67) to 949bc7108a56498684eed9672f5d07b6 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "949bc7108a56498684eed9672f5d07b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:05.620249  7657 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:20:05.622083  7657 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:20:05.622551  7657 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:20:05.638880 18480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510"
dest_uuid: "949bc7108a56498684eed9672f5d07b6"
mode: GRACEFUL
new_leader_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
 from {username='slave'} at 127.0.0.1:57170
I20260709 13:20:05.639611 18480 raft_consensus.cc:606] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 LEADER]: Received request to transfer leadership to TS 7777cc0b91d54cce811f8ea37ef00be1
I20260709 13:20:05.641057  7657 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:20:05.694419 18707 consensus_queue.cc:1048] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:05.709388 18679 consensus_queue.cc:1048] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:05.932746 18555 raft_consensus.cc:1275] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Refusing update from remote peer 509f5650120f4b5c998884d571f72dd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.934823 18724 consensus_queue.cc:1048] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:05.948362 18480 raft_consensus.cc:1275] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Refusing update from remote peer 509f5650120f4b5c998884d571f72dd5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.951222 18728 consensus_queue.cc:1048] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:05.982548 18555 raft_consensus.cc:1275] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Refusing update from remote peer 949bc7108a56498684eed9672f5d07b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:05.984266 18707 consensus_queue.cc:1048] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:05.992503 18679 raft_consensus.cc:993] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: : Instructing follower 7777cc0b91d54cce811f8ea37ef00be1 to start an election
I20260709 13:20:05.993708 18684 raft_consensus.cc:1081] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 LEADER]: Signalling peer 7777cc0b91d54cce811f8ea37ef00be1 to start an election
I20260709 13:20:05.996105 18556 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510"
dest_uuid: "7777cc0b91d54cce811f8ea37ef00be1"
 from {username='slave'} at 127.0.0.1:43302
I20260709 13:20:05.998469 18556 raft_consensus.cc:493] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:05.998939 18556 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:05.999150 18630 raft_consensus.cc:1275] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 2 FOLLOWER]: Refusing update from remote peer 949bc7108a56498684eed9672f5d07b6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:06.001269 18684 consensus_queue.cc:1048] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:06.009649 18556 raft_consensus.cc:515] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:06.017057 18556 leader_election.cc:290] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [CANDIDATE]: Term 3 election: Requested vote from peers 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197), 509f5650120f4b5c998884d571f72dd5 (127.7.122.67:42105)
I20260709 13:20:06.018873 18630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "7777cc0b91d54cce811f8ea37ef00be1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "509f5650120f4b5c998884d571f72dd5"
I20260709 13:20:06.019508 18480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30aac02da70c451b9413a8dd45a13510" candidate_uuid: "7777cc0b91d54cce811f8ea37ef00be1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "949bc7108a56498684eed9672f5d07b6"
I20260709 13:20:06.019675 18630 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.020255 18480 raft_consensus.cc:3055] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:06.020569 18480 raft_consensus.cc:740] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 949bc7108a56498684eed9672f5d07b6, State: Running, Role: LEADER
I20260709 13:20:06.021404 18480 consensus_queue.cc:260] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:06.022531 18480 raft_consensus.cc:3060] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:06.027194 18630 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7777cc0b91d54cce811f8ea37ef00be1 in term 3.
I20260709 13:20:06.032918 18521 leader_election.cc:304] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 509f5650120f4b5c998884d571f72dd5, 7777cc0b91d54cce811f8ea37ef00be1; no voters: 
I20260709 13:20:06.035133 18480 raft_consensus.cc:2468] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7777cc0b91d54cce811f8ea37ef00be1 in term 3.
I20260709 13:20:06.035276 18690 raft_consensus.cc:2804] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:06.039664 18690 raft_consensus.cc:697] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 3 LEADER]: Becoming Leader. State: Replica: 7777cc0b91d54cce811f8ea37ef00be1, State: Running, Role: LEADER
I20260709 13:20:06.041038 18690 consensus_queue.cc:237] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } }
I20260709 13:20:06.048207 18377 catalog_manager.cc:5697] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 reported cstate change: term changed from 2 to 3, leader changed from 949bc7108a56498684eed9672f5d07b6 (127.7.122.65) to 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66). New cstate: current_term: 3 leader_uuid: "7777cc0b91d54cce811f8ea37ef00be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "949bc7108a56498684eed9672f5d07b6" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 38197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7777cc0b91d54cce811f8ea37ef00be1" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 36635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "509f5650120f4b5c998884d571f72dd5" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 42105 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:06.314509  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
I20260709 13:20:06.346545  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:06.347750  7657 tablet_replica.cc:333] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6: stopping tablet replica
I20260709 13:20:06.348606  7657 raft_consensus.cc:2243] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.349607  7657 raft_consensus.cc:2272] T 8242e98873a343019e59a0c0afe01dd7 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.353021  7657 tablet_replica.cc:333] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6: stopping tablet replica
I20260709 13:20:06.353786  7657 raft_consensus.cc:2243] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.354305  7657 raft_consensus.cc:2272] T 30aac02da70c451b9413a8dd45a13510 P 949bc7108a56498684eed9672f5d07b6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.357841  7657 tablet_replica.cc:333] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6: stopping tablet replica
I20260709 13:20:06.358534  7657 raft_consensus.cc:2243] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.359622  7657 raft_consensus.cc:2272] T 68aa0123403a4b3a968012f9098d9083 P 949bc7108a56498684eed9672f5d07b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.362383  7657 tablet_replica.cc:333] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6: stopping tablet replica
I20260709 13:20:06.363018  7657 raft_consensus.cc:2243] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.363520  7657 raft_consensus.cc:2272] T 163166443940432a9fbc766a8931f6fb P 949bc7108a56498684eed9672f5d07b6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:06.376741 18595 consensus_peers.cc:597] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 -> Peer 949bc7108a56498684eed9672f5d07b6 (127.7.122.65:38197): Couldn't send request to peer 949bc7108a56498684eed9672f5d07b6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.403045  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
I20260709 13:20:06.423136  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
W20260709 13:20:06.457834 18593 consensus_peers.cc:597] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 -> Peer 7777cc0b91d54cce811f8ea37ef00be1 (127.7.122.66:36635): Couldn't send request to peer 7777cc0b91d54cce811f8ea37ef00be1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:06.466212  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:06.467907  7657 tablet_replica.cc:333] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1: stopping tablet replica
I20260709 13:20:06.469316  7657 raft_consensus.cc:2243] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.469913  7657 raft_consensus.cc:2272] T 8242e98873a343019e59a0c0afe01dd7 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.474267  7657 tablet_replica.cc:333] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: stopping tablet replica
I20260709 13:20:06.475008  7657 raft_consensus.cc:2243] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.475728  7657 pending_rounds.cc:70] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: Trying to abort 1 pending ops.
I20260709 13:20:06.475924  7657 pending_rounds.cc:77] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638731953336320 op_type: NO_OP noop_request { }
I20260709 13:20:06.476243  7657 raft_consensus.cc:2889] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:06.476583  7657 raft_consensus.cc:2272] T 30aac02da70c451b9413a8dd45a13510 P 7777cc0b91d54cce811f8ea37ef00be1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.480911  7657 tablet_replica.cc:333] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1: stopping tablet replica
I20260709 13:20:06.481853  7657 raft_consensus.cc:2243] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.482513  7657 raft_consensus.cc:2272] T 68aa0123403a4b3a968012f9098d9083 P 7777cc0b91d54cce811f8ea37ef00be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.485687  7657 tablet_replica.cc:333] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1: stopping tablet replica
I20260709 13:20:06.486281  7657 raft_consensus.cc:2243] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.486764  7657 raft_consensus.cc:2272] T 163166443940432a9fbc766a8931f6fb P 7777cc0b91d54cce811f8ea37ef00be1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.518512  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
I20260709 13:20:06.539556  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
I20260709 13:20:06.575234  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:06.576139  7657 tablet_replica.cc:333] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5: stopping tablet replica
I20260709 13:20:06.577066  7657 raft_consensus.cc:2243] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.577617  7657 raft_consensus.cc:2272] T 8242e98873a343019e59a0c0afe01dd7 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.581200  7657 tablet_replica.cc:333] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5: stopping tablet replica
I20260709 13:20:06.581995  7657 raft_consensus.cc:2243] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.582480  7657 raft_consensus.cc:2272] T 30aac02da70c451b9413a8dd45a13510 P 509f5650120f4b5c998884d571f72dd5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.585880  7657 tablet_replica.cc:333] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5: stopping tablet replica
I20260709 13:20:06.586490  7657 raft_consensus.cc:2243] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:06.587103  7657 raft_consensus.cc:2272] T 68aa0123403a4b3a968012f9098d9083 P 509f5650120f4b5c998884d571f72dd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.590114  7657 tablet_replica.cc:333] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5: stopping tablet replica
I20260709 13:20:06.590700  7657 raft_consensus.cc:2243] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.591601  7657 raft_consensus.cc:2272] T 163166443940432a9fbc766a8931f6fb P 509f5650120f4b5c998884d571f72dd5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.621027  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
I20260709 13:20:06.643239  7657 master.cc:562] Master@127.7.122.126:45901 shutting down...
I20260709 13:20:06.672531  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:06.673193  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:06.673681  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P b35f3f6aeb0c4c4682cbb39d5ac0af3e: stopping tablet replica
I20260709 13:20:06.698247  7657 master.cc:584] Master@127.7.122.126:45901 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3474 ms)
[----------] 6 tests from LeaderRebalancerTest (323019 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:20:06.754488  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:37053
I20260709 13:20:06.755802  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:06.762768 18739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:06.764122 18742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:06.764427  7657 server_base.cc:1061] running on GCE node
W20260709 13:20:06.764248 18740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:06.765735  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:06.765939  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:06.766049  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603206766039 us; error 0 us; skew 500 ppm
I20260709 13:20:06.766526  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:06.769495  7657 webserver.cc:533] Webserver started at http://127.7.122.126:37805/ using document root <none> and password file <none>
I20260709 13:20:06.769980  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:06.770141  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:06.770365  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:06.771562  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "c13b625b955b4993a5f7a0b539c406c3"
format_stamp: "Formatted at 2026-07-09 13:20:06 on dist-test-slave-078m"
I20260709 13:20:06.777506  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:20:06.782537 18747 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:06.783696  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 13:20:06.784094  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "c13b625b955b4993a5f7a0b539c406c3"
format_stamp: "Formatted at 2026-07-09 13:20:06 on dist-test-slave-078m"
I20260709 13:20:06.784416  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:06.796223  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:06.797816  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:06.849538  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:37053
I20260709 13:20:06.849654 18798 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:37053 every 8 connection(s)
I20260709 13:20:06.854018 18799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:06.867487 18799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3: Bootstrap starting.
I20260709 13:20:06.874336 18799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:06.879860 18799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3: No bootstrap required, opened a new log
I20260709 13:20:06.882506 18799 raft_consensus.cc:359] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13b625b955b4993a5f7a0b539c406c3" member_type: VOTER }
I20260709 13:20:06.882936 18799 raft_consensus.cc:385] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:06.883119 18799 raft_consensus.cc:740] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13b625b955b4993a5f7a0b539c406c3, State: Initialized, Role: FOLLOWER
I20260709 13:20:06.883620 18799 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13b625b955b4993a5f7a0b539c406c3" member_type: VOTER }
I20260709 13:20:06.884121 18799 raft_consensus.cc:399] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:06.884326 18799 raft_consensus.cc:493] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:06.884543 18799 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:06.890630 18799 raft_consensus.cc:515] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13b625b955b4993a5f7a0b539c406c3" member_type: VOTER }
I20260709 13:20:06.891219 18799 leader_election.cc:304] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c13b625b955b4993a5f7a0b539c406c3; no voters: 
I20260709 13:20:06.892514 18799 leader_election.cc:290] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:06.893005 18802 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:06.894564 18802 raft_consensus.cc:697] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 1 LEADER]: Becoming Leader. State: Replica: c13b625b955b4993a5f7a0b539c406c3, State: Running, Role: LEADER
I20260709 13:20:06.895422 18802 consensus_queue.cc:237] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13b625b955b4993a5f7a0b539c406c3" member_type: VOTER }
I20260709 13:20:06.895704 18799 sys_catalog.cc:565] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:06.898236 18804 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c13b625b955b4993a5f7a0b539c406c3. Latest consensus state: current_term: 1 leader_uuid: "c13b625b955b4993a5f7a0b539c406c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13b625b955b4993a5f7a0b539c406c3" member_type: VOTER } }
I20260709 13:20:06.898998 18804 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:06.899794 18803 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c13b625b955b4993a5f7a0b539c406c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13b625b955b4993a5f7a0b539c406c3" member_type: VOTER } }
I20260709 13:20:06.900660 18803 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:06.906785 18807 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:06.912823 18807 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:06.914775  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:06.925031 18807 catalog_manager.cc:1383] Generated new cluster ID: 786e820f19cf463892c0990b270cdfc8
I20260709 13:20:06.925364 18807 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:06.963436 18807 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:06.964927 18807 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:06.980966 18807 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3: Generated new TSK 0
I20260709 13:20:06.981650 18807 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:07.046468  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:07.053943 18820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:07.054709 18821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:07.062594  7657 server_base.cc:1061] running on GCE node
W20260709 13:20:07.062551 18823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:07.064239  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:07.064450  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:07.064584  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603207064572 us; error 0 us; skew 500 ppm
I20260709 13:20:07.065219  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:07.067926  7657 webserver.cc:533] Webserver started at http://127.7.122.65:35595/ using document root <none> and password file <none>
I20260709 13:20:07.068622  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:07.068835  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:07.069178  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:07.070559  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "63afc17fdaf044d7852e2c262003fb9e"
format_stamp: "Formatted at 2026-07-09 13:20:07 on dist-test-slave-078m"
I20260709 13:20:07.075593  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:20:07.079668 18828 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.080680  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:07.081224  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "63afc17fdaf044d7852e2c262003fb9e"
format_stamp: "Formatted at 2026-07-09 13:20:07 on dist-test-slave-078m"
I20260709 13:20:07.081569  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:07.098556  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:07.100018  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:07.102123  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:07.104830  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:07.105182  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:20:07.105506  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:07.105718  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.155556  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:41063
I20260709 13:20:07.155686 18890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:41063 every 8 connection(s)
I20260709 13:20:07.161264  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:07.170536 18895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:07.171815 18896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:07.177579 18898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:07.178598  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:07.178874 18891 heartbeater.cc:344] Connected to a master server at 127.7.122.126:37053
I20260709 13:20:07.179316 18891 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:07.180356 18891 heartbeater.cc:507] Master 127.7.122.126:37053 requested a full tablet report, sending...
I20260709 13:20:07.180721  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:07.181079  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:07.181293  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603207181272 us; error 0 us; skew 500 ppm
I20260709 13:20:07.182003  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:07.183790 18764 ts_manager.cc:194] Registered new tserver with Master: 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063)
I20260709 13:20:07.185146  7657 webserver.cc:533] Webserver started at http://127.7.122.66:40647/ using document root <none> and password file <none>
I20260709 13:20:07.185781  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:07.186010  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:07.186286  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:07.186364 18764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53460
I20260709 13:20:07.187855  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "828ccfa7cf7644b78530b20a826fff1f"
format_stamp: "Formatted at 2026-07-09 13:20:07 on dist-test-slave-078m"
I20260709 13:20:07.193290  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:20:07.197732 18903 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.198799  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:20:07.199134  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "828ccfa7cf7644b78530b20a826fff1f"
format_stamp: "Formatted at 2026-07-09 13:20:07 on dist-test-slave-078m"
I20260709 13:20:07.199465  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:07.216194  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:07.218428  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:07.220168  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:07.222816  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:07.223268  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.223554  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:07.223738  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.276046  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:38141
I20260709 13:20:07.276206 18965 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:38141 every 8 connection(s)
I20260709 13:20:07.281435  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:07.290123 18969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:07.292532 18970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:07.296226 18972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:07.297503 18966 heartbeater.cc:344] Connected to a master server at 127.7.122.126:37053
I20260709 13:20:07.297559  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:07.298013 18966 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:07.298784  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:07.298862 18966 heartbeater.cc:507] Master 127.7.122.126:37053 requested a full tablet report, sending...
W20260709 13:20:07.299158  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:07.299444  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603207299414 us; error 0 us; skew 500 ppm
I20260709 13:20:07.300148  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:07.301813 18764 ts_manager.cc:194] Registered new tserver with Master: 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:07.303447  7657 webserver.cc:533] Webserver started at http://127.7.122.67:41467/ using document root <none> and password file <none>
I20260709 13:20:07.303579 18764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53462
I20260709 13:20:07.304034  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:07.304255  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:07.304502  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:07.305932  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "3fa6859faad5468999f2458aa6ead888"
format_stamp: "Formatted at 2026-07-09 13:20:07 on dist-test-slave-078m"
I20260709 13:20:07.311038  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:20:07.315163 18977 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.316087  7657 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:20:07.316483  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "3fa6859faad5468999f2458aa6ead888"
format_stamp: "Formatted at 2026-07-09 13:20:07 on dist-test-slave-078m"
I20260709 13:20:07.316776  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:07.341966  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:07.343357  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:07.345140  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:07.347893  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:07.348380  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260709 13:20:07.348685  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:07.348894  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:07.405539  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:34975
I20260709 13:20:07.405840 19039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:34975 every 8 connection(s)
I20260709 13:20:07.426782 19040 heartbeater.cc:344] Connected to a master server at 127.7.122.126:37053
I20260709 13:20:07.427269 19040 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:07.428016 19040 heartbeater.cc:507] Master 127.7.122.126:37053 requested a full tablet report, sending...
I20260709 13:20:07.430188 18764 ts_manager.cc:194] Registered new tserver with Master: 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:07.430703  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021337077s
I20260709 13:20:07.432433 18764 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53472
I20260709 13:20:07.462160 18764 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53488:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:07.465291 18764 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:07.551661 18931 tablet_service.cc:1511] Processing CreateTablet for tablet 65992451110d467e96a2454589815604 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:07.553444 18931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65992451110d467e96a2454589815604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.554946 19005 tablet_service.cc:1511] Processing CreateTablet for tablet 65992451110d467e96a2454589815604 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:07.556553 19005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65992451110d467e96a2454589815604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.558204 19004 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb85dd452d5432e9589e26edf1e26ea (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:07.559806 19004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb85dd452d5432e9589e26edf1e26ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.559618 19003 tablet_service.cc:1511] Processing CreateTablet for tablet 51a163032e7f4ca3adb801438b519f39 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:07.556568 19002 tablet_service.cc:1511] Processing CreateTablet for tablet bedcb1bc48ff41469d97febe85f27c11 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:07.561771 19003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a163032e7f4ca3adb801438b519f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.562894 19001 tablet_service.cc:1511] Processing CreateTablet for tablet df19c0634c8348dc9800213636a5830d (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:07.564462 19001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df19c0634c8348dc9800213636a5830d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.566766 19000 tablet_service.cc:1511] Processing CreateTablet for tablet d14a33a7dbc24cb299fae92678e0a603 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:07.568638 19000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14a33a7dbc24cb299fae92678e0a603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.570461 19002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedcb1bc48ff41469d97febe85f27c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.582070 18930 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb85dd452d5432e9589e26edf1e26ea (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:07.585752 18928 tablet_service.cc:1511] Processing CreateTablet for tablet bedcb1bc48ff41469d97febe85f27c11 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:07.586982 18999 tablet_service.cc:1511] Processing CreateTablet for tablet 0c297d5dfdd14eba90455d4edd43a1b3 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:07.589171 18999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c297d5dfdd14eba90455d4edd43a1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.589607 18927 tablet_service.cc:1511] Processing CreateTablet for tablet df19c0634c8348dc9800213636a5830d (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:07.580163 18929 tablet_service.cc:1511] Processing CreateTablet for tablet 51a163032e7f4ca3adb801438b519f39 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:07.592034 18930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb85dd452d5432e9589e26edf1e26ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.593261 18929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a163032e7f4ca3adb801438b519f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.597616 18927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df19c0634c8348dc9800213636a5830d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.605581 18928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedcb1bc48ff41469d97febe85f27c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.617074 18998 tablet_service.cc:1511] Processing CreateTablet for tablet 648b04d1c1a24441af383a0b31f07b27 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:07.618728 18998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648b04d1c1a24441af383a0b31f07b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.640733 18927 tablet_service.cc:1511] Processing CreateTablet for tablet d14a33a7dbc24cb299fae92678e0a603 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:07.642266 19055 tablet_bootstrap.cc:492] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:07.642956 18927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14a33a7dbc24cb299fae92678e0a603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.656793 18926 tablet_service.cc:1511] Processing CreateTablet for tablet 0c297d5dfdd14eba90455d4edd43a1b3 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:07.658592 18926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c297d5dfdd14eba90455d4edd43a1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.660367 18856 tablet_service.cc:1511] Processing CreateTablet for tablet 65992451110d467e96a2454589815604 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:07.660568 18855 tablet_service.cc:1511] Processing CreateTablet for tablet 7cb85dd452d5432e9589e26edf1e26ea (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:07.661942 18856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65992451110d467e96a2454589815604. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.662691 18855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7cb85dd452d5432e9589e26edf1e26ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.664280 18925 tablet_service.cc:1511] Processing CreateTablet for tablet 648b04d1c1a24441af383a0b31f07b27 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:07.667227 19004 tablet_service.cc:1511] Processing CreateTablet for tablet 390b07da8c78438aa4284db4e3a833b3 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:07.669061 18925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648b04d1c1a24441af383a0b31f07b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.669912 18854 tablet_service.cc:1511] Processing CreateTablet for tablet 51a163032e7f4ca3adb801438b519f39 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:07.671451 18854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51a163032e7f4ca3adb801438b519f39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.680260 19055 tablet_bootstrap.cc:654] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.683068 18853 tablet_service.cc:1511] Processing CreateTablet for tablet bedcb1bc48ff41469d97febe85f27c11 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:07.684568 18853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bedcb1bc48ff41469d97febe85f27c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.695026 18852 tablet_service.cc:1511] Processing CreateTablet for tablet df19c0634c8348dc9800213636a5830d (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:07.669111 19004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390b07da8c78438aa4284db4e3a833b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.697814 18852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df19c0634c8348dc9800213636a5830d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.701520 18931 tablet_service.cc:1511] Processing CreateTablet for tablet 390b07da8c78438aa4284db4e3a833b3 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:07.702978 18931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390b07da8c78438aa4284db4e3a833b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.706034 18849 tablet_service.cc:1511] Processing CreateTablet for tablet 648b04d1c1a24441af383a0b31f07b27 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:07.707237 18850 tablet_service.cc:1511] Processing CreateTablet for tablet 0c297d5dfdd14eba90455d4edd43a1b3 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:07.709254 18848 tablet_service.cc:1511] Processing CreateTablet for tablet 390b07da8c78438aa4284db4e3a833b3 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:07.706034 18851 tablet_service.cc:1511] Processing CreateTablet for tablet d14a33a7dbc24cb299fae92678e0a603 (DEFAULT_TABLE table=test-workload [id=ed6c4cbdd6614dcf8042d6966007d3bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:07.707691 18849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 648b04d1c1a24441af383a0b31f07b27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.715423 18850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c297d5dfdd14eba90455d4edd43a1b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.726553 18851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14a33a7dbc24cb299fae92678e0a603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.729302 18848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390b07da8c78438aa4284db4e3a833b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:07.734972 19056 tablet_bootstrap.cc:492] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:07.751982 19058 tablet_bootstrap.cc:492] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:07.754086 19055 tablet_bootstrap.cc:492] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:07.755049 19055 ts_tablet_manager.cc:1403] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.007s
I20260709 13:20:07.758114 19055 raft_consensus.cc:359] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:07.758755 19058 tablet_bootstrap.cc:654] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.786235 19055 raft_consensus.cc:385] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.786765 19055 raft_consensus.cc:740] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.787565 19055 consensus_queue.cc:260] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:07.789994 18966 heartbeater.cc:499] Master 127.7.122.126:37053 was elected leader, sending a full tablet report...
I20260709 13:20:07.790515 19055 ts_tablet_manager.cc:1434] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.035s	user 0.011s	sys 0.026s
I20260709 13:20:07.791615 19055 tablet_bootstrap.cc:492] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:07.799134 19055 tablet_bootstrap.cc:654] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.800941 19056 tablet_bootstrap.cc:654] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.830155 19055 tablet_bootstrap.cc:492] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:07.832085 19058 tablet_bootstrap.cc:492] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:07.837347 19058 ts_tablet_manager.cc:1403] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.026s
I20260709 13:20:07.837347 19055 ts_tablet_manager.cc:1403] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.014s
I20260709 13:20:07.840745 19055 raft_consensus.cc:359] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.841552 19055 raft_consensus.cc:385] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.841842 19055 raft_consensus.cc:740] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.842605 19058 raft_consensus.cc:359] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.843282 19058 raft_consensus.cc:385] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.842658 19055 consensus_queue.cc:260] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.843624 19058 raft_consensus.cc:740] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.844385 19058 consensus_queue.cc:260] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.845240 19055 ts_tablet_manager.cc:1434] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:20:07.846352 19055 tablet_bootstrap.cc:492] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:07.849339 18891 heartbeater.cc:499] Master 127.7.122.126:37053 was elected leader, sending a full tablet report...
I20260709 13:20:07.849727 19058 ts_tablet_manager.cc:1434] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:20:07.851531 19058 tablet_bootstrap.cc:492] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:07.853715 19055 tablet_bootstrap.cc:654] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.859871 19056 tablet_bootstrap.cc:492] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:07.860630 19056 ts_tablet_manager.cc:1403] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.126s	user 0.005s	sys 0.009s
I20260709 13:20:07.865021 19056 raft_consensus.cc:359] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:07.865758 19056 raft_consensus.cc:385] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.866065 19056 raft_consensus.cc:740] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.868361 19058 tablet_bootstrap.cc:654] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.869051 19055 tablet_bootstrap.cc:492] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:07.869671 19055 ts_tablet_manager.cc:1403] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 13:20:07.869179 19056 consensus_queue.cc:260] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:07.873129 19040 heartbeater.cc:499] Master 127.7.122.126:37053 was elected leader, sending a full tablet report...
I20260709 13:20:07.873696 19055 raft_consensus.cc:359] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.874537 19055 raft_consensus.cc:385] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.874699 19056 ts_tablet_manager.cc:1434] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:20:07.874850 19055 raft_consensus.cc:740] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.876173 19056 tablet_bootstrap.cc:492] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:07.876194 19055 consensus_queue.cc:260] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.879412 19055 ts_tablet_manager.cc:1434] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:20:07.880632 19055 tablet_bootstrap.cc:492] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:07.883424 19056 tablet_bootstrap.cc:654] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.888562 19055 tablet_bootstrap.cc:654] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.895486 19058 tablet_bootstrap.cc:492] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:07.896076 19058 ts_tablet_manager.cc:1403] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.001s
I20260709 13:20:07.896153 19056 tablet_bootstrap.cc:492] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:07.896976 19056 ts_tablet_manager.cc:1403] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:20:07.899688 19058 raft_consensus.cc:359] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:07.900684 19058 raft_consensus.cc:385] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.901058 19058 raft_consensus.cc:740] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.901585 19056 raft_consensus.cc:359] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.902122 19058 consensus_queue.cc:260] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:07.902763 19056 raft_consensus.cc:385] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.904780 19058 ts_tablet_manager.cc:1434] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:20:07.906085 19058 tablet_bootstrap.cc:492] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:07.907042 19056 raft_consensus.cc:740] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.908735 19056 consensus_queue.cc:260] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.912595 19056 ts_tablet_manager.cc:1434] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
W20260709 13:20:07.913450 18812 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:07.913744 19058 tablet_bootstrap.cc:654] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.914211 19056 tablet_bootstrap.cc:492] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:07.920109 19055 tablet_bootstrap.cc:492] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:07.920830 19055 ts_tablet_manager.cc:1403] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.019s
I20260709 13:20:07.924968 19055 raft_consensus.cc:359] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.925943 19055 raft_consensus.cc:385] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.926282 19055 raft_consensus.cc:740] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.926414 19056 tablet_bootstrap.cc:654] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.927309 19055 consensus_queue.cc:260] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.931185 19055 ts_tablet_manager.cc:1434] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:20:07.932135 19058 tablet_bootstrap.cc:492] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:07.932235 19055 tablet_bootstrap.cc:492] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:07.932835 19058 ts_tablet_manager.cc:1403] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:20:07.936440 19056 tablet_bootstrap.cc:492] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:07.936151 19058 raft_consensus.cc:359] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.937000 19058 raft_consensus.cc:385] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.937099 19056 ts_tablet_manager.cc:1403] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260709 13:20:07.937362 19058 raft_consensus.cc:740] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.938304 19058 consensus_queue.cc:260] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.940546 19056 raft_consensus.cc:359] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.941417 19056 raft_consensus.cc:385] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.941707 19056 raft_consensus.cc:740] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.942251 19058 ts_tablet_manager.cc:1434] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:20:07.943707 19058 tablet_bootstrap.cc:492] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:07.943296 19056 consensus_queue.cc:260] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.946401 19056 ts_tablet_manager.cc:1434] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:20:07.947650 19056 tablet_bootstrap.cc:492] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:07.952013 19058 tablet_bootstrap.cc:654] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.953639 19055 tablet_bootstrap.cc:654] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.955274 19056 tablet_bootstrap.cc:654] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.966238 19056 tablet_bootstrap.cc:492] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:07.966820 19056 ts_tablet_manager.cc:1403] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 13:20:07.967362 19058 tablet_bootstrap.cc:492] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:07.967919 19055 tablet_bootstrap.cc:492] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:07.968021 19058 ts_tablet_manager.cc:1403] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 13:20:07.968540 19055 ts_tablet_manager.cc:1403] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.008s
I20260709 13:20:07.970114 19056 raft_consensus.cc:359] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.970958 19056 raft_consensus.cc:385] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.971268 19056 raft_consensus.cc:740] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.971793 19058 raft_consensus.cc:359] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.971803 19055 raft_consensus.cc:359] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.972143 19056 consensus_queue.cc:260] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.972599 19058 raft_consensus.cc:385] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.972944 19055 raft_consensus.cc:385] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:07.973172 19058 raft_consensus.cc:740] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.973325 19055 raft_consensus.cc:740] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:07.974622 19056 ts_tablet_manager.cc:1434] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:07.974293 19058 consensus_queue.cc:260] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.974381 19055 consensus_queue.cc:260] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.975872 19056 tablet_bootstrap.cc:492] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:07.979460 19055 ts_tablet_manager.cc:1434] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:07.979941 19063 raft_consensus.cc:493] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:07.980881 19055 tablet_bootstrap.cc:492] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:07.980509 19063 raft_consensus.cc:515] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:07.983572 19063 leader_election.cc:290] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:07.983928 19056 tablet_bootstrap.cc:654] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:07.985482 19058 ts_tablet_manager.cc:1434] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:20:07.986613 19058 tablet_bootstrap.cc:492] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:07.996142 19058 tablet_bootstrap.cc:654] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.022450 19055 tablet_bootstrap.cc:654] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.023838 19056 tablet_bootstrap.cc:492] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:08.024631 19056 ts_tablet_manager.cc:1403] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.049s	user 0.020s	sys 0.023s
I20260709 13:20:08.029278 19056 raft_consensus.cc:359] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.030362 19056 raft_consensus.cc:385] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.033816 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.035204 19056 raft_consensus.cc:740] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.035799 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.033671 19058 tablet_bootstrap.cc:492] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:08.036306 19056 consensus_queue.cc:260] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.036834 18941 raft_consensus.cc:2468] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:08.037652 19058 ts_tablet_manager.cc:1403] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.018s
W20260709 13:20:08.037465 18832 leader_election.cc:343] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.038993 18831 leader_election.cc:304] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:08.039933 19063 raft_consensus.cc:2804] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.036813 19055 tablet_bootstrap.cc:492] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:08.040405 19063 raft_consensus.cc:493] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.040743 19055 ts_tablet_manager.cc:1403] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.011s
I20260709 13:20:08.041057 19063 raft_consensus.cc:3060] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.041810 19058 raft_consensus.cc:359] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.042632 19058 raft_consensus.cc:385] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.043149 19058 raft_consensus.cc:740] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.044094 19058 consensus_queue.cc:260] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.044711 19055 raft_consensus.cc:359] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.045662 19055 raft_consensus.cc:385] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.045969 19055 raft_consensus.cc:740] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.047075 19055 consensus_queue.cc:260] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.048256 19056 ts_tablet_manager.cc:1434] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:20:08.054054 19056 tablet_bootstrap.cc:492] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:08.054509 19055 ts_tablet_manager.cc:1434] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:20:08.056411 19055 tablet_bootstrap.cc:492] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:08.059993 19063 raft_consensus.cc:515] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.062724 19058 ts_tablet_manager.cc:1434] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 13:20:08.063769 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.064204 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:08.064560 18941 raft_consensus.cc:3060] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:08.066332 18832 leader_election.cc:343] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.067178 19063 leader_election.cc:290] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.071493 19056 tablet_bootstrap.cc:654] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.073398 19055 tablet_bootstrap.cc:654] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.073357 19065 raft_consensus.cc:493] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.074232 18941 raft_consensus.cc:2468] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:08.074204 19065 raft_consensus.cc:515] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:08.076036 18831 leader_election.cc:304] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:08.077425 19079 raft_consensus.cc:2804] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.077950 19079 raft_consensus.cc:697] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:08.078871 19079 consensus_queue.cc:237] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.080103 19065 leader_election.cc:290] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063)
I20260709 13:20:08.083093 19058 tablet_bootstrap.cc:492] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:08.096799 19058 tablet_bootstrap.cc:654] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.102422 19063 raft_consensus.cc:493] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.103905 19063 raft_consensus.cc:515] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.108170 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df19c0634c8348dc9800213636a5830d" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.108976 18941 raft_consensus.cc:2468] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:08.110460 19056 tablet_bootstrap.cc:492] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:08.110754 18831 leader_election.cc:304] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.111104 19056 ts_tablet_manager.cc:1403] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.004s
I20260709 13:20:08.113832 19087 raft_consensus.cc:2804] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.114935 19087 raft_consensus.cc:493] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.115525 19087 raft_consensus.cc:3060] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.115648 19063 leader_election.cc:290] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.114416 19058 tablet_bootstrap.cc:492] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:08.117673 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df19c0634c8348dc9800213636a5830d" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.119782 18761 catalog_manager.cc:5697] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:08.121527 18832 leader_election.cc:343] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.123529 19058 ts_tablet_manager.cc:1403] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.041s	user 0.026s	sys 0.001s
I20260709 13:20:08.132355 19056 raft_consensus.cc:359] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.133391 19056 raft_consensus.cc:385] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.133729 19056 raft_consensus.cc:740] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.132081 19058 raft_consensus.cc:359] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.136276 19058 raft_consensus.cc:385] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.137223 19058 raft_consensus.cc:740] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.138278 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.139132 18866 raft_consensus.cc:2468] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:08.141150 18980 leader_election.cc:304] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:08.141993 19065 raft_consensus.cc:2804] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.142356 19065 raft_consensus.cc:493] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.142706 19065 raft_consensus.cc:3060] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.142513 19058 consensus_queue.cc:260] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.146018 19059 raft_consensus.cc:493] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.146787 19058 ts_tablet_manager.cc:1434] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 13:20:08.146670 19059 raft_consensus.cc:515] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.148201 19058 tablet_bootstrap.cc:492] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:08.158416 19058 tablet_bootstrap.cc:654] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.161106 19065 raft_consensus.cc:515] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:08.160482 19059 leader_election.cc:290] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.162249 19055 tablet_bootstrap.cc:492] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:08.163179 19059 raft_consensus.cc:493] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.163439 19055 ts_tablet_manager.cc:1403] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.107s	user 0.045s	sys 0.041s
I20260709 13:20:08.163709 19059 raft_consensus.cc:515] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:08.165233 19065 leader_election.cc:290] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063)
I20260709 13:20:08.178547 19059 leader_election.cc:290] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975), 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063)
I20260709 13:20:08.184237 19087 raft_consensus.cc:515] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.170506 19056 consensus_queue.cc:260] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.187891 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:08.189034 18866 raft_consensus.cc:3060] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.190747 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df19c0634c8348dc9800213636a5830d" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.191704 18941 raft_consensus.cc:3060] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.187885 19056 ts_tablet_manager.cc:1434] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.002s
I20260709 13:20:08.195412 19055 raft_consensus.cc:359] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.196319 19055 raft_consensus.cc:385] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.196627 19055 raft_consensus.cc:740] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.197540 19055 consensus_queue.cc:260] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.200083 19055 ts_tablet_manager.cc:1434] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:20:08.201208 19055 tablet_bootstrap.cc:492] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:08.206094 19056 tablet_bootstrap.cc:492] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:08.208701 19055 tablet_bootstrap.cc:654] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.210654 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df19c0634c8348dc9800213636a5830d" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
W20260709 13:20:08.214619 18832 leader_election.cc:343] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.212493 19087 leader_election.cc:290] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.215796 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.216558 18939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.216948 18940 raft_consensus.cc:2468] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:08.222445 19059 raft_consensus.cc:493] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.223301 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.223205 19059 raft_consensus.cc:515] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.225904 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.227628 19059 leader_election.cc:290] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.228461 18866 raft_consensus.cc:2468] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:08.228554 19090 raft_consensus.cc:493] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.229378 19090 raft_consensus.cc:515] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.230748 18980 leader_election.cc:304] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:08.232278 19065 raft_consensus.cc:493] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.235184 18906 leader_election.cc:343] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.235879 19065 raft_consensus.cc:515] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.240609 19058 tablet_bootstrap.cc:492] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:08.242094 19058 ts_tablet_manager.cc:1403] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.023s
I20260709 13:20:08.244210 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.222574 18941 raft_consensus.cc:2468] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:08.245081 18865 raft_consensus.cc:2468] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:08.244982 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.245748 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.246366 19014 raft_consensus.cc:2393] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 828ccfa7cf7644b78530b20a826fff1f in current term 1: Already voted for candidate 3fa6859faad5468999f2458aa6ead888 in this term.
I20260709 13:20:08.246538 19013 raft_consensus.cc:2468] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:08.246977 19095 raft_consensus.cc:2804] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.247462 19090 leader_election.cc:290] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.247016 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.248466 18831 leader_election.cc:304] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:08.249765 18907 leader_election.cc:304] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.245240 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.251142 19090 raft_consensus.cc:3060] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.251165 18907 leader_election.cc:304] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.245191 19056 tablet_bootstrap.cc:654] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.254341 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.255335 19013 raft_consensus.cc:2468] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:08.255029 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.240725 19065 leader_election.cc:290] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:08.257324 19087 raft_consensus.cc:2804] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.258131 19059 raft_consensus.cc:2804] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.261574 19087 raft_consensus.cc:697] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:08.262192 19059 raft_consensus.cc:493] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.262837 19059 raft_consensus.cc:3060] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.262918 19087 consensus_queue.cc:237] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
W20260709 13:20:08.265293 18980 leader_election.cc:343] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.266494 18906 leader_election.cc:304] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.261524 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
W20260709 13:20:08.268626 18907 leader_election.cc:343] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:08.268752 18980 leader_election.cc:343] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.269315 18907 leader_election.cc:304] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.269842 18980 leader_election.cc:304] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888; no voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:08.273092 19065 raft_consensus.cc:2749] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.273696 19055 tablet_bootstrap.cc:492] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:08.259990 19058 raft_consensus.cc:359] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.274612 19058 raft_consensus.cc:385] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.274336 19055 ts_tablet_manager.cc:1403] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.009s
I20260709 13:20:08.279161 19058 raft_consensus.cc:740] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.280316 19058 consensus_queue.cc:260] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.281831 19059 raft_consensus.cc:515] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.287127 19059 leader_election.cc:290] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.287664 19059 raft_consensus.cc:2749] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.278658 19100 raft_consensus.cc:2804] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.282220 19055 raft_consensus.cc:359] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.288276 19100 raft_consensus.cc:493] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.276973 19090 raft_consensus.cc:2749] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.288719 19100 raft_consensus.cc:3060] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.288365 19055 raft_consensus.cc:385] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.289319 19055 raft_consensus.cc:740] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.290406 19055 consensus_queue.cc:260] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.293303 19055 ts_tablet_manager.cc:1434] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:20:08.290972 18761 catalog_manager.cc:5697] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.296339 19100 raft_consensus.cc:515] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.296636 19065 raft_consensus.cc:493] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.297366 19065 raft_consensus.cc:515] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.298527 19100 leader_election.cc:290] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.285131 19058 ts_tablet_manager.cc:1434] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:20:08.299932 19058 tablet_bootstrap.cc:492] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:08.300191 19065 leader_election.cc:290] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:08.301397 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.302147 18866 raft_consensus.cc:2468] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:08.303866 18980 leader_election.cc:304] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:08.305375 19065 raft_consensus.cc:2804] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.305970 19065 raft_consensus.cc:493] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.306370 19065 raft_consensus.cc:3060] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.307866 19058 tablet_bootstrap.cc:654] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:08.315176 18906 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.65:41063, user_credentials={real_user=slave}} blocked reactor thread for 48788.6us
I20260709 13:20:08.307451 19055 tablet_bootstrap.cc:492] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
W20260709 13:20:08.316355 18906 leader_election.cc:343] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.318722 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:08.324939 19055 tablet_bootstrap.cc:654] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.328150 19065 raft_consensus.cc:515] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.338932 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:08.339929 18866 raft_consensus.cc:3060] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.344365 19100 raft_consensus.cc:493] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.345420 19100 raft_consensus.cc:515] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.348459 19100 leader_election.cc:290] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.350670 19065 leader_election.cc:290] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:08.355605 18866 raft_consensus.cc:2468] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:08.359076 19055 tablet_bootstrap.cc:492] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:08.359866 19087 raft_consensus.cc:493] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:08.360184 18907 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.67:34975, user_credentials={real_user=slave}} blocked reactor thread for 91617.3us
I20260709 13:20:08.361157 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:08.361395 18864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.361737 19087 raft_consensus.cc:515] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.362111 18865 raft_consensus.cc:3060] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.364379 19087 leader_election.cc:290] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.365176 19055 ts_tablet_manager.cc:1403] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.000s
I20260709 13:20:08.368579 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.368927 18980 leader_election.cc:304] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:08.367425 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.370831 18941 raft_consensus.cc:2468] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
W20260709 13:20:08.371506 18832 leader_election.cc:343] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.372965 18864 raft_consensus.cc:2393] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 828ccfa7cf7644b78530b20a826fff1f in current term 1: Already voted for candidate 3fa6859faad5468999f2458aa6ead888 in this term.
I20260709 13:20:08.372809 19087 raft_consensus.cc:493] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.361336 19095 raft_consensus.cc:697] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:08.373821 19087 raft_consensus.cc:515] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.375092 19095 consensus_queue.cc:237] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:08.378824 19055 raft_consensus.cc:359] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.379717 19055 raft_consensus.cc:385] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.380079 19055 raft_consensus.cc:740] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.379783 18831 leader_election.cc:304] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:08.383590 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.384549 18941 raft_consensus.cc:2468] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:08.385879 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.387192 19014 raft_consensus.cc:2393] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 828ccfa7cf7644b78530b20a826fff1f in current term 1: Already voted for candidate 3fa6859faad5468999f2458aa6ead888 in this term.
I20260709 13:20:08.384294 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
W20260709 13:20:08.359179 18906 leader_election.cc:343] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.388944 19015 raft_consensus.cc:3060] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.390017 19056 tablet_bootstrap.cc:492] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:08.390569 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.390594 19056 ts_tablet_manager.cc:1403] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.185s	user 0.024s	sys 0.036s
I20260709 13:20:08.391288 18941 raft_consensus.cc:3060] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.395005 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:08.395968 19056 raft_consensus.cc:359] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.396606 19013 raft_consensus.cc:3060] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.397713 18907 leader_election.cc:304] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.398708 19055 consensus_queue.cc:260] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.398940 19079 raft_consensus.cc:2804] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.399719 19079 raft_consensus.cc:493] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.400190 19079 raft_consensus.cc:3060] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.405361 19013 raft_consensus.cc:2468] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:08.396783 19056 raft_consensus.cc:385] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.407181 18939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.407191 19056 raft_consensus.cc:740] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.408244 18939 raft_consensus.cc:2468] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:08.409556 19055 ts_tablet_manager.cc:1434] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:20:08.409442 19056 consensus_queue.cc:260] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.410785 18831 leader_election.cc:304] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.412046 19065 raft_consensus.cc:2804] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.413993 19063 raft_consensus.cc:2804] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.414531 19063 raft_consensus.cc:493] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.414927 19063 raft_consensus.cc:3060] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.416090 19087 leader_election.cc:290] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.427117 19063 raft_consensus.cc:515] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.428618 18907 leader_election.cc:304] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.414939 18941 raft_consensus.cc:2468] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:08.411055 18865 raft_consensus.cc:2468] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:08.412109 19056 ts_tablet_manager.cc:1434] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.001s
I20260709 13:20:08.431315 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.433010 19101 raft_consensus.cc:2749] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:08.433398 18832 leader_election.cc:343] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.433707 19056 tablet_bootstrap.cc:492] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:08.435149 19015 raft_consensus.cc:2468] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:08.443677 19058 tablet_bootstrap.cc:492] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:08.444643 19058 ts_tablet_manager.cc:1403] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.145s	user 0.051s	sys 0.074s
I20260709 13:20:08.445138 18906 leader_election.cc:304] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.437387 19101 raft_consensus.cc:2804] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.449100 19100 raft_consensus.cc:2804] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.449575 19101 raft_consensus.cc:697] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:08.449735 19100 raft_consensus.cc:697] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:08.450548 19101 consensus_queue.cc:237] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.451722 19063 leader_election.cc:290] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.448920 19058 raft_consensus.cc:359] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.452629 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:08.453049 19058 raft_consensus.cc:385] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.450614 19100 consensus_queue.cc:237] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.453073 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.456442 19058 raft_consensus.cc:740] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.455201 19065 raft_consensus.cc:697] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
W20260709 13:20:08.454962 18832 leader_election.cc:343] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.457638 19058 consensus_queue.cc:260] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.454258 18762 catalog_manager.cc:5697] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.458335 19065 consensus_queue.cc:237] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.455008 19079 raft_consensus.cc:515] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.454228 18941 raft_consensus.cc:3060] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.469408 19058 ts_tablet_manager.cc:1434] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.006s
I20260709 13:20:08.471028 19058 tablet_bootstrap.cc:492] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:08.488647 19058 tablet_bootstrap.cc:654] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.493359 18939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.494278 18939 raft_consensus.cc:3060] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.502054 19063 consensus_queue.cc:1048] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.503208 19056 tablet_bootstrap.cc:654] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.520589 19079 leader_election.cc:290] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.520186 18939 raft_consensus.cc:2468] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:08.526505 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:08.526597 19100 raft_consensus.cc:493] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.531283 19015 raft_consensus.cc:3060] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.534514 18831 leader_election.cc:304] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.534816 19100 raft_consensus.cc:515] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.537524 19058 tablet_bootstrap.cc:492] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:08.538231 19058 ts_tablet_manager.cc:1403] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.010s
I20260709 13:20:08.539335 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.539633 19100 leader_election.cc:290] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.540824 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.541656 19013 raft_consensus.cc:2468] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:08.543100 18907 leader_election.cc:304] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
W20260709 13:20:08.543689 18906 leader_election.cc:343] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:08.544709 19058 raft_consensus.cc:359] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.545477 19058 raft_consensus.cc:385] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.545779 19058 raft_consensus.cc:740] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.544807 19100 raft_consensus.cc:2804] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:08.544106 18761 catalog_manager.cc:5697] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 1 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.546499 19058 consensus_queue.cc:260] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.547202 19100 raft_consensus.cc:493] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:08.546066 19079 raft_consensus.cc:2804] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.552222 19100 raft_consensus.cc:3060] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.550017 19065 raft_consensus.cc:493] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.555182 19058 ts_tablet_manager.cc:1434] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.001s
I20260709 13:20:08.553964 19079 raft_consensus.cc:697] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:08.556186 19065 raft_consensus.cc:515] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.557044 19015 raft_consensus.cc:2468] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:08.558365 19065 leader_election.cc:290] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:08.561031 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.560798 18761 catalog_manager.cc:5697] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 1 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.561007 18941 raft_consensus.cc:2468] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:08.564569 18831 leader_election.cc:304] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:08.551723 18762 catalog_manager.cc:5697] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:08.565652 19087 raft_consensus.cc:2804] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.567550 19087 raft_consensus.cc:697] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:08.556777 19079 consensus_queue.cc:237] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.568627 19087 consensus_queue.cc:237] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.564630 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.579936 18980 leader_election.cc:304] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888; no voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:08.581225 19065 raft_consensus.cc:2749] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.582023 19015 raft_consensus.cc:3060] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.603497 19087 consensus_queue.cc:1048] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.606536 19100 raft_consensus.cc:515] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.621524 19087 raft_consensus.cc:493] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.622954 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:08.623399 19100 leader_election.cc:290] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.622179 19087 raft_consensus.cc:515] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.625691 18865 raft_consensus.cc:3060] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.627803 19056 tablet_bootstrap.cc:492] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:08.628368 19056 ts_tablet_manager.cc:1403] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.195s	user 0.039s	sys 0.023s
I20260709 13:20:08.630484 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:08.631151 19015 raft_consensus.cc:3060] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.631181 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.629856 19087 leader_election.cc:290] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.633512 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "648b04d1c1a24441af383a0b31f07b27" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.634493 18941 raft_consensus.cc:2393] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63afc17fdaf044d7852e2c262003fb9e in current term 1: Already voted for candidate 828ccfa7cf7644b78530b20a826fff1f in this term.
I20260709 13:20:08.635880 18831 leader_election.cc:304] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e; no voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:08.637974 19056 raft_consensus.cc:359] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.638842 19056 raft_consensus.cc:385] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.639137 19056 raft_consensus.cc:740] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.639750 19056 consensus_queue.cc:260] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.641106 18865 raft_consensus.cc:2468] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:08.641733 19087 raft_consensus.cc:2749] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.643644 18906 leader_election.cc:304] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:08.644515 19056 ts_tablet_manager.cc:1434] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:20:08.645615 19056 tablet_bootstrap.cc:492] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:08.648627 19015 raft_consensus.cc:2468] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:08.651691 19056 tablet_bootstrap.cc:654] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:08.653074 19100 raft_consensus.cc:2804] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:08.654373 19100 raft_consensus.cc:697] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:08.655040 19100 consensus_queue.cc:237] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.656080 18762 catalog_manager.cc:5697] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.669809 19056 tablet_bootstrap.cc:492] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:08.670404 19056 ts_tablet_manager.cc:1403] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 13:20:08.673338 19056 raft_consensus.cc:359] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.674125 19056 raft_consensus.cc:385] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:08.674415 19056 raft_consensus.cc:740] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:08.675132 19056 consensus_queue.cc:260] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.678071 19056 ts_tablet_manager.cc:1434] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:08.679574 18761 catalog_manager.cc:5697] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 1 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.683508 18764 catalog_manager.cc:5697] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:08.685438 19079 consensus_queue.cc:1048] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.691357 19013 raft_consensus.cc:3060] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.703752 19079 consensus_queue.cc:1048] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:08.722086 19079 raft_consensus.cc:493] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.722543 19079 raft_consensus.cc:515] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.724694 19079 leader_election.cc:290] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.725540 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.725867 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:08.726811 19013 raft_consensus.cc:2393] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63afc17fdaf044d7852e2c262003fb9e in current term 1: Already voted for candidate 828ccfa7cf7644b78530b20a826fff1f in this term.
I20260709 13:20:08.727941 18832 leader_election.cc:304] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e; no voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:08.728794 19079 raft_consensus.cc:3060] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.734926 19079 raft_consensus.cc:2749] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.818583 19065 raft_consensus.cc:493] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:08.819229 19065 raft_consensus.cc:515] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.821242 19065 leader_election.cc:290] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:08.822746 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:08.823004 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:08.823896 18941 raft_consensus.cc:2393] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fa6859faad5468999f2458aa6ead888 in current term 1: Already voted for candidate 63afc17fdaf044d7852e2c262003fb9e in this term.
I20260709 13:20:08.825382 18980 leader_election.cc:304] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888; no voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:08.826133 19065 raft_consensus.cc:3060] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:08.834532 19065 raft_consensus.cc:2749] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:08.834669 19106 consensus_queue.cc:1048] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.852324 19065 consensus_queue.cc:1048] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:08.887836 19100 consensus_queue.cc:1048] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.903501 19100 consensus_queue.cc:1048] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.907373 19015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65992451110d467e96a2454589815604"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
mode: GRACEFUL
new_leader_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:39582
I20260709 13:20:08.908435 19015 raft_consensus.cc:606] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Received request to transfer leadership to TS 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.918560 19065 consensus_queue.cc:1048] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.918702 19015 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
mode: GRACEFUL
new_leader_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:39582
I20260709 13:20:08.919642 19015 raft_consensus.cc:606] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Received request to transfer leadership to TS 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.946177 19106 raft_consensus.cc:993] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: : Instructing follower 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:08.946795 19106 raft_consensus.cc:1081] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Signalling peer 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:08.949185 18866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:45184
I20260709 13:20:08.951560 18866 raft_consensus.cc:493] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:08.953836 19106 consensus_queue.cc:1048] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.954948 18866 raft_consensus.cc:3060] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.958951 18940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
mode: GRACEFUL
new_leader_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:42024
I20260709 13:20:08.959605 18940 raft_consensus.cc:606] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Received request to transfer leadership to TS 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:08.967722 18866 raft_consensus.cc:515] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:08.969110 19079 consensus_queue.cc:1048] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:08.990217 18866 leader_election.cc:290] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:08.992319 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:08.993597 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7cb85dd452d5432e9589e26edf1e26ea" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:08.994057 18941 raft_consensus.cc:3060] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:08.994362 19015 raft_consensus.cc:3055] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:08.995021 19015 raft_consensus.cc:740] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:09.001473 19079 consensus_queue.cc:1048] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:08.996320 19015 consensus_queue.cc:260] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.004117 19015 raft_consensus.cc:3060] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.004832 18866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df19c0634c8348dc9800213636a5830d"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:09.005946 18866 raft_consensus.cc:606] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:09.007831 19100 consensus_queue.cc:1048] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:09.011098 18941 raft_consensus.cc:2468] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:09.015077 18831 leader_election.cc:304] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:09.018507 19063 raft_consensus.cc:2804] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.019091 19063 raft_consensus.cc:697] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:09.021725 19015 raft_consensus.cc:2468] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:09.022615 18866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:09.023408 18866 raft_consensus.cc:606] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:09.019929 19063 consensus_queue.cc:237] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.030194 19100 consensus_queue.cc:1048] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:09.044201 18865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:09.045068 18865 raft_consensus.cc:606] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:09.047407 18764 catalog_manager.cc:5697] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 1 to 2, leader changed from 3fa6859faad5468999f2458aa6ead888 (127.7.122.67) to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 2 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.066793 19101 consensus_queue.cc:1048] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:09.070721 19090 raft_consensus.cc:993] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: : Instructing follower 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:09.071194 19090 raft_consensus.cc:1081] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Signalling peer 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:09.073336 18864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:45188
I20260709 13:20:09.073997 18864 raft_consensus.cc:493] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.074398 18864 raft_consensus.cc:3060] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.081634 19090 consensus_queue.cc:1048] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:09.083249 18864 raft_consensus.cc:515] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.086338 18864 leader_election.cc:290] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:09.087898 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:09.088527 19014 raft_consensus.cc:3060] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.087684 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bedcb1bc48ff41469d97febe85f27c11" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:09.089247 18940 raft_consensus.cc:3055] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.089577 18940 raft_consensus.cc:740] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:09.090400 18940 consensus_queue.cc:260] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.091581 18940 raft_consensus.cc:3060] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.091702 19063 raft_consensus.cc:993] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:09.092377 19079 raft_consensus.cc:1081] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:09.094823 18941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df19c0634c8348dc9800213636a5830d"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:42002
I20260709 13:20:09.095691 18941 raft_consensus.cc:493] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.096191 18941 raft_consensus.cc:3060] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.102638 19014 raft_consensus.cc:2468] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:09.104688 18832 leader_election.cc:304] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:09.105954 19063 raft_consensus.cc:2804] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.106769 19063 raft_consensus.cc:697] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:09.107744 19063 consensus_queue.cc:237] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.113210 18941 raft_consensus.cc:515] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.114845 18866 raft_consensus.cc:1240] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Rejecting Update request from peer 828ccfa7cf7644b78530b20a826fff1f for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:09.118537 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df19c0634c8348dc9800213636a5830d" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:09.119302 18865 raft_consensus.cc:3055] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.119637 18865 raft_consensus.cc:740] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:09.120263 18940 raft_consensus.cc:2468] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:09.120522 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df19c0634c8348dc9800213636a5830d" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:09.131124 19014 raft_consensus.cc:3060] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.119436 18941 leader_election.cc:290] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:09.121889 18865 consensus_queue.cc:260] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.133929 18865 raft_consensus.cc:3060] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.141755 18761 catalog_manager.cc:5697] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 1 to 2, leader changed from 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66) to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 2 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.144045 18865 raft_consensus.cc:2468] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:09.145534 18906 leader_election.cc:304] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:09.145741 19014 raft_consensus.cc:2468] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:09.146517 19100 raft_consensus.cc:2804] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.147047 19100 raft_consensus.cc:697] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:09.147894 19100 consensus_queue.cc:237] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.157037 18761 catalog_manager.cc:5697] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 2 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.180249 19063 consensus_queue.cc:1048] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:09.193293 19117 consensus_queue.cc:1048] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:09.201471 19079 raft_consensus.cc:993] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:09.201984 19079 raft_consensus.cc:1081] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:09.203641 18941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:42002
I20260709 13:20:09.204211 18941 raft_consensus.cc:493] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.204523 18941 raft_consensus.cc:3060] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.211177 18941 raft_consensus.cc:515] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.212965 18941 leader_election.cc:290] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:09.213991 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:09.214080 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14a33a7dbc24cb299fae92678e0a603" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:09.215423 18865 raft_consensus.cc:3055] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.215435 19014 raft_consensus.cc:3060] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.215866 18865 raft_consensus.cc:740] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:09.216847 18865 consensus_queue.cc:260] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.218837 18865 raft_consensus.cc:3060] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.222875 19014 raft_consensus.cc:2468] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:09.224296 18907 leader_election.cc:304] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:09.225497 19100 raft_consensus.cc:2804] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.225943 18865 raft_consensus.cc:2468] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:09.225950 19100 raft_consensus.cc:697] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:09.227244 19100 consensus_queue.cc:237] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.233942 18761 catalog_manager.cc:5697] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 2 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:09.379823 19106 raft_consensus.cc:993] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: : Instructing follower 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:09.380501 19065 raft_consensus.cc:1081] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Signalling peer 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:09.382521 18865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65992451110d467e96a2454589815604"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:45184
I20260709 13:20:09.383263 18865 raft_consensus.cc:493] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.383915 18865 raft_consensus.cc:3060] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.389905 18865 raft_consensus.cc:515] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:09.391788 18865 leader_election.cc:290] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:09.393141 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:09.393918 19014 raft_consensus.cc:3055] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.393210 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65992451110d467e96a2454589815604" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:09.394503 19014 raft_consensus.cc:740] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:09.394797 18941 raft_consensus.cc:3060] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.395417 19014 consensus_queue.cc:260] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:09.396661 19014 raft_consensus.cc:3060] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.401875 18941 raft_consensus.cc:2468] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:09.402990 19014 raft_consensus.cc:2468] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:09.403249 18831 leader_election.cc:304] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:09.404418 19079 raft_consensus.cc:2804] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.405035 19079 raft_consensus.cc:697] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:09.405826 19079 consensus_queue.cc:237] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } }
I20260709 13:20:09.413390 18761 catalog_manager.cc:5697] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 1 to 2, leader changed from 3fa6859faad5468999f2458aa6ead888 (127.7.122.67) to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 2 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.453812 18941 raft_consensus.cc:1275] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.455502 19087 consensus_queue.cc:1048] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.465948 19014 raft_consensus.cc:1275] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.467839 19079 consensus_queue.cc:1048] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:09.559485 19014 raft_consensus.cc:1275] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.561259 19090 consensus_queue.cc:1048] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.569191 19079 raft_consensus.cc:993] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:09.569705 19079 raft_consensus.cc:1081] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:09.570425 18865 raft_consensus.cc:1275] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.571529 19013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:39568
I20260709 13:20:09.572165 19013 raft_consensus.cc:493] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:09.572551 19013 raft_consensus.cc:3060] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.574218 19100 consensus_queue.cc:1048] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.581888 19013 raft_consensus.cc:515] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.584486 19013 leader_election.cc:290] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:09.585599 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:09.585871 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390b07da8c78438aa4284db4e3a833b3" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:09.586512 18940 raft_consensus.cc:3060] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.587152 18865 raft_consensus.cc:3055] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:09.587610 18865 raft_consensus.cc:740] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:09.588565 18865 consensus_queue.cc:260] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.589324 19013 raft_consensus.cc:1275] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.590291 18941 raft_consensus.cc:1275] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.591369 18865 raft_consensus.cc:3060] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:09.592809 19079 consensus_queue.cc:1048] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:09.595435 19063 consensus_queue.cc:1048] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.598027 18940 raft_consensus.cc:2468] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:09.599356 18980 leader_election.cc:304] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:09.600283 19065 raft_consensus.cc:2804] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:09.600795 19065 raft_consensus.cc:697] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:09.601676 19065 consensus_queue.cc:237] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:09.612000 18865 raft_consensus.cc:2468] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:09.615950 19014 raft_consensus.cc:1275] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.618379 19100 consensus_queue.cc:1048] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:09.622802 18762 catalog_manager.cc:5697] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:09.631281 18865 raft_consensus.cc:1275] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.632906 19140 consensus_queue.cc:1048] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.855571 18940 raft_consensus.cc:1275] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.857620 19063 consensus_queue.cc:1048] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:09.872320 19013 raft_consensus.cc:1275] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:09.874562 19113 consensus_queue.cc:1048] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.094933 18940 raft_consensus.cc:1275] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.096324 19065 consensus_queue.cc:1048] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:10.106858 18865 raft_consensus.cc:1275] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:10.108436 19147 consensus_queue.cc:1048] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:12.076116 18764 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53492:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:12.078365 18764 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:12.136548 18852 tablet_service.cc:1511] Processing CreateTablet for tablet f441e12425064837902b523ea96d9a33 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:12.138101 18852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f441e12425064837902b523ea96d9a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.137729 18925 tablet_service.cc:1511] Processing CreateTablet for tablet f441e12425064837902b523ea96d9a33 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:12.139258 18925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f441e12425064837902b523ea96d9a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.138903 19004 tablet_service.cc:1511] Processing CreateTablet for tablet f441e12425064837902b523ea96d9a33 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:12.140765 19004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f441e12425064837902b523ea96d9a33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.141064 18849 tablet_service.cc:1511] Processing CreateTablet for tablet 3153a1f8ddcf46c799b9ce948270c089 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:12.142457 18849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3153a1f8ddcf46c799b9ce948270c089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.145552 18931 tablet_service.cc:1511] Processing CreateTablet for tablet 3153a1f8ddcf46c799b9ce948270c089 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:12.147059 18931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3153a1f8ddcf46c799b9ce948270c089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.154594 18850 tablet_service.cc:1511] Processing CreateTablet for tablet 5bb1b71b4e12411aba909a290fedc2ed (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:12.156333 18850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb1b71b4e12411aba909a290fedc2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.158212 19001 tablet_service.cc:1511] Processing CreateTablet for tablet 3153a1f8ddcf46c799b9ce948270c089 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:12.159834 19001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3153a1f8ddcf46c799b9ce948270c089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.168371 18926 tablet_service.cc:1511] Processing CreateTablet for tablet 5bb1b71b4e12411aba909a290fedc2ed (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:12.170203 18926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb1b71b4e12411aba909a290fedc2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.171944 18848 tablet_service.cc:1511] Processing CreateTablet for tablet 33605be2c8474bcfbbd9b729d011b3a5 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:12.173696 18848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33605be2c8474bcfbbd9b729d011b3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.174926 19005 tablet_service.cc:1511] Processing CreateTablet for tablet 5bb1b71b4e12411aba909a290fedc2ed (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:12.176445 19005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb1b71b4e12411aba909a290fedc2ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.191179 18929 tablet_service.cc:1511] Processing CreateTablet for tablet 33605be2c8474bcfbbd9b729d011b3a5 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:12.192749 18929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33605be2c8474bcfbbd9b729d011b3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.198504 19000 tablet_service.cc:1511] Processing CreateTablet for tablet 33605be2c8474bcfbbd9b729d011b3a5 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:12.200030 19000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33605be2c8474bcfbbd9b729d011b3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.203810 18851 tablet_service.cc:1511] Processing CreateTablet for tablet 3424e080cd5347179267e944cbe2d50f (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:12.205343 18851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3424e080cd5347179267e944cbe2d50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.209836 18927 tablet_service.cc:1511] Processing CreateTablet for tablet 3424e080cd5347179267e944cbe2d50f (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:12.211417 18927 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3424e080cd5347179267e944cbe2d50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.218214 18855 tablet_service.cc:1511] Processing CreateTablet for tablet ce24e08a46a6414a9c67822aa216a601 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:12.221139 18930 tablet_service.cc:1511] Processing CreateTablet for tablet ce24e08a46a6414a9c67822aa216a601 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:12.222462 18855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce24e08a46a6414a9c67822aa216a601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.222528 18930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce24e08a46a6414a9c67822aa216a601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.223351 19003 tablet_service.cc:1511] Processing CreateTablet for tablet ce24e08a46a6414a9c67822aa216a601 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:12.224786 19003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce24e08a46a6414a9c67822aa216a601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.218091 19001 tablet_service.cc:1511] Processing CreateTablet for tablet 3424e080cd5347179267e944cbe2d50f (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:12.241693 19001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3424e080cd5347179267e944cbe2d50f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.245147 18854 tablet_service.cc:1511] Processing CreateTablet for tablet ca40b5775aec483cb84a42ce3803b19b (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:12.247210 18854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40b5775aec483cb84a42ce3803b19b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.259859 18928 tablet_service.cc:1511] Processing CreateTablet for tablet ca40b5775aec483cb84a42ce3803b19b (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:12.265758 18928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40b5775aec483cb84a42ce3803b19b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.267477 18998 tablet_service.cc:1511] Processing CreateTablet for tablet ca40b5775aec483cb84a42ce3803b19b (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:12.272507 18998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca40b5775aec483cb84a42ce3803b19b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.278445 19165 tablet_bootstrap.cc:492] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:12.283614 19166 tablet_bootstrap.cc:492] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.306548 19167 tablet_bootstrap.cc:492] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.315971 19167 tablet_bootstrap.cc:654] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.318120 18850 tablet_service.cc:1511] Processing CreateTablet for tablet 65e4d11ead5149c1b84e6b9b84f9ceaf (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:12.320990 18931 tablet_service.cc:1511] Processing CreateTablet for tablet 65e4d11ead5149c1b84e6b9b84f9ceaf (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:12.322584 18931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e4d11ead5149c1b84e6b9b84f9ceaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.323168 19165 tablet_bootstrap.cc:654] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.331987 18852 tablet_service.cc:1511] Processing CreateTablet for tablet caa8da3e6f094e10816a4264fb1a4f87 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:12.332492 18850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e4d11ead5149c1b84e6b9b84f9ceaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.332898 18930 tablet_service.cc:1511] Processing CreateTablet for tablet caa8da3e6f094e10816a4264fb1a4f87 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:12.333585 18852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa8da3e6f094e10816a4264fb1a4f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.334198 18930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa8da3e6f094e10816a4264fb1a4f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.338490 19001 tablet_service.cc:1511] Processing CreateTablet for tablet caa8da3e6f094e10816a4264fb1a4f87 (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:12.340454 19001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caa8da3e6f094e10816a4264fb1a4f87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.348831 19003 tablet_service.cc:1511] Processing CreateTablet for tablet 65e4d11ead5149c1b84e6b9b84f9ceaf (DEFAULT_TABLE table=soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:12.353379 19003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65e4d11ead5149c1b84e6b9b84f9ceaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:12.365748 19167 tablet_bootstrap.cc:492] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.366391 19167 ts_tablet_manager.cc:1403] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.002s
I20260709 13:20:12.379700 19167 raft_consensus.cc:359] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.382721 19166 tablet_bootstrap.cc:654] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.391748 19167 raft_consensus.cc:385] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.391394 19165 tablet_bootstrap.cc:492] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:12.393173 19167 raft_consensus.cc:740] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.402722 19165 ts_tablet_manager.cc:1403] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.125s	user 0.019s	sys 0.000s
I20260709 13:20:12.402777 19167 consensus_queue.cc:260] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.406453 19167 ts_tablet_manager.cc:1434] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:20:12.407778 19167 tablet_bootstrap.cc:492] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.406598 19165 raft_consensus.cc:359] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.411883 19165 raft_consensus.cc:385] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.414908 19165 raft_consensus.cc:740] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.417840 19167 tablet_bootstrap.cc:654] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.419587 19165 consensus_queue.cc:260] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.423431 19166 tablet_bootstrap.cc:492] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.424353 19166 ts_tablet_manager.cc:1403] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.003s
I20260709 13:20:12.427927 19166 raft_consensus.cc:359] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.437506 19165 ts_tablet_manager.cc:1434] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 13:20:12.437896 19166 raft_consensus.cc:385] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.438256 19166 raft_consensus.cc:740] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.439862 19166 consensus_queue.cc:260] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.443102 19166 ts_tablet_manager.cc:1434] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 13:20:12.443742 19165 tablet_bootstrap.cc:492] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:12.445885 19166 tablet_bootstrap.cc:492] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.447093 19167 tablet_bootstrap.cc:492] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.447769 19167 ts_tablet_manager.cc:1403] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.021s
I20260709 13:20:12.451665 19167 raft_consensus.cc:359] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.453168 19167 raft_consensus.cc:385] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.454028 19167 raft_consensus.cc:740] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.455295 19167 consensus_queue.cc:260] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.457373 19166 tablet_bootstrap.cc:654] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.460201 19167 ts_tablet_manager.cc:1434] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:20:12.461829 19167 tablet_bootstrap.cc:492] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.472007 19167 tablet_bootstrap.cc:654] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.472080 19166 tablet_bootstrap.cc:492] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.472898 19166 ts_tablet_manager.cc:1403] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 13:20:12.477465 19166 raft_consensus.cc:359] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.478809 19166 raft_consensus.cc:385] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.479362 19166 raft_consensus.cc:740] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.480142 19166 consensus_queue.cc:260] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.480598 19167 tablet_bootstrap.cc:492] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.481442 19167 ts_tablet_manager.cc:1403] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:20:12.483518 19166 ts_tablet_manager.cc:1434] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:12.484966 19166 tablet_bootstrap.cc:492] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.484799 19167 raft_consensus.cc:359] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.485888 19167 raft_consensus.cc:385] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.486303 19167 raft_consensus.cc:740] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.487151 19167 consensus_queue.cc:260] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.491276 19167 ts_tablet_manager.cc:1434] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:20:12.492720 19167 tablet_bootstrap.cc:492] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.494488 19166 tablet_bootstrap.cc:654] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.500133 19167 tablet_bootstrap.cc:654] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.510844 19167 tablet_bootstrap.cc:492] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.511354 19167 ts_tablet_manager.cc:1403] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:20:12.514179 19167 raft_consensus.cc:359] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.514819 19165 tablet_bootstrap.cc:654] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.514998 19167 raft_consensus.cc:385] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.515362 19167 raft_consensus.cc:740] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.516253 19167 consensus_queue.cc:260] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.518918 19167 ts_tablet_manager.cc:1434] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:20:12.520344 19167 tablet_bootstrap.cc:492] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.521636 19166 tablet_bootstrap.cc:492] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.522339 19166 ts_tablet_manager.cc:1403] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.012s
I20260709 13:20:12.525242 19154 raft_consensus.cc:493] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.525313 19165 tablet_bootstrap.cc:492] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:12.527629 19165 ts_tablet_manager.cc:1403] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.004s
I20260709 13:20:12.526080 19154 raft_consensus.cc:515] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.528258 19167 tablet_bootstrap.cc:654] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.530320 19154 leader_election.cc:290] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.530987 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33605be2c8474bcfbbd9b729d011b3a5" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
W20260709 13:20:12.533004 18907 leader_election.cc:343] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.527045 19166 raft_consensus.cc:359] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.533485 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33605be2c8474bcfbbd9b729d011b3a5" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:12.533603 19166 raft_consensus.cc:385] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.534097 19166 raft_consensus.cc:740] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.535398 19167 tablet_bootstrap.cc:492] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.531522 19165 raft_consensus.cc:359] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
W20260709 13:20:12.535563 18906 leader_election.cc:343] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.536017 19165 raft_consensus.cc:385] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.536111 19167 ts_tablet_manager.cc:1403] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:20:12.536150 18906 leader_election.cc:304] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:12.536478 19165 raft_consensus.cc:740] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.535058 19166 consensus_queue.cc:260] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.538929 19166 ts_tablet_manager.cc:1434] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:20:12.540148 19166 tablet_bootstrap.cc:492] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.541039 19165 consensus_queue.cc:260] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.543285 19149 raft_consensus.cc:2749] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:12.544134 19165 ts_tablet_manager.cc:1434] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:20:12.539677 19167 raft_consensus.cc:359] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.545054 19167 raft_consensus.cc:385] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.545369 19167 raft_consensus.cc:740] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.546137 19167 consensus_queue.cc:260] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.548581 19167 ts_tablet_manager.cc:1434] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.001s
I20260709 13:20:12.553635 19165 tablet_bootstrap.cc:492] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:12.554260 19166 tablet_bootstrap.cc:654] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.558388 19167 tablet_bootstrap.cc:492] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.562335 19166 tablet_bootstrap.cc:492] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.562904 19166 ts_tablet_manager.cc:1403] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:20:12.565922 19165 tablet_bootstrap.cc:654] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.565927 19167 tablet_bootstrap.cc:654] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.567994 19166 raft_consensus.cc:359] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.569043 19166 raft_consensus.cc:385] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.569360 19166 raft_consensus.cc:740] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.570484 19166 consensus_queue.cc:260] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.573412 19166 ts_tablet_manager.cc:1434] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.008s
I20260709 13:20:12.574577 19149 raft_consensus.cc:493] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.575259 19166 tablet_bootstrap.cc:492] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.575557 19149 raft_consensus.cc:515] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.579183 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
W20260709 13:20:12.580966 18907 leader_election.cc:343] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.582374 19149 leader_election.cc:290] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.584064 19166 tablet_bootstrap.cc:654] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.584105 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
W20260709 13:20:12.585956 18906 leader_election.cc:343] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.586460 18906 leader_election.cc:304] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:12.587714 19149 raft_consensus.cc:2749] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:12.588160 19167 tablet_bootstrap.cc:492] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.588753 19167 ts_tablet_manager.cc:1403] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:20:12.592983 19167 raft_consensus.cc:359] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.593751 19167 raft_consensus.cc:385] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.594085 19167 raft_consensus.cc:740] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.594837 19166 tablet_bootstrap.cc:492] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.594837 19167 consensus_queue.cc:260] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.595561 19166 ts_tablet_manager.cc:1403] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.001s
I20260709 13:20:12.602368 19166 raft_consensus.cc:359] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.603184 19166 raft_consensus.cc:385] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.603502 19166 raft_consensus.cc:740] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.596975 19167 ts_tablet_manager.cc:1434] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:12.608142 19165 tablet_bootstrap.cc:492] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:12.609045 19167 tablet_bootstrap.cc:492] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.609218 19165 ts_tablet_manager.cc:1403] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.017s
I20260709 13:20:12.604240 19166 consensus_queue.cc:260] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.613520 19165 raft_consensus.cc:359] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.614389 19165 raft_consensus.cc:385] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.614804 19165 raft_consensus.cc:740] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.615108 19166 ts_tablet_manager.cc:1434] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:20:12.616318 19166 tablet_bootstrap.cc:492] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.615890 19165 consensus_queue.cc:260] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.618849 19165 ts_tablet_manager.cc:1434] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:12.621196 19165 tablet_bootstrap.cc:492] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:12.625774 19167 tablet_bootstrap.cc:654] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.628702 19166 tablet_bootstrap.cc:654] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.629601 19165 tablet_bootstrap.cc:654] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.637013 19149 raft_consensus.cc:493] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.637933 19149 raft_consensus.cc:515] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.642575 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:12.643326 18865 raft_consensus.cc:2468] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:12.644995 18906 leader_election.cc:304] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.646178 19154 raft_consensus.cc:2804] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.646582 19154 raft_consensus.cc:493] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.646984 19154 raft_consensus.cc:3060] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.648713 19165 tablet_bootstrap.cc:492] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:12.650164 19165 ts_tablet_manager.cc:1403] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.004s
I20260709 13:20:12.651688 19166 tablet_bootstrap.cc:492] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.652513 19166 ts_tablet_manager.cc:1403] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.004s
I20260709 13:20:12.653746 19165 raft_consensus.cc:359] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.654677 19165 raft_consensus.cc:385] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.654289 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:12.655113 19165 raft_consensus.cc:740] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.655453 19013 raft_consensus.cc:2468] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:12.655977 19165 consensus_queue.cc:260] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.657958 19149 leader_election.cc:290] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.658820 19165 ts_tablet_manager.cc:1434] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:12.660264 19165 tablet_bootstrap.cc:492] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:12.663300 19166 raft_consensus.cc:359] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.664374 19166 raft_consensus.cc:385] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.664795 19166 raft_consensus.cc:740] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.667086 19166 consensus_queue.cc:260] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.668215 19165 tablet_bootstrap.cc:654] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.668429 19167 tablet_bootstrap.cc:492] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.669073 19167 ts_tablet_manager.cc:1403] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.060s	user 0.033s	sys 0.018s
I20260709 13:20:12.669898 19166 ts_tablet_manager.cc:1434] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:12.672204 19167 raft_consensus.cc:359] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.673048 19167 raft_consensus.cc:385] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.673352 19167 raft_consensus.cc:740] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.656647 19154 raft_consensus.cc:515] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.674156 19167 consensus_queue.cc:260] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.676694 19167 ts_tablet_manager.cc:1434] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:20:12.677824 19167 tablet_bootstrap.cc:492] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.679136 19166 tablet_bootstrap.cc:492] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.679849 19151 raft_consensus.cc:493] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.678690 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:12.682808 18865 raft_consensus.cc:3060] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.680613 19151 raft_consensus.cc:515] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.685853 19154 leader_election.cc:290] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.686089 19167 tablet_bootstrap.cc:654] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.688120 19151 leader_election.cc:290] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:12.685256 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:12.689026 19013 raft_consensus.cc:3060] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.691195 19166 tablet_bootstrap.cc:654] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.689555 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f441e12425064837902b523ea96d9a33" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:12.692034 18941 raft_consensus.cc:2468] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:12.693948 18980 leader_election.cc:304] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.691074 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f441e12425064837902b523ea96d9a33" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:12.695089 18866 raft_consensus.cc:2468] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:12.698403 19151 raft_consensus.cc:2804] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.698930 19151 raft_consensus.cc:493] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.699270 19151 raft_consensus.cc:3060] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.709677 19166 tablet_bootstrap.cc:492] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.710613 19166 ts_tablet_manager.cc:1403] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.004s
I20260709 13:20:12.719172 19166 raft_consensus.cc:359] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.719992 19166 raft_consensus.cc:385] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.720292 19166 raft_consensus.cc:740] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.723501 19165 tablet_bootstrap.cc:492] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:12.723731 19167 tablet_bootstrap.cc:492] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.724149 19165 ts_tablet_manager.cc:1403] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.019s
I20260709 13:20:12.724471 19166 consensus_queue.cc:260] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.723592 18865 raft_consensus.cc:2468] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:12.724912 19013 raft_consensus.cc:2468] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:12.727494 19166 ts_tablet_manager.cc:1434] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:20:12.728204 18907 leader_election.cc:304] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.728642 19166 tablet_bootstrap.cc:492] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.729885 19154 raft_consensus.cc:2804] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.730417 19154 raft_consensus.cc:697] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:12.724165 19167 ts_tablet_manager.cc:1403] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.019s
I20260709 13:20:12.731302 19154 consensus_queue.cc:237] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.735914 19167 raft_consensus.cc:359] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.736671 19167 raft_consensus.cc:385] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.737346 19167 raft_consensus.cc:740] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.738720 19167 consensus_queue.cc:260] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.727600 19165 raft_consensus.cc:359] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.741950 19165 raft_consensus.cc:385] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.742311 19165 raft_consensus.cc:740] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.743237 19165 consensus_queue.cc:260] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.737457 19166 tablet_bootstrap.cc:654] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.740819 19167 ts_tablet_manager.cc:1434] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:20:12.745339 19153 raft_consensus.cc:493] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.746344 19167 tablet_bootstrap.cc:492] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: Bootstrap starting.
I20260709 13:20:12.746091 19153 raft_consensus.cc:515] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.750479 19153 leader_election.cc:290] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.750701 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33605be2c8474bcfbbd9b729d011b3a5" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:12.751451 18941 raft_consensus.cc:2468] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:12.725035 19151 raft_consensus.cc:515] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.753470 18831 leader_election.cc:304] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.754442 19153 raft_consensus.cc:2804] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.754951 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33605be2c8474bcfbbd9b729d011b3a5" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:12.755774 19013 raft_consensus.cc:2468] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:12.754844 19153 raft_consensus.cc:493] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.759096 19153 raft_consensus.cc:3060] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.760488 19167 tablet_bootstrap.cc:654] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.773463 19149 raft_consensus.cc:493] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.774170 19149 raft_consensus.cc:515] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.778766 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce24e08a46a6414a9c67822aa216a601" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:12.780110 18865 raft_consensus.cc:2468] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:12.782001 18906 leader_election.cc:304] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.783972 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce24e08a46a6414a9c67822aa216a601" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
W20260709 13:20:12.789407 18907 leader_election.cc:343] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.790014 19151 leader_election.cc:290] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:12.790998 19165 ts_tablet_manager.cc:1434] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.066s	user 0.012s	sys 0.017s
I20260709 13:20:12.791605 19149 leader_election.cc:290] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.792673 19149 raft_consensus.cc:2804] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.792831 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f441e12425064837902b523ea96d9a33" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:12.793172 19149 raft_consensus.cc:493] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.793542 19149 raft_consensus.cc:3060] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.791330 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f441e12425064837902b523ea96d9a33" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:12.778062 18763 catalog_manager.cc:5697] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 1 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.796770 18866 raft_consensus.cc:3060] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.793565 18941 raft_consensus.cc:3060] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.805199 19153 raft_consensus.cc:515] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.801761 19165 tablet_bootstrap.cc:492] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:12.808900 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33605be2c8474bcfbbd9b729d011b3a5" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:12.810087 19153 leader_election.cc:290] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.811364 18940 raft_consensus.cc:3060] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.814419 19166 tablet_bootstrap.cc:492] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.815033 19166 ts_tablet_manager.cc:1403] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.031s
I20260709 13:20:12.818177 19166 raft_consensus.cc:359] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.819483 19166 raft_consensus.cc:385] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.819768 18941 raft_consensus.cc:2468] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:12.819774 19166 raft_consensus.cc:740] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.821583 19166 consensus_queue.cc:260] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.822253 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33605be2c8474bcfbbd9b729d011b3a5" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:12.823366 19014 raft_consensus.cc:3060] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.824002 19166 ts_tablet_manager.cc:1434] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:12.825768 19166 tablet_bootstrap.cc:492] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: Bootstrap starting.
I20260709 13:20:12.825402 18980 leader_election.cc:304] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.826561 19151 raft_consensus.cc:2804] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.827081 19151 raft_consensus.cc:697] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:12.827904 19151 consensus_queue.cc:237] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.836297 19166 tablet_bootstrap.cc:654] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.844960 19190 raft_consensus.cc:493] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.846442 19190 raft_consensus.cc:515] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.857910 19190 leader_election.cc:290] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:12.862154 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:12.863309 18865 raft_consensus.cc:2468] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:12.840909 19149 raft_consensus.cc:515] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.853345 19153 raft_consensus.cc:493] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.877223 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce24e08a46a6414a9c67822aa216a601" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:12.878021 18865 raft_consensus.cc:3060] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.871248 18980 leader_election.cc:304] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:12.865253 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:12.882251 18941 raft_consensus.cc:2468] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 0.
I20260709 13:20:12.883798 19194 raft_consensus.cc:493] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.884384 19194 raft_consensus.cc:515] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.885629 19167 tablet_bootstrap.cc:492] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: No bootstrap required, opened a new log
I20260709 13:20:12.885141 18762 catalog_manager.cc:5697] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:12.886138 19167 ts_tablet_manager.cc:1403] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: Time spent bootstrapping tablet: real 0.140s	user 0.054s	sys 0.017s
I20260709 13:20:12.886976 19194 leader_election.cc:290] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.870990 19153 raft_consensus.cc:515] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.889348 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:12.889109 19167 raft_consensus.cc:359] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.889523 19153 leader_election.cc:290] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.890336 19167 raft_consensus.cc:385] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.890722 19167 raft_consensus.cc:740] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.893187 18864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:12.864876 18940 raft_consensus.cc:2468] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:12.893903 18864 raft_consensus.cc:2468] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 0.
I20260709 13:20:12.894337 19149 leader_election.cc:290] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
W20260709 13:20:12.894424 18907 leader_election.cc:343] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.895452 18906 leader_election.cc:304] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:12.895457 18831 leader_election.cc:304] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.896355 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:12.897070 19013 raft_consensus.cc:2468] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:12.897426 19149 raft_consensus.cc:2804] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.897831 19153 raft_consensus.cc:2804] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.896999 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:12.898439 18832 leader_election.cc:304] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:12.898866 18941 raft_consensus.cc:2468] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:12.899242 19014 raft_consensus.cc:2468] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:12.899334 19169 raft_consensus.cc:2804] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.899933 19169 raft_consensus.cc:493] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.892630 19167 consensus_queue.cc:260] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.900329 19169 raft_consensus.cc:3060] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.900244 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce24e08a46a6414a9c67822aa216a601" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:12.902503 19167 ts_tablet_manager.cc:1434] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
W20260709 13:20:12.904214 18907 leader_election.cc:343] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.904697 18866 raft_consensus.cc:2468] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:12.897930 19149 raft_consensus.cc:493] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.902441 19153 raft_consensus.cc:697] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:12.906744 19149 raft_consensus.cc:3060] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.906673 19153 consensus_queue.cc:237] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.911331 19166 tablet_bootstrap.cc:492] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: No bootstrap required, opened a new log
I20260709 13:20:12.911936 19166 ts_tablet_manager.cc:1403] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.005s
I20260709 13:20:12.902016 19151 raft_consensus.cc:2804] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.912456 19151 raft_consensus.cc:493] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.912922 19151 raft_consensus.cc:3060] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.913196 19192 raft_consensus.cc:493] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:12.914197 19192 raft_consensus.cc:515] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.915014 19166 raft_consensus.cc:359] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.915885 19166 raft_consensus.cc:385] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:12.916159 19166 raft_consensus.cc:740] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Initialized, Role: FOLLOWER
I20260709 13:20:12.916882 19166 consensus_queue.cc:260] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.917965 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:12.919304 19166 ts_tablet_manager.cc:1434] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:12.919297 18941 raft_consensus.cc:2468] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:12.920338 18865 raft_consensus.cc:2468] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:12.920954 18831 leader_election.cc:304] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:12.922601 19200 raft_consensus.cc:2804] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:12.921161 19192 leader_election.cc:290] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.922726 18906 leader_election.cc:304] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:12.923048 19200 raft_consensus.cc:493] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:12.924117 19200 raft_consensus.cc:3060] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.924974 19194 raft_consensus.cc:2804] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.925199 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:12.925580 19194 raft_consensus.cc:697] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
W20260709 13:20:12.926823 18832 leader_election.cc:343] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.926487 19194 consensus_queue.cc:237] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.926877 19165 tablet_bootstrap.cc:654] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:12.939095 19169 raft_consensus.cc:515] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.944329 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:12.945016 18941 raft_consensus.cc:3060] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.944648 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:12.945829 18761 catalog_manager.cc:5697] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.946806 19013 raft_consensus.cc:3060] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.945971 19149 raft_consensus.cc:515] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.958719 19200 raft_consensus.cc:515] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.962548 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:12.963261 18940 raft_consensus.cc:3060] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.965440 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:12.966451 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:12.966938 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:12.967497 18865 raft_consensus.cc:3060] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.967653 19149 leader_election.cc:290] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.968277 19200 leader_election.cc:290] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
W20260709 13:20:12.969740 18832 leader_election.cc:343] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:12.970649 18907 leader_election.cc:343] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:12.951463 19169 leader_election.cc:290] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:12.977840 18865 raft_consensus.cc:2468] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 1.
I20260709 13:20:12.979482 18906 leader_election.cc:304] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:12.980878 19149 raft_consensus.cc:2804] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.976397 18940 raft_consensus.cc:2468] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:12.983017 19151 raft_consensus.cc:515] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.983314 18831 leader_election.cc:304] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:12.981523 19149 raft_consensus.cc:697] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:12.985603 19149 consensus_queue.cc:237] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.985714 19013 raft_consensus.cc:2468] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:12.985776 19169 raft_consensus.cc:2804] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.988355 18832 leader_election.cc:304] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:12.989277 19200 raft_consensus.cc:2804] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:12.989396 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:12.989797 19200 raft_consensus.cc:697] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:12.990199 18865 raft_consensus.cc:3060] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:12.990686 19200 consensus_queue.cc:237] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.988628 19169 raft_consensus.cc:697] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:12.984315 18941 raft_consensus.cc:2468] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:12.994028 19169 consensus_queue.cc:237] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:12.986069 19165 tablet_bootstrap.cc:492] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:12.995903 19165 ts_tablet_manager.cc:1403] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.197s	user 0.032s	sys 0.017s
I20260709 13:20:12.998865 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:12.999903 18940 raft_consensus.cc:3060] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.003163 18865 raft_consensus.cc:2468] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:13.004652 19165 raft_consensus.cc:359] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.007791 19165 raft_consensus.cc:385] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:13.008297 19165 raft_consensus.cc:740] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:13.008972 18980 leader_election.cc:304] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:13.010210 19190 raft_consensus.cc:2804] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:13.005864 19151 leader_election.cc:290] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:13.022984 19190 raft_consensus.cc:697] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:13.009235 19165 consensus_queue.cc:260] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
W20260709 13:20:13.030548 18812 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:13.033327 19165 ts_tablet_manager.cc:1434] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:20:13.034581 19190 consensus_queue.cc:237] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.035774 19165 tablet_bootstrap.cc:492] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:13.038133 18940 raft_consensus.cc:2468] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 1.
I20260709 13:20:13.043509 19165 tablet_bootstrap.cc:654] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:13.050387 19165 tablet_bootstrap.cc:492] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:13.051236 19165 ts_tablet_manager.cc:1403] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:20:13.052428 18762 catalog_manager.cc:5697] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 1 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.054327 18762 catalog_manager.cc:5697] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 0 to 1, leader changed from <none> to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 1 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.054581 19165 raft_consensus.cc:359] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.055498 19165 raft_consensus.cc:385] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:13.055828 19165 raft_consensus.cc:740] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:13.056754 19165 consensus_queue.cc:260] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.059196 19165 ts_tablet_manager.cc:1434] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:20:13.060570 19165 tablet_bootstrap.cc:492] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:13.067606 19165 tablet_bootstrap.cc:654] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:13.068182 18761 catalog_manager.cc:5697] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.068189 18763 catalog_manager.cc:5697] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.071854 18763 catalog_manager.cc:5697] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.075925 19169 raft_consensus.cc:493] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.076532 19169 raft_consensus.cc:515] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.077280 19165 tablet_bootstrap.cc:492] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:13.077841 19165 ts_tablet_manager.cc:1403] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:20:13.078828 19169 leader_election.cc:290] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:13.081095 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888" is_pre_election: true
I20260709 13:20:13.080801 19165 raft_consensus.cc:359] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.082659 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:13.084188 19165 raft_consensus.cc:385] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:13.084532 19165 raft_consensus.cc:740] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:13.084692 18940 raft_consensus.cc:2468] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:13.085330 19165 consensus_queue.cc:260] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.086118 18831 leader_election.cc:304] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:13.086433 19013 raft_consensus.cc:2468] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 0.
I20260709 13:20:13.087342 19169 raft_consensus.cc:2804] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:13.087718 19165 ts_tablet_manager.cc:1434] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:13.087774 19169 raft_consensus.cc:493] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:13.088353 19169 raft_consensus.cc:3060] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.088757 19165 tablet_bootstrap.cc:492] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: Bootstrap starting.
I20260709 13:20:13.097708 19165 tablet_bootstrap.cc:654] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:13.098387 19169 raft_consensus.cc:515] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.104454 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:13.105927 18940 raft_consensus.cc:3060] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.107751 19165 tablet_bootstrap.cc:492] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: No bootstrap required, opened a new log
I20260709 13:20:13.108311 19165 ts_tablet_manager.cc:1403] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 13:20:13.113129 19165 raft_consensus.cc:359] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.114390 19165 raft_consensus.cc:385] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:13.114821 19165 raft_consensus.cc:740] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Initialized, Role: FOLLOWER
I20260709 13:20:13.115423 19169 leader_election.cc:290] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:13.115842 19165 consensus_queue.cc:260] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.116382 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:13.117199 19013 raft_consensus.cc:3060] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.119820 19165 ts_tablet_manager.cc:1434] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:20:13.120397 18940 raft_consensus.cc:2468] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:13.122808 18831 leader_election.cc:304] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:13.124596 19169 raft_consensus.cc:2804] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:13.125263 19169 raft_consensus.cc:697] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:13.126346 19169 consensus_queue.cc:237] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.129168 19013 raft_consensus.cc:2468] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 1.
I20260709 13:20:13.139546 18763 catalog_manager.cc:5697] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 1 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.204541 19194 consensus_queue.cc:1048] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.218617 19149 consensus_queue.cc:1048] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.300119 19190 consensus_queue.cc:1048] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.304826 19013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f441e12425064837902b523ea96d9a33"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
mode: GRACEFUL
new_leader_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:39582
I20260709 13:20:13.305527 19013 raft_consensus.cc:606] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Received request to transfer leadership to TS 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:13.308967 19151 raft_consensus.cc:993] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: : Instructing follower 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:13.309451 19151 raft_consensus.cc:1081] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Signalling peer 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:13.311161 18866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f441e12425064837902b523ea96d9a33"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:45184
I20260709 13:20:13.311700 18866 raft_consensus.cc:493] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.312101 18866 raft_consensus.cc:3060] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.316332 19190 consensus_queue.cc:1048] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.319065 18940 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
mode: GRACEFUL
new_leader_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:42024
I20260709 13:20:13.319782 18940 raft_consensus.cc:606] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Received request to transfer leadership to TS 63afc17fdaf044d7852e2c262003fb9e
I20260709 13:20:13.320955 18866 raft_consensus.cc:515] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.324167 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f441e12425064837902b523ea96d9a33" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:13.325323 19190 raft_consensus.cc:493] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.326072 19190 raft_consensus.cc:515] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.324285 18865 raft_consensus.cc:1240] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Rejecting Update request from peer 3fa6859faad5468999f2458aa6ead888 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:13.330106 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f441e12425064837902b523ea96d9a33" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:13.330374 18864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:13.331022 19013 raft_consensus.cc:3055] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.331621 19013 raft_consensus.cc:740] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:13.331770 19208 consensus_queue.cc:1059] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.332504 19190 leader_election.cc:290] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:13.324702 18866 leader_election.cc:290] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:13.333312 19013 consensus_queue.cc:260] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.334244 19013 raft_consensus.cc:3060] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.337335 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:13.338438 18940 raft_consensus.cc:2393] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3fa6859faad5468999f2458aa6ead888 in current term 1: Already voted for candidate 63afc17fdaf044d7852e2c262003fb9e in this term.
I20260709 13:20:13.340385 18980 leader_election.cc:304] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888; no voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:13.341681 19190 raft_consensus.cc:3060] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.344609 19013 raft_consensus.cc:2468] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
W20260709 13:20:13.345248 19151 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:20:13.345847 18832 leader_election.cc:304] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:13.347194 19169 raft_consensus.cc:2804] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.347687 19013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
mode: GRACEFUL
new_leader_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:39582
I20260709 13:20:13.348294 19013 raft_consensus.cc:606] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Received request to transfer leadership to TS 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:13.347719 19169 raft_consensus.cc:697] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:13.349959 19169 consensus_queue.cc:237] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.350476 19190 raft_consensus.cc:2749] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:13.353722 19149 consensus_queue.cc:1048] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.359130 18761 catalog_manager.cc:5697] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 1 to 2, leader changed from 3fa6859faad5468999f2458aa6ead888 (127.7.122.67) to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 2 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.361232 18866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:13.362572 18866 raft_consensus.cc:606] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:13.366173 19013 raft_consensus.cc:3060] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.377717 19154 consensus_queue.cc:1048] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.391214 19154 consensus_queue.cc:1048] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.393517 18865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:45196
I20260709 13:20:13.394341 18865 raft_consensus.cc:606] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:13.418356 19013 raft_consensus.cc:3060] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:13.428558 19190 raft_consensus.cc:493] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:13.429761 19154 consensus_queue.cc:1048] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.429629 19190 raft_consensus.cc:515] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.434831 19169 consensus_queue.cc:1048] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.435909 19190 leader_election.cc:290] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:13.437074 18940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "828ccfa7cf7644b78530b20a826fff1f" is_pre_election: true
I20260709 13:20:13.441478 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63afc17fdaf044d7852e2c262003fb9e" is_pre_election: true
I20260709 13:20:13.444380 18980 leader_election.cc:304] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888; no voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f
I20260709 13:20:13.444600 19200 consensus_queue.cc:1048] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.446599 19151 raft_consensus.cc:2749] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:13.455415 19200 consensus_queue.cc:1048] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:13.478596 19190 consensus_queue.cc:1048] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.491210 19153 consensus_queue.cc:1048] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.504020 19151 consensus_queue.cc:1048] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.513731 19153 consensus_queue.cc:1048] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.543093 19153 consensus_queue.cc:1048] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:13.548076 19169 consensus_queue.cc:1048] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.555028 19198 raft_consensus.cc:993] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:13.555696 19198 raft_consensus.cc:1081] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:13.557806 18940 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:42002
I20260709 13:20:13.558271 19207 raft_consensus.cc:993] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: : Instructing follower 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:13.558772 18940 raft_consensus.cc:493] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.559043 19207 raft_consensus.cc:1081] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Signalling peer 828ccfa7cf7644b78530b20a826fff1f to start an election
I20260709 13:20:13.559296 18940 raft_consensus.cc:3060] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.564524 18937 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
 from {username='slave'} at 127.0.0.1:42014
I20260709 13:20:13.565481 18937 raft_consensus.cc:493] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.566039 18937 raft_consensus.cc:3060] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.570611 18940 raft_consensus.cc:515] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.573099 18940 leader_election.cc:290] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:13.582123 19013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:13.582764 19013 raft_consensus.cc:3060] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.589474 18937 raft_consensus.cc:515] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.595412 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca40b5775aec483cb84a42ce3803b19b" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:13.595630 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:13.596310 18866 raft_consensus.cc:3055] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.596773 18866 raft_consensus.cc:740] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:13.596843 18865 raft_consensus.cc:3060] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.598253 18866 consensus_queue.cc:260] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.599267 19198 consensus_queue.cc:1048] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:13.601960 19013 raft_consensus.cc:2468] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:13.599466 19153 raft_consensus.cc:993] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:13.603108 19153 raft_consensus.cc:1081] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:13.603371 18907 leader_election.cc:304] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:13.605144 18866 raft_consensus.cc:3060] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.606173 19014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:39568
I20260709 13:20:13.606920 19014 raft_consensus.cc:493] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.607306 19014 raft_consensus.cc:3060] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.610879 18937 leader_election.cc:290] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:13.611088 19015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3424e080cd5347179267e944cbe2d50f" candidate_uuid: "828ccfa7cf7644b78530b20a826fff1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:13.606189 19154 raft_consensus.cc:2804] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.613765 19015 raft_consensus.cc:3055] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.614086 19154 raft_consensus.cc:697] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:13.614416 19015 raft_consensus.cc:740] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:13.615162 19154 consensus_queue.cc:237] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.615731 19015 consensus_queue.cc:260] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.617460 18865 raft_consensus.cc:2468] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:13.617995 19015 raft_consensus.cc:3060] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.619611 18906 leader_election.cc:304] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63afc17fdaf044d7852e2c262003fb9e, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:13.620842 19194 raft_consensus.cc:2804] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.622036 19194 raft_consensus.cc:697] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Becoming Leader. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:13.624518 19194 consensus_queue.cc:237] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.639052 18866 raft_consensus.cc:2468] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:13.650725 19015 raft_consensus.cc:2468] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 828ccfa7cf7644b78530b20a826fff1f in term 2.
I20260709 13:20:13.649964 18761 catalog_manager.cc:5697] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 2 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.651638 19014 raft_consensus.cc:515] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.654229 18761 catalog_manager.cc:5697] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f reported cstate change: term changed from 1 to 2, leader changed from 3fa6859faad5468999f2458aa6ead888 (127.7.122.67) to 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66). New cstate: current_term: 2 leader_uuid: "828ccfa7cf7644b78530b20a826fff1f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.656641 19014 leader_election.cc:290] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:13.657920 18866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:13.658293 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caa8da3e6f094e10816a4264fb1a4f87" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:13.658674 18866 raft_consensus.cc:3055] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.658885 18941 raft_consensus.cc:3060] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.659369 18866 raft_consensus.cc:740] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:13.661337 18866 consensus_queue.cc:260] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.664181 18866 raft_consensus.cc:3060] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.673652 18941 raft_consensus.cc:2468] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:13.674116 18866 raft_consensus.cc:2468] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:13.675145 18980 leader_election.cc:304] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:13.676112 19151 raft_consensus.cc:2804] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.676620 19151 raft_consensus.cc:697] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:13.677544 19151 consensus_queue.cc:237] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.683708 19194 raft_consensus.cc:993] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: : Instructing follower 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:13.684551 19194 raft_consensus.cc:1081] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Signalling peer 63afc17fdaf044d7852e2c262003fb9e to start an election
I20260709 13:20:13.687285 18866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
 from {username='slave'} at 127.0.0.1:45188
I20260709 13:20:13.687919 18866 raft_consensus.cc:493] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.688328 18866 raft_consensus.cc:3060] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.689525 18761 catalog_manager.cc:5697] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.699980 18866 raft_consensus.cc:515] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.702538 18866 leader_election.cc:290] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Requested vote from peers 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141), 3fa6859faad5468999f2458aa6ead888 (127.7.122.67:34975)
I20260709 13:20:13.704317 18941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:13.704602 19014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3153a1f8ddcf46c799b9ce948270c089" candidate_uuid: "63afc17fdaf044d7852e2c262003fb9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3fa6859faad5468999f2458aa6ead888"
I20260709 13:20:13.705755 18941 raft_consensus.cc:3055] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.705830 19014 raft_consensus.cc:3060] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.706604 18941 raft_consensus.cc:740] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:13.707491 18941 consensus_queue.cc:260] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.708920 18941 raft_consensus.cc:3060] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.716729 19014 raft_consensus.cc:2468] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:13.718483 18832 leader_election.cc:304] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:13.719540 19169 raft_consensus.cc:2804] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.720340 19169 raft_consensus.cc:697] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Becoming Leader. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:13.720824 18941 raft_consensus.cc:2468] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63afc17fdaf044d7852e2c262003fb9e in term 2.
I20260709 13:20:13.721241 19169 consensus_queue.cc:237] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:13.730343 18762 catalog_manager.cc:5697] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e reported cstate change: term changed from 1 to 2, leader changed from 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66) to 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65). New cstate: current_term: 2 leader_uuid: "63afc17fdaf044d7852e2c262003fb9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.781987 19014 raft_consensus.cc:1275] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.783667 19169 consensus_queue.cc:1048] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.794389 18941 raft_consensus.cc:3060] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.803251 18941 raft_consensus.cc:1275] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.805307 19198 consensus_queue.cc:1048] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:14.029516 19014 raft_consensus.cc:1275] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.030990 19149 consensus_queue.cc:1048] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:14.042518 18866 raft_consensus.cc:1275] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.045544 19154 consensus_queue.cc:1048] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.048069 18866 raft_consensus.cc:1275] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.052484 19149 consensus_queue.cc:1048] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:14.068547 19014 raft_consensus.cc:1275] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 828ccfa7cf7644b78530b20a826fff1f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.071555 19149 consensus_queue.cc:1048] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.121676 18937 raft_consensus.cc:1275] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.124020 19208 consensus_queue.cc:1048] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.131528 19013 raft_consensus.cc:1275] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.134531 19198 consensus_queue.cc:1048] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.152199 18865 raft_consensus.cc:1275] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.158725 19237 consensus_queue.cc:1048] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.169086 18941 raft_consensus.cc:1275] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 63afc17fdaf044d7852e2c262003fb9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.171782 19200 consensus_queue.cc:1048] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:16.400727 18764 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53492:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:16.429137 18764 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53492:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:16.470791  7657 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:20:16.647194 19256 log.cc:927] Time spent T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:20:16.670523 18831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:38141, user_credentials={real_user=slave}} blocked reactor thread for 50700.8us
W20260709 13:20:16.742396 19275 log.cc:927] Time spent T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 13:20:16.842862 19262 log.cc:927] Time spent T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: Append to log took a long time: real 0.272s	user 0.005s	sys 0.000s
I20260709 13:20:16.966779 19295 tablet.cc:1724] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:16.967362 19301 tablet.cc:1724] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:16.969437 19296 tablet.cc:1724] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:17.032245 18967 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:65e4d11ead5149c1b84e6b9b84f9ceaf)
W20260709 13:20:17.034005 19297 log.cc:927] Time spent T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:20:16.969053 19304 tablet.cc:1724] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:17.045305 19291 log.cc:927] Time spent T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 13:20:17.047195 18980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:41063, user_credentials={real_user=slave}} blocked reactor thread for 84052us
W20260709 13:20:17.044603 19285 log.cc:927] Time spent T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 13:20:16.927359 19292 tablet.cc:1724] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.050571 19299 tablet.cc:1724] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.066919 19303 tablet.cc:1724] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:17.094834 19294 log.cc:927] Time spent T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:20:17.100306 19298 log.cc:927] Time spent T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:20:17.106158 18967 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:65e4d11ead5149c1b84e6b9b84f9ceaf)
W20260709 13:20:17.115789 18967 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:65e4d11ead5149c1b84e6b9b84f9ceaf)
W20260709 13:20:17.123945 18980 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.65:41063, user_credentials={real_user=slave}} blocked reactor thread for 67862.9us
I20260709 13:20:17.137473 19309 tablet.cc:1724] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.088259 19310 tablet.cc:1724] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.165164 19311 tablet.cc:1724] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.189761 19304 tablet.cc:1724] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.192289 18864 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:46988
I20260709 13:20:17.192008 19313 tablet.cc:1724] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.197258 18864 raft_consensus.cc:606] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:17.199466 19301 tablet.cc:1724] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.171942 19316 tablet.cc:1724] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.221163 19292 tablet.cc:1724] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.227061 19296 tablet.cc:1724] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.242035 19295 tablet.cc:1724] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.247867 19303 tablet.cc:1724] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.254076 19309 tablet.cc:1724] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.231640 19299 tablet.cc:1724] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.272281 19311 tablet.cc:1724] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.277853 19299 tablet.cc:1724] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.291519 19299 tablet.cc:1724] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.301741 19310 tablet.cc:1724] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.302403 19313 tablet.cc:1724] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.305907 19303 tablet.cc:1724] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.324241 19295 tablet.cc:1724] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:17.380473 18937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
mode: GRACEFUL
new_leader_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:35376
I20260709 13:20:17.381258 18937 raft_consensus.cc:606] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Received request to transfer leadership to TS 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:17.386337  7657 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:20:17.387064  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.399806 18937 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3"
dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
mode: GRACEFUL
new_leader_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:35376
I20260709 13:20:17.400442 18937 raft_consensus.cc:606] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Received request to transfer leadership to TS 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:17.403767 18865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39"
dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
mode: GRACEFUL
new_leader_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:46988
I20260709 13:20:17.404407 18865 raft_consensus.cc:606] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Received request to transfer leadership to TS 3fa6859faad5468999f2458aa6ead888
I20260709 13:20:17.406066  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:17.406751  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:17.408382 18764 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3: soft_deleted_table [id=ee67f9905dea4bbcb7793b16da579f62] alter complete (version 1)
I20260709 13:20:17.445562 19268 raft_consensus.cc:993] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: : Instructing follower 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.446439 19273 raft_consensus.cc:1081] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Signalling peer 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.448500 19011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:39578
I20260709 13:20:17.449409 19011 raft_consensus.cc:493] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.449836 19011 raft_consensus.cc:3060] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.456887 19011 raft_consensus.cc:515] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.460314 19011 leader_election.cc:290] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:17.461100 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:17.461606 18937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65e4d11ead5149c1b84e6b9b84f9ceaf" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:17.462297 18937 raft_consensus.cc:3055] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.462250 18865 raft_consensus.cc:3060] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.462687 18937 raft_consensus.cc:740] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:17.464375 18937 consensus_queue.cc:260] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.466027 19273 raft_consensus.cc:993] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: : Instructing follower 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.466249 18937 raft_consensus.cc:3060] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.466727 19268 raft_consensus.cc:1081] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Signalling peer 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.468659 19011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:39578
I20260709 13:20:17.469309 19011 raft_consensus.cc:493] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.469676 19011 raft_consensus.cc:3060] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.470849 18865 raft_consensus.cc:2468] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.472694 18980 leader_election.cc:304] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:17.473821 19302 raft_consensus.cc:2804] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.474351 19302 raft_consensus.cc:697] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:17.475641 18937 raft_consensus.cc:2468] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.475464 19302 consensus_queue.cc:237] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.480116 19011 raft_consensus.cc:515] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.482353 19011 leader_election.cc:290] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:17.483664 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:17.483765 18937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c297d5dfdd14eba90455d4edd43a1b3" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:17.484511 18865 raft_consensus.cc:3060] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.484701 18937 raft_consensus.cc:3055] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.485201 18937 raft_consensus.cc:740] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 828ccfa7cf7644b78530b20a826fff1f, State: Running, Role: LEADER
I20260709 13:20:17.486188 18937 consensus_queue.cc:260] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.487771 18937 raft_consensus.cc:3060] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.490258 18764 catalog_manager.cc:5697] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 1 to 2, leader changed from 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66) to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.491969 18865 raft_consensus.cc:2468] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.494799 18980 leader_election.cc:304] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:17.496016 19302 raft_consensus.cc:2804] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.496685 19302 raft_consensus.cc:697] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:17.497725 19302 consensus_queue.cc:237] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.499611 18937 raft_consensus.cc:2468] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.512446 18764 catalog_manager.cc:5697] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 1 to 2, leader changed from 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66) to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.523654 19272 raft_consensus.cc:993] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.524320 19267 raft_consensus.cc:1081] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.526276 19011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:39568
I20260709 13:20:17.526883 19011 raft_consensus.cc:493] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.527182 19011 raft_consensus.cc:3060] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.533078 19011 raft_consensus.cc:515] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.535104 19011 leader_election.cc:290] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:17.536216 18865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:17.536445 18937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bb1b71b4e12411aba909a290fedc2ed" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:17.537025 18865 raft_consensus.cc:3055] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.537369 18865 raft_consensus.cc:740] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:17.537222 18937 raft_consensus.cc:3060] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.538376 18865 consensus_queue.cc:260] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.539433 18865 raft_consensus.cc:3060] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.544932 18865 raft_consensus.cc:2468] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.546205 18937 raft_consensus.cc:2468] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.546720 18980 leader_election.cc:304] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 63afc17fdaf044d7852e2c262003fb9e; no voters: 
I20260709 13:20:17.548416 19302 raft_consensus.cc:2804] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.549220 19302 raft_consensus.cc:697] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:17.550163 19302 consensus_queue.cc:237] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.559777 18764 catalog_manager.cc:5697] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.778359 19272 raft_consensus.cc:993] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: : Instructing follower 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.779075 19267 raft_consensus.cc:1081] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Signalling peer 3fa6859faad5468999f2458aa6ead888 to start an election
I20260709 13:20:17.781111 19011 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39"
dest_uuid: "3fa6859faad5468999f2458aa6ead888"
 from {username='slave'} at 127.0.0.1:39568
I20260709 13:20:17.781863 19011 raft_consensus.cc:493] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.782413 19011 raft_consensus.cc:3060] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.788457 19011 raft_consensus.cc:515] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.790287 19011 leader_election.cc:290] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Requested vote from peers 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063), 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141)
I20260709 13:20:17.791296 18864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63afc17fdaf044d7852e2c262003fb9e"
I20260709 13:20:17.791729 18937 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51a163032e7f4ca3adb801438b519f39" candidate_uuid: "3fa6859faad5468999f2458aa6ead888" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "828ccfa7cf7644b78530b20a826fff1f"
I20260709 13:20:17.792194 18864 raft_consensus.cc:3055] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:17.792641 18937 raft_consensus.cc:3060] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.792670 18864 raft_consensus.cc:740] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63afc17fdaf044d7852e2c262003fb9e, State: Running, Role: LEADER
I20260709 13:20:17.794135 18864 consensus_queue.cc:260] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.795816 18864 raft_consensus.cc:3060] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:17.801854 18937 raft_consensus.cc:2468] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.803514 18980 leader_election.cc:304] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fa6859faad5468999f2458aa6ead888, 828ccfa7cf7644b78530b20a826fff1f; no voters: 
I20260709 13:20:17.804804 19315 raft_consensus.cc:2804] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:17.804977 18864 raft_consensus.cc:2468] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fa6859faad5468999f2458aa6ead888 in term 2.
I20260709 13:20:17.805436 19315 raft_consensus.cc:697] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Becoming Leader. State: Replica: 3fa6859faad5468999f2458aa6ead888, State: Running, Role: LEADER
I20260709 13:20:17.806466 19315 consensus_queue.cc:237] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } }
I20260709 13:20:17.816701 18764 catalog_manager.cc:5697] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 reported cstate change: term changed from 1 to 2, leader changed from 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65) to 3fa6859faad5468999f2458aa6ead888 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "3fa6859faad5468999f2458aa6ead888" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fa6859faad5468999f2458aa6ead888" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34975 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:17.855499 18864 raft_consensus.cc:1275] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:17.857156 19315 consensus_queue.cc:1048] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:17.869957 18937 raft_consensus.cc:1275] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:17.876773 19325 consensus_queue.cc:1048] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:17.894515 18937 raft_consensus.cc:1275] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.896067 19325 consensus_queue.cc:1048] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.906899 18864 raft_consensus.cc:1275] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:17.908527 19315 consensus_queue.cc:1048] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:17.966164 18937 raft_consensus.cc:1275] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:17.967636 19329 consensus_queue.cc:1048] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:17.976212 18864 raft_consensus.cc:1275] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:17.978140 19325 consensus_queue.cc:1048] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:18.227583 18865 raft_consensus.cc:1275] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.229624 19325 consensus_queue.cc:1048] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63afc17fdaf044d7852e2c262003fb9e" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.239856 18937 raft_consensus.cc:1275] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Refusing update from remote peer 3fa6859faad5468999f2458aa6ead888: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:18.241688 19329 consensus_queue.cc:1048] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [LEADER]: Connected to new peer: Peer: permanent_uuid: "828ccfa7cf7644b78530b20a826fff1f" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.502457  7657 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:18.511212  7657 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:20:18.511631  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.517165  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:18.517746  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:19.550992  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
W20260709 13:20:19.577836 18906 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:20:19.582631 18906 consensus_peers.cc:597] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.600775  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:19.601933  7657 tablet_replica.cc:333] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.603001  7657 raft_consensus.cc:2243] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.603835  7657 raft_consensus.cc:2272] T ce24e08a46a6414a9c67822aa216a601 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.606580  7657 tablet_replica.cc:333] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.607435  7657 raft_consensus.cc:2243] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.608705  7657 raft_consensus.cc:2272] T 33605be2c8474bcfbbd9b729d011b3a5 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.611528  7657 tablet_replica.cc:333] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.612177  7657 raft_consensus.cc:2243] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.612632  7657 raft_consensus.cc:2272] T caa8da3e6f094e10816a4264fb1a4f87 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.614744  7657 tablet_replica.cc:333] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.615475  7657 raft_consensus.cc:2243] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.616262  7657 raft_consensus.cc:2272] T f441e12425064837902b523ea96d9a33 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.618798  7657 tablet_replica.cc:333] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.619481  7657 raft_consensus.cc:2243] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.619932  7657 raft_consensus.cc:2272] T 648b04d1c1a24441af383a0b31f07b27 P 63afc17fdaf044d7852e2c262003fb9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.622942  7657 tablet_replica.cc:333] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.623697  7657 raft_consensus.cc:2243] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.624734  7657 raft_consensus.cc:2272] T 3153a1f8ddcf46c799b9ce948270c089 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.627154  7657 tablet_replica.cc:333] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.627741  7657 raft_consensus.cc:2243] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.628257  7657 raft_consensus.cc:2272] T 0c297d5dfdd14eba90455d4edd43a1b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.630476  7657 tablet_replica.cc:333] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.631270  7657 raft_consensus.cc:2243] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.631795  7657 raft_consensus.cc:2272] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.633981  7657 tablet_replica.cc:333] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.634545  7657 raft_consensus.cc:2243] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.635031  7657 raft_consensus.cc:2272] T d14a33a7dbc24cb299fae92678e0a603 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.637094  7657 tablet_replica.cc:333] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.637619  7657 raft_consensus.cc:2243] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.638087  7657 raft_consensus.cc:2272] T df19c0634c8348dc9800213636a5830d P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.640647  7657 tablet_replica.cc:333] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.641338  7657 raft_consensus.cc:2243] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.641868  7657 raft_consensus.cc:2272] T 5bb1b71b4e12411aba909a290fedc2ed P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.644086  7657 tablet_replica.cc:333] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.644722  7657 raft_consensus.cc:2243] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.645282  7657 raft_consensus.cc:2272] T ca40b5775aec483cb84a42ce3803b19b P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.647369  7657 tablet_replica.cc:333] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.648218  7657 raft_consensus.cc:2243] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.648788  7657 raft_consensus.cc:2272] T 390b07da8c78438aa4284db4e3a833b3 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.651168  7657 tablet_replica.cc:333] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.651782  7657 raft_consensus.cc:2243] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.652659  7657 raft_consensus.cc:2272] T 7cb85dd452d5432e9589e26edf1e26ea P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.655642  7657 tablet_replica.cc:333] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.656410  7657 raft_consensus.cc:2243] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.657271  7657 raft_consensus.cc:2272] T bedcb1bc48ff41469d97febe85f27c11 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.659773  7657 tablet_replica.cc:333] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.660352  7657 raft_consensus.cc:2243] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.660820  7657 raft_consensus.cc:2272] T 3424e080cd5347179267e944cbe2d50f P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.662920  7657 tablet_replica.cc:333] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.663754  7657 raft_consensus.cc:2243] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.665228  7657 raft_consensus.cc:2272] T 65992451110d467e96a2454589815604 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.668615  7657 tablet_replica.cc:333] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e: stopping tablet replica
I20260709 13:20:19.669221  7657 raft_consensus.cc:2243] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.669601  7657 raft_consensus.cc:2272] T 51a163032e7f4ca3adb801438b519f39 P 63afc17fdaf044d7852e2c262003fb9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.716764 18980 consensus_peers.cc:597] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.718262  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
W20260709 13:20:19.722261 18980 consensus_peers.cc:597] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.733706 18980 consensus_peers.cc:597] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.762038  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
W20260709 13:20:19.763757 18906 consensus_peers.cc:597] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.793298 18906 consensus_peers.cc:597] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.807169  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:19.808279  7657 tablet_replica.cc:333] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.809470  7657 raft_consensus.cc:2243] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.810886  7657 raft_consensus.cc:2272] T ce24e08a46a6414a9c67822aa216a601 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.813881  7657 tablet_replica.cc:333] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.814793  7657 raft_consensus.cc:2243] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.815706  7657 raft_consensus.cc:2272] T caa8da3e6f094e10816a4264fb1a4f87 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.816407 18980 consensus_peers.cc:597] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 -> Peer 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141): Couldn't send request to peer 828ccfa7cf7644b78530b20a826fff1f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.819592  7657 tablet_replica.cc:333] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.820510  7657 raft_consensus.cc:2243] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.821151  7657 raft_consensus.cc:2272] T f441e12425064837902b523ea96d9a33 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.824326  7657 tablet_replica.cc:333] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
W20260709 13:20:19.824472 18906 consensus_peers.cc:597] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.825338  7657 raft_consensus.cc:2243] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.826741  7657 raft_consensus.cc:2272] T 648b04d1c1a24441af383a0b31f07b27 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.829699  7657 tablet_replica.cc:333] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.830528  7657 raft_consensus.cc:2243] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.831431  7657 raft_consensus.cc:2272] T ca40b5775aec483cb84a42ce3803b19b P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.833673  7657 tablet_replica.cc:333] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.834331  7657 raft_consensus.cc:2243] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.834831  7657 raft_consensus.cc:2272] T 390b07da8c78438aa4284db4e3a833b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.837150  7657 tablet_replica.cc:333] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.837805  7657 raft_consensus.cc:2243] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.838351  7657 raft_consensus.cc:2272] T 3153a1f8ddcf46c799b9ce948270c089 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.840543  7657 tablet_replica.cc:333] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.841238  7657 raft_consensus.cc:2243] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.841701  7657 raft_consensus.cc:2272] T 0c297d5dfdd14eba90455d4edd43a1b3 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.843966  7657 tablet_replica.cc:333] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.844606  7657 raft_consensus.cc:2243] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.845218  7657 raft_consensus.cc:2272] T 33605be2c8474bcfbbd9b729d011b3a5 P 828ccfa7cf7644b78530b20a826fff1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.848249  7657 tablet_replica.cc:333] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.848909  7657 raft_consensus.cc:2243] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.849556  7657 raft_consensus.cc:2272] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.851723  7657 tablet_replica.cc:333] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.852274  7657 raft_consensus.cc:2243] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.853142  7657 raft_consensus.cc:2272] T d14a33a7dbc24cb299fae92678e0a603 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.855361  7657 tablet_replica.cc:333] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.856086  7657 raft_consensus.cc:2243] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.856586  7657 raft_consensus.cc:2272] T bedcb1bc48ff41469d97febe85f27c11 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.858764  7657 tablet_replica.cc:333] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.859287  7657 raft_consensus.cc:2243] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.859742  7657 raft_consensus.cc:2272] T 7cb85dd452d5432e9589e26edf1e26ea P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.862176  7657 tablet_replica.cc:333] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.862771  7657 raft_consensus.cc:2243] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.863477  7657 raft_consensus.cc:2272] T 5bb1b71b4e12411aba909a290fedc2ed P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.865662  7657 tablet_replica.cc:333] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.866372  7657 raft_consensus.cc:2243] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.867424  7657 raft_consensus.cc:2272] T df19c0634c8348dc9800213636a5830d P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.870555  7657 tablet_replica.cc:333] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.871382  7657 raft_consensus.cc:2243] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.872058  7657 raft_consensus.cc:2272] T 51a163032e7f4ca3adb801438b519f39 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.874886  7657 tablet_replica.cc:333] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.875608  7657 raft_consensus.cc:2243] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.876843  7657 raft_consensus.cc:2272] T 3424e080cd5347179267e944cbe2d50f P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.879355  7657 tablet_replica.cc:333] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f: stopping tablet replica
I20260709 13:20:19.879983  7657 raft_consensus.cc:2243] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.880499  7657 raft_consensus.cc:2272] T 65992451110d467e96a2454589815604 P 828ccfa7cf7644b78530b20a826fff1f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.917642  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
W20260709 13:20:19.960152 18980 consensus_peers.cc:597] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 -> Peer 63afc17fdaf044d7852e2c262003fb9e (127.7.122.65:41063): Couldn't send request to peer 63afc17fdaf044d7852e2c262003fb9e. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.65:41063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.964058  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
W20260709 13:20:19.993819 18980 consensus_peers.cc:597] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 -> Peer 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141): Couldn't send request to peer 828ccfa7cf7644b78530b20a826fff1f. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:38141: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:20.005539  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:20.006423  7657 tablet_replica.cc:333] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.007191  7657 raft_consensus.cc:2243] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.007752  7657 raft_consensus.cc:2272] T ce24e08a46a6414a9c67822aa216a601 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.010207  7657 tablet_replica.cc:333] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.010798  7657 raft_consensus.cc:2243] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.011557  7657 raft_consensus.cc:2272] T 33605be2c8474bcfbbd9b729d011b3a5 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.013945  7657 tablet_replica.cc:333] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.014516  7657 raft_consensus.cc:2243] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.015120  7657 raft_consensus.cc:2272] T ca40b5775aec483cb84a42ce3803b19b P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.017091  7657 tablet_replica.cc:333] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.017680  7657 raft_consensus.cc:2243] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.018568  7657 raft_consensus.cc:2272] T 390b07da8c78438aa4284db4e3a833b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.020789  7657 tablet_replica.cc:333] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.021440  7657 raft_consensus.cc:2243] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.022244  7657 raft_consensus.cc:2272] T caa8da3e6f094e10816a4264fb1a4f87 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.025302  7657 tablet_replica.cc:333] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.026535  7657 raft_consensus.cc:2243] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.027444  7657 raft_consensus.cc:2272] T f441e12425064837902b523ea96d9a33 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.030155  7657 tablet_replica.cc:333] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.030798  7657 raft_consensus.cc:2243] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.031817  7657 raft_consensus.cc:2272] T 5bb1b71b4e12411aba909a290fedc2ed P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.035029  7657 tablet_replica.cc:333] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.035967  7657 raft_consensus.cc:2243] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.036643  7657 raft_consensus.cc:2272] T df19c0634c8348dc9800213636a5830d P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:20.038631 18980 consensus_peers.cc:597] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 -> Peer 828ccfa7cf7644b78530b20a826fff1f (127.7.122.66:38141): Couldn't send request to peer 828ccfa7cf7644b78530b20a826fff1f. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:38141: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:20.039458  7657 tablet_replica.cc:333] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.040123  7657 raft_consensus.cc:2243] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.040979  7657 raft_consensus.cc:2272] T 65e4d11ead5149c1b84e6b9b84f9ceaf P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.043138  7657 tablet_replica.cc:333] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.043764  7657 raft_consensus.cc:2243] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.044241  7657 raft_consensus.cc:2272] T d14a33a7dbc24cb299fae92678e0a603 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.046415  7657 tablet_replica.cc:333] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.046962  7657 raft_consensus.cc:2243] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.047688  7657 raft_consensus.cc:2272] T 51a163032e7f4ca3adb801438b519f39 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.051187  7657 tablet_replica.cc:333] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.051770  7657 raft_consensus.cc:2243] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.052223  7657 raft_consensus.cc:2272] T 648b04d1c1a24441af383a0b31f07b27 P 3fa6859faad5468999f2458aa6ead888 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.054476  7657 tablet_replica.cc:333] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.055006  7657 raft_consensus.cc:2243] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.055426  7657 raft_consensus.cc:2272] T 3153a1f8ddcf46c799b9ce948270c089 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.057548  7657 tablet_replica.cc:333] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.058096  7657 raft_consensus.cc:2243] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.058866  7657 raft_consensus.cc:2272] T 0c297d5dfdd14eba90455d4edd43a1b3 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.061342  7657 tablet_replica.cc:333] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.061997  7657 raft_consensus.cc:2243] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.062687  7657 raft_consensus.cc:2272] T 7cb85dd452d5432e9589e26edf1e26ea P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.065384  7657 tablet_replica.cc:333] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.065959  7657 raft_consensus.cc:2243] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.066514  7657 raft_consensus.cc:2272] T bedcb1bc48ff41469d97febe85f27c11 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.068794  7657 tablet_replica.cc:333] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.069317  7657 raft_consensus.cc:2243] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.069746  7657 raft_consensus.cc:2272] T 3424e080cd5347179267e944cbe2d50f P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.071704  7657 tablet_replica.cc:333] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888: stopping tablet replica
I20260709 13:20:20.072171  7657 raft_consensus.cc:2243] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:20.072615  7657 raft_consensus.cc:2272] T 65992451110d467e96a2454589815604 P 3fa6859faad5468999f2458aa6ead888 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.120930  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
I20260709 13:20:20.160308  7657 master.cc:562] Master@127.7.122.126:37053 shutting down...
I20260709 13:20:20.197288  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:20.198218  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:20.198711  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P c13b625b955b4993a5f7a0b539c406c3: stopping tablet replica
I20260709 13:20:20.220577  7657 master.cc:584] Master@127.7.122.126:37053 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (13524 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:20:20.277316  7657 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.122.126:36875
I20260709 13:20:20.278400  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.286839 19339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.286890 19340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.287946 19342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.288446  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:20.289522  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.289762  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.289942  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603220289923 us; error 0 us; skew 500 ppm
I20260709 13:20:20.290644  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.293612  7657 webserver.cc:533] Webserver started at http://127.7.122.126:38989/ using document root <none> and password file <none>
I20260709 13:20:20.294169  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.294392  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.294695  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.295949  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/master-0-root/instance:
uuid: "ff4108ea6bfb412db127791e4182653f"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.301299  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:20:20.305826 19347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.307236  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:20:20.307564  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/master-0-root
uuid: "ff4108ea6bfb412db127791e4182653f"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.307859  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.331845  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.333184  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.386089  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.126:36875
I20260709 13:20:20.386355 19398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.126:36875 every 8 connection(s)
I20260709 13:20:20.390650 19399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.404520 19399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f: Bootstrap starting.
I20260709 13:20:20.409853 19399 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.414613 19399 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f: No bootstrap required, opened a new log
I20260709 13:20:20.417176 19399 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4108ea6bfb412db127791e4182653f" member_type: VOTER }
I20260709 13:20:20.417606 19399 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.417889 19399 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff4108ea6bfb412db127791e4182653f, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.418483 19399 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4108ea6bfb412db127791e4182653f" member_type: VOTER }
I20260709 13:20:20.419009 19399 raft_consensus.cc:399] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:20.419217 19399 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:20.419498 19399 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.424643 19399 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4108ea6bfb412db127791e4182653f" member_type: VOTER }
I20260709 13:20:20.425304 19399 leader_election.cc:304] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff4108ea6bfb412db127791e4182653f; no voters: 
I20260709 13:20:20.426573 19399 leader_election.cc:290] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:20.426970 19402 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:20.428539 19402 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 1 LEADER]: Becoming Leader. State: Replica: ff4108ea6bfb412db127791e4182653f, State: Running, Role: LEADER
I20260709 13:20:20.429391 19402 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4108ea6bfb412db127791e4182653f" member_type: VOTER }
I20260709 13:20:20.430029 19399 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:20.434393 19403 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff4108ea6bfb412db127791e4182653f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4108ea6bfb412db127791e4182653f" member_type: VOTER } }
I20260709 13:20:20.435324 19403 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:20.434300 19404 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff4108ea6bfb412db127791e4182653f. Latest consensus state: current_term: 1 leader_uuid: "ff4108ea6bfb412db127791e4182653f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff4108ea6bfb412db127791e4182653f" member_type: VOTER } }
I20260709 13:20:20.436033 19404 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:20.440706 19409 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:20.446085 19409 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:20.449203  7657 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:20.456563 19409 catalog_manager.cc:1383] Generated new cluster ID: 4023c073fd524207b6981fa044d3cc00
I20260709 13:20:20.456930 19409 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:20.495260 19409 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:20.496726 19409 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:20.523083 19409 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f: Generated new TSK 0
I20260709 13:20:20.523775 19409 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:20.581621  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.588987 19420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.589973 19421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.592269 19423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.592741  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:20.593863  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.594069  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.594187  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603220594175 us; error 0 us; skew 500 ppm
I20260709 13:20:20.594686  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.597347  7657 webserver.cc:533] Webserver started at http://127.7.122.65:38357/ using document root <none> and password file <none>
I20260709 13:20:20.597801  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.597945  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.598160  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.599233  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-0-root/instance:
uuid: "f0bf4771859f4045958021e7ea1be493"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.604300  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:20.609242 19428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.610260  7657 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:20.610635  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-0-root
uuid: "f0bf4771859f4045958021e7ea1be493"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.610916  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.630342  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.631680  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.633800  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.636493  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.636685  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.637056  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.637219  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.691615  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.65:41141
I20260709 13:20:20.691764 19490 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.65:41141 every 8 connection(s)
I20260709 13:20:20.697755  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.706475 19495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.707082 19496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.710729  7657 server_base.cc:1061] running on GCE node
W20260709 13:20:20.711009 19498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.713024  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.713371  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.713611  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603220713592 us; error 0 us; skew 500 ppm
I20260709 13:20:20.714383  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.716349 19491 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36875
I20260709 13:20:20.716761 19491 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.717437  7657 webserver.cc:533] Webserver started at http://127.7.122.66:34855/ using document root <none> and password file <none>
I20260709 13:20:20.717850 19491 heartbeater.cc:507] Master 127.7.122.126:36875 requested a full tablet report, sending...
I20260709 13:20:20.718019  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.718348  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.718631  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.720067  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-1-root/instance:
uuid: "13f3b9cb92d842adab53cfae0f465880"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.720289 19364 ts_manager.cc:194] Registered new tserver with Master: f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141)
I20260709 13:20:20.722914 19364 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33870
I20260709 13:20:20.726433  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:20:20.730317 19503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.731401  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:20.731940  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-1-root
uuid: "13f3b9cb92d842adab53cfae0f465880"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.732451  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.745982  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.747589  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.749359  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.752014  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.752257  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.752597  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.752785  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.809594  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.66:33053
I20260709 13:20:20.809813 19565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.66:33053 every 8 connection(s)
I20260709 13:20:20.815768  7657 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.826458 19569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.827455 19570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.833331 19572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.834964  7657 server_base.cc:1061] running on GCE node
I20260709 13:20:20.835408 19566 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36875
I20260709 13:20:20.836009 19566 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.836946  7657 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.837333  7657 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.837396 19566 heartbeater.cc:507] Master 127.7.122.126:36875 requested a full tablet report, sending...
I20260709 13:20:20.837643  7657 hybrid_clock.cc:648] HybridClock initialized: now 1783603220837622 us; error 0 us; skew 500 ppm
I20260709 13:20:20.839301  7657 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.840277 19364 ts_manager.cc:194] Registered new tserver with Master: 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:20.842163 19364 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33876
I20260709 13:20:20.842592  7657 webserver.cc:533] Webserver started at http://127.7.122.67:43841/ using document root <none> and password file <none>
I20260709 13:20:20.843475  7657 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.843747  7657 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.844070  7657 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.845928  7657 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-2-root/instance:
uuid: "a079720156944039b22ad6526547f3a3"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.851395  7657 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:20.855554 19577 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.856600  7657 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:20.857041  7657 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-2-root
uuid: "a079720156944039b22ad6526547f3a3"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-078m"
I20260709 13:20:20.857496  7657 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskWR8O6U/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602883560622-7657-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.889597  7657 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.890884  7657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.892841  7657 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.895359  7657 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.895627  7657 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.895882  7657 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.896085  7657 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.958982  7657 rpc_server.cc:307] RPC server started. Bound to: 127.7.122.67:34141
I20260709 13:20:20.959187 19639 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.122.67:34141 every 8 connection(s)
I20260709 13:20:20.981819 19640 heartbeater.cc:344] Connected to a master server at 127.7.122.126:36875
I20260709 13:20:20.982327 19640 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.983130 19640 heartbeater.cc:507] Master 127.7.122.126:36875 requested a full tablet report, sending...
I20260709 13:20:20.985692 19364 ts_manager.cc:194] Registered new tserver with Master: a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:20.985819  7657 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.023697352s
I20260709 13:20:20.987145 19364 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33884
I20260709 13:20:21.016517 19364 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33892:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:21.019948 19364 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:21.130560 19456 tablet_service.cc:1511] Processing CreateTablet for tablet 94b9096dc5ca40daa09a2b7c363727b8 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:21.132272 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b9096dc5ca40daa09a2b7c363727b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.133154 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 1f37f98f577248938245361e2def9199 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:21.134723 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f37f98f577248938245361e2def9199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.143836 19605 tablet_service.cc:1511] Processing CreateTablet for tablet 94b9096dc5ca40daa09a2b7c363727b8 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:21.144451 19604 tablet_service.cc:1511] Processing CreateTablet for tablet 1f37f98f577248938245361e2def9199 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:21.145462 19602 tablet_service.cc:1511] Processing CreateTablet for tablet 69848ac78e1148979677509a52df8579 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:21.146137 19604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f37f98f577248938245361e2def9199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.147075 19605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b9096dc5ca40daa09a2b7c363727b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.147965 19454 tablet_service.cc:1511] Processing CreateTablet for tablet d5ae544f1a5a48daaf69cfa73c5cd0f0 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:21.148180 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 1d038c6c55134b638eaef82cd6b71573 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:21.148444 19603 tablet_service.cc:1511] Processing CreateTablet for tablet d5ae544f1a5a48daaf69cfa73c5cd0f0 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:21.150065 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ae544f1a5a48daaf69cfa73c5cd0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.153038 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d038c6c55134b638eaef82cd6b71573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.153306 19600 tablet_service.cc:1511] Processing CreateTablet for tablet c84d156f10b946a5a606abc4b01e0285 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:21.154861 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84d156f10b946a5a606abc4b01e0285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.159000 19599 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd5407becc24ba795d7005349f58dba (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:21.160614 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd5407becc24ba795d7005349f58dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.161736 19452 tablet_service.cc:1511] Processing CreateTablet for tablet 1d038c6c55134b638eaef82cd6b71573 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:21.163297 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d038c6c55134b638eaef82cd6b71573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.164601 19598 tablet_service.cc:1511] Processing CreateTablet for tablet ee1c455f49944115869891cf2ed24fbd (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:21.159046 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 69848ac78e1148979677509a52df8579 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:21.167624 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69848ac78e1148979677509a52df8579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.170738 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 54a73a0103c74ee1960ca0d4e885676d (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:21.171959 19603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ae544f1a5a48daaf69cfa73c5cd0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.172748 19602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69848ac78e1148979677509a52df8579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.173542 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1c455f49944115869891cf2ed24fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.174270 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a73a0103c74ee1960ca0d4e885676d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.181504 19525 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd5407becc24ba795d7005349f58dba (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:21.181982 19531 tablet_service.cc:1511] Processing CreateTablet for tablet 94b9096dc5ca40daa09a2b7c363727b8 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:21.183251 19525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd5407becc24ba795d7005349f58dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.184492 19530 tablet_service.cc:1511] Processing CreateTablet for tablet 1f37f98f577248938245361e2def9199 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:21.186110 19524 tablet_service.cc:1511] Processing CreateTablet for tablet ee1c455f49944115869891cf2ed24fbd (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:21.186111 19530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f37f98f577248938245361e2def9199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.187322 19529 tablet_service.cc:1511] Processing CreateTablet for tablet d5ae544f1a5a48daaf69cfa73c5cd0f0 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:21.189991 19528 tablet_service.cc:1511] Processing CreateTablet for tablet 69848ac78e1148979677509a52df8579 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:21.190785 19524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1c455f49944115869891cf2ed24fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.191593 19528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69848ac78e1148979677509a52df8579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.194051 19527 tablet_service.cc:1511] Processing CreateTablet for tablet 1d038c6c55134b638eaef82cd6b71573 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:21.196506 19526 tablet_service.cc:1511] Processing CreateTablet for tablet c84d156f10b946a5a606abc4b01e0285 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:21.198058 19531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94b9096dc5ca40daa09a2b7c363727b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.199658 19529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ae544f1a5a48daaf69cfa73c5cd0f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.202586 19523 tablet_service.cc:1511] Processing CreateTablet for tablet 54a73a0103c74ee1960ca0d4e885676d (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:21.204195 19523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a73a0103c74ee1960ca0d4e885676d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.205255 19527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d038c6c55134b638eaef82cd6b71573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.206869 19526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84d156f10b946a5a606abc4b01e0285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.232992 19451 tablet_service.cc:1511] Processing CreateTablet for tablet c84d156f10b946a5a606abc4b01e0285 (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:21.234810 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84d156f10b946a5a606abc4b01e0285. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.244547 19450 tablet_service.cc:1511] Processing CreateTablet for tablet 4bd5407becc24ba795d7005349f58dba (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:21.246315 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bd5407becc24ba795d7005349f58dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.250204 19449 tablet_service.cc:1511] Processing CreateTablet for tablet ee1c455f49944115869891cf2ed24fbd (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:21.251770 19449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1c455f49944115869891cf2ed24fbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.254180 19448 tablet_service.cc:1511] Processing CreateTablet for tablet 54a73a0103c74ee1960ca0d4e885676d (DEFAULT_TABLE table=test-workload [id=741f2339143d48adb433a582dd8c2e73]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:21.255620 19448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a73a0103c74ee1960ca0d4e885676d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:21.314859 19658 tablet_bootstrap.cc:492] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.323030 19658 tablet_bootstrap.cc:654] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.347183 19659 tablet_bootstrap.cc:492] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.352236 19658 tablet_bootstrap.cc:492] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.352931 19658 ts_tablet_manager.cc:1403] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.005s
I20260709 13:20:21.354322 19659 tablet_bootstrap.cc:654] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.360122 19658 raft_consensus.cc:359] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.361409 19658 raft_consensus.cc:385] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.361955 19658 raft_consensus.cc:740] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.370014 19658 consensus_queue.cc:260] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.370612 19661 tablet_bootstrap.cc:492] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.372982 19640 heartbeater.cc:499] Master 127.7.122.126:36875 was elected leader, sending a full tablet report...
I20260709 13:20:21.375624 19658 ts_tablet_manager.cc:1434] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.003s
I20260709 13:20:21.377079 19658 tablet_bootstrap.cc:492] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.379304 19659 tablet_bootstrap.cc:492] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.379648 19661 tablet_bootstrap.cc:654] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.379943 19659 ts_tablet_manager.cc:1403] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 13:20:21.384079 19659 raft_consensus.cc:359] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.384918 19659 raft_consensus.cc:385] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.385143 19658 tablet_bootstrap.cc:654] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.385257 19659 raft_consensus.cc:740] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.386704 19659 consensus_queue.cc:260] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.399941 19658 tablet_bootstrap.cc:492] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.401163 19658 ts_tablet_manager.cc:1403] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.009s
I20260709 13:20:21.404709 19659 ts_tablet_manager.cc:1434] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.012s
I20260709 13:20:21.405782 19491 heartbeater.cc:499] Master 127.7.122.126:36875 was elected leader, sending a full tablet report...
I20260709 13:20:21.405876 19661 tablet_bootstrap.cc:492] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:21.406165 19659 tablet_bootstrap.cc:492] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.406668 19661 ts_tablet_manager.cc:1403] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.017s
I20260709 13:20:21.411136 19661 raft_consensus.cc:359] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.412073 19661 raft_consensus.cc:385] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.412447 19661 raft_consensus.cc:740] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.405167 19658 raft_consensus.cc:359] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.413479 19658 raft_consensus.cc:385] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.414160 19659 tablet_bootstrap.cc:654] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.414310 19658 raft_consensus.cc:740] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.413511 19661 consensus_queue.cc:260] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.415406 19658 consensus_queue.cc:260] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.418042 19658 ts_tablet_manager.cc:1434] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:20:21.419157 19658 tablet_bootstrap.cc:492] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.424381 19661 ts_tablet_manager.cc:1434] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:20:21.426283 19658 tablet_bootstrap.cc:654] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.426283 19661 tablet_bootstrap.cc:492] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.427735 19566 heartbeater.cc:499] Master 127.7.122.126:36875 was elected leader, sending a full tablet report...
I20260709 13:20:21.437024 19659 tablet_bootstrap.cc:492] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.437680 19659 ts_tablet_manager.cc:1403] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.010s
I20260709 13:20:21.440529 19661 tablet_bootstrap.cc:654] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.440949 19659 raft_consensus.cc:359] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.441828 19659 raft_consensus.cc:385] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.442246 19659 raft_consensus.cc:740] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.443270 19659 consensus_queue.cc:260] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
W20260709 13:20:21.443981 19412 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:21.446174 19659 ts_tablet_manager.cc:1434] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
W20260709 13:20:21.447100 19492 tablet.cc:2406] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:21.447824 19659 tablet_bootstrap.cc:492] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.452800 19665 raft_consensus.cc:493] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.453785 19665 raft_consensus.cc:515] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.458266 19659 tablet_bootstrap.cc:654] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.468842 19665 leader_election.cc:290] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.471498 19659 tablet_bootstrap.cc:492] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.472246 19659 ts_tablet_manager.cc:1403] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.008s
I20260709 13:20:21.475312 19661 tablet_bootstrap.cc:492] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:21.477082 19661 ts_tablet_manager.cc:1403] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.005s
I20260709 13:20:21.476574 19659 raft_consensus.cc:359] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.478919 19659 raft_consensus.cc:385] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.479300 19659 raft_consensus.cc:740] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.480379 19659 consensus_queue.cc:260] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.483250 19659 ts_tablet_manager.cc:1434] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:20:21.484501 19659 tablet_bootstrap.cc:492] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.485520 19658 tablet_bootstrap.cc:492] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.486238 19658 ts_tablet_manager.cc:1403] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.029s
I20260709 13:20:21.488395 19661 raft_consensus.cc:359] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.490168 19658 raft_consensus.cc:359] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.493252 19661 raft_consensus.cc:385] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.493454 19658 raft_consensus.cc:385] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.493711 19661 raft_consensus.cc:740] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.493834 19658 raft_consensus.cc:740] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.491384 19659 tablet_bootstrap.cc:654] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.496764 19661 consensus_queue.cc:260] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.494695 19658 consensus_queue.cc:260] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.499215 19661 ts_tablet_manager.cc:1434] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:20:21.499893 19658 ts_tablet_manager.cc:1434] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:20:21.500329 19661 tablet_bootstrap.cc:492] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.501088 19658 tablet_bootstrap.cc:492] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.512024 19658 tablet_bootstrap.cc:654] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.513077 19663 raft_consensus.cc:493] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.513914 19663 raft_consensus.cc:515] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.518184 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69848ac78e1148979677509a52df8579" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.519060 19541 raft_consensus.cc:2468] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:21.520780 19432 leader_election.cc:304] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:21.522330 19659 tablet_bootstrap.cc:492] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.523051 19659 ts_tablet_manager.cc:1403] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.007s
I20260709 13:20:21.522900 19665 raft_consensus.cc:2804] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.525823 19665 raft_consensus.cc:493] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.526393 19665 raft_consensus.cc:3060] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.527287 19659 raft_consensus.cc:359] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.528262 19659 raft_consensus.cc:385] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.529819 19659 raft_consensus.cc:740] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.530692 19659 consensus_queue.cc:260] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.531423 19658 tablet_bootstrap.cc:492] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.532042 19658 ts_tablet_manager.cc:1403] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.010s
I20260709 13:20:21.532966 19663 leader_election.cc:290] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:21.535974 19658 raft_consensus.cc:359] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.536934 19658 raft_consensus.cc:385] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.537248 19658 raft_consensus.cc:740] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.538009 19658 consensus_queue.cc:260] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.539140 19663 raft_consensus.cc:493] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.539721 19663 raft_consensus.cc:515] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.543259 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
W20260709 13:20:21.545734 19579 leader_election.cc:343] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.563961 19663 leader_election.cc:290] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:21.563750 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:21.565172 19466 raft_consensus.cc:2468] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:21.567265 19681 raft_consensus.cc:493] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.569141 19579 leader_election.cc:304] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:21.571105 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69848ac78e1148979677509a52df8579" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:21.548359 19665 raft_consensus.cc:515] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.577608 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69848ac78e1148979677509a52df8579" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:21.578392 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.578563 19541 raft_consensus.cc:3060] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.581996 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
W20260709 13:20:21.584504 19581 leader_election.cc:343] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.585626 19581 leader_election.cc:304] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a079720156944039b22ad6526547f3a3; no voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:21.590160 19667 raft_consensus.cc:493] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.591049 19667 raft_consensus.cc:515] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.595758 19679 raft_consensus.cc:493] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.596807 19679 raft_consensus.cc:515] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.607329 19661 tablet_bootstrap.cc:654] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.610508 19667 leader_election.cc:290] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.620028 19663 raft_consensus.cc:2804] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.621090 19663 raft_consensus.cc:493] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.621968 19663 raft_consensus.cc:3060] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.627794 19682 raft_consensus.cc:2749] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:20:21.628398 19581 leader_election.cc:343] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.630805 19682 raft_consensus.cc:493] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.631467 19682 raft_consensus.cc:515] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.624842 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.568148 19681 raft_consensus.cc:515] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.638053 19681 leader_election.cc:290] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:21.639273 19615 raft_consensus.cc:2468] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:21.647028 19682 leader_election.cc:290] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
W20260709 13:20:21.644306 19432 leader_election.cc:343] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.655949 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69848ac78e1148979677509a52df8579" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:21.656689 19658 ts_tablet_manager.cc:1434] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.124s	user 0.051s	sys 0.055s
I20260709 13:20:21.657037 19466 raft_consensus.cc:2393] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a079720156944039b22ad6526547f3a3 in current term 1: Already voted for candidate f0bf4771859f4045958021e7ea1be493 in this term.
I20260709 13:20:21.660948 19539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.661425 19658 tablet_bootstrap.cc:492] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.664260 19665 leader_election.cc:290] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.658700 19679 leader_election.cc:290] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.665637 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:21.666702 19465 raft_consensus.cc:2468] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:21.651713 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69848ac78e1148979677509a52df8579" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.671216 19658 tablet_bootstrap.cc:654] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.672951 19541 raft_consensus.cc:2468] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:21.673002 19663 raft_consensus.cc:515] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.674724 19432 leader_election.cc:304] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:21.676568 19579 leader_election.cc:304] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:21.677845 19663 leader_election.cc:290] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:21.678514 19663 raft_consensus.cc:2804] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.679548 19678 raft_consensus.cc:2804] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.680146 19678 raft_consensus.cc:697] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
W20260709 13:20:21.679895 19581 leader_election.cc:343] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.681066 19678 consensus_queue.cc:237] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.678835 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
W20260709 13:20:21.684479 19504 leader_election.cc:343] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a079720156944039b22ad6526547f3a3 (127.7.122.67:34141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.682852 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:21.686337 19465 raft_consensus.cc:3060] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.681869 19581 leader_election.cc:304] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a079720156944039b22ad6526547f3a3; no voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:21.693192 19682 raft_consensus.cc:3060] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.694007 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
W20260709 13:20:21.695930 19505 leader_election.cc:343] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.696593 19505 leader_election.cc:304] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880; no voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:21.697561 19667 raft_consensus.cc:2749] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.678874 19663 raft_consensus.cc:493] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.698197 19659 ts_tablet_manager.cc:1434] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.174s	user 0.036s	sys 0.074s
I20260709 13:20:21.703594 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:21.705737 19661 tablet_bootstrap.cc:492] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:21.705848 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69848ac78e1148979677509a52df8579" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:21.702459 19663 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.706713 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:21.709054 19465 raft_consensus.cc:2468] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:21.703995 19659 tablet_bootstrap.cc:492] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.709146 19661 ts_tablet_manager.cc:1403] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.208s	user 0.029s	sys 0.006s
I20260709 13:20:21.713274 19579 leader_election.cc:304] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:21.714277 19682 raft_consensus.cc:2749] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.714471 19680 raft_consensus.cc:2804] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.715175 19680 raft_consensus.cc:697] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:21.716078 19680 consensus_queue.cc:237] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.719278 19363 catalog_manager.cc:5697] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.720803 19663 raft_consensus.cc:515] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.722415 19615 raft_consensus.cc:2393] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0bf4771859f4045958021e7ea1be493 in current term 1: Already voted for candidate a079720156944039b22ad6526547f3a3 in this term.
I20260709 13:20:21.723757 19663 leader_election.cc:290] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:21.720928 19658 tablet_bootstrap.cc:492] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.725014 19658 ts_tablet_manager.cc:1403] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.065s	user 0.031s	sys 0.010s
I20260709 13:20:21.725109 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:21.725801 19466 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:21.727486 19581 leader_election.cc:343] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.727793 19614 raft_consensus.cc:2468] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:21.732056 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:21.736284 19659 tablet_bootstrap.cc:654] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.735916 19466 raft_consensus.cc:2468] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:21.738448 19579 leader_election.cc:304] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:21.739450 19682 raft_consensus.cc:2804] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.739974 19682 raft_consensus.cc:697] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:21.740556 19661 raft_consensus.cc:359] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.740852 19658 raft_consensus.cc:359] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.741967 19658 raft_consensus.cc:385] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.741477 19682 consensus_queue.cc:237] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.742211 19429 leader_election.cc:304] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:21.743742 19678 raft_consensus.cc:2749] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.742304 19658 raft_consensus.cc:740] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.744776 19658 consensus_queue.cc:260] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.747562 19658 ts_tablet_manager.cc:1434] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:20:21.749312 19658 tablet_bootstrap.cc:492] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.754020 19361 catalog_manager.cc:5697] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:21.755465 19581 leader_election.cc:343] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.741477 19661 raft_consensus.cc:385] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.757395 19661 raft_consensus.cc:740] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.758682 19661 consensus_queue.cc:260] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.765517 19661 ts_tablet_manager.cc:1434] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:20:21.767369 19661 tablet_bootstrap.cc:492] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.768361 19658 tablet_bootstrap.cc:654] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.763345 19659 tablet_bootstrap.cc:492] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.770857 19659 ts_tablet_manager.cc:1403] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.005s
I20260709 13:20:21.774472 19659 raft_consensus.cc:359] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.775838 19659 raft_consensus.cc:385] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.776350 19659 raft_consensus.cc:740] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.776661 19661 tablet_bootstrap.cc:654] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.782368 19658 tablet_bootstrap.cc:492] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.783196 19658 ts_tablet_manager.cc:1403] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.005s
I20260709 13:20:21.784888 19659 consensus_queue.cc:260] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.787492 19661 tablet_bootstrap.cc:492] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:21.787165 19658 raft_consensus.cc:359] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.788021 19659 ts_tablet_manager.cc:1434] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:20:21.788071 19658 raft_consensus.cc:385] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.788632 19658 raft_consensus.cc:740] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.788695 19661 ts_tablet_manager.cc:1403] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.009s
I20260709 13:20:21.789621 19659 tablet_bootstrap.cc:492] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.789965 19658 consensus_queue.cc:260] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.793232 19658 ts_tablet_manager.cc:1434] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:20:21.792634 19661 raft_consensus.cc:359] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.794160 19661 raft_consensus.cc:385] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.794746 19661 raft_consensus.cc:740] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.795687 19661 consensus_queue.cc:260] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:21.797510 19659 tablet_bootstrap.cc:654] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.798442 19661 ts_tablet_manager.cc:1434] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:21.799960 19661 tablet_bootstrap.cc:492] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.807024 19658 tablet_bootstrap.cc:492] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.811339 19678 raft_consensus.cc:493] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.811990 19678 raft_consensus.cc:515] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.814725 19678 leader_election.cc:290] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.815764 19661 tablet_bootstrap.cc:654] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.816454 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.817788 19659 tablet_bootstrap.cc:492] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.818553 19361 catalog_manager.cc:5697] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.818373 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:21.819756 19659 ts_tablet_manager.cc:1403] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.010s
I20260709 13:20:21.820166 19614 raft_consensus.cc:2468] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
W20260709 13:20:21.821594 19432 leader_election.cc:343] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.822446 19429 leader_election.cc:304] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:21.818931 19658 tablet_bootstrap.cc:654] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.823074 19659 raft_consensus.cc:359] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.823655 19678 raft_consensus.cc:2804] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.823936 19659 raft_consensus.cc:385] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.824110 19678 raft_consensus.cc:493] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.824286 19659 raft_consensus.cc:740] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.824549 19678 raft_consensus.cc:3060] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.825127 19659 consensus_queue.cc:260] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.827551 19659 ts_tablet_manager.cc:1434] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:21.828577 19659 tablet_bootstrap.cc:492] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.837462 19661 tablet_bootstrap.cc:492] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:21.838331 19661 ts_tablet_manager.cc:1403] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.006s
I20260709 13:20:21.843923 19659 tablet_bootstrap.cc:654] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.842805 19661 raft_consensus.cc:359] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.845373 19661 raft_consensus.cc:385] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.845785 19661 raft_consensus.cc:740] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.846910 19658 tablet_bootstrap.cc:492] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.846696 19661 consensus_queue.cc:260] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.847461 19658 ts_tablet_manager.cc:1403] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.013s
I20260709 13:20:21.849310 19661 ts_tablet_manager.cc:1434] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.002s
I20260709 13:20:21.849311 19665 raft_consensus.cc:493] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.850366 19665 raft_consensus.cc:515] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.850999 19658 raft_consensus.cc:359] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.851976 19658 raft_consensus.cc:385] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.852380 19658 raft_consensus.cc:740] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.853174 19665 leader_election.cc:290] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.853339 19658 consensus_queue.cc:260] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.854410 19678 raft_consensus.cc:515] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.856176 19658 ts_tablet_manager.cc:1434] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.005s
I20260709 13:20:21.856438 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:21.856791 19678 leader_election.cc:290] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.858196 19658 tablet_bootstrap.cc:492] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.859028 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:21.859865 19614 raft_consensus.cc:3060] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.860895 19661 tablet_bootstrap.cc:492] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.867013 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.867542 19658 tablet_bootstrap.cc:654] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.868160 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
W20260709 13:20:21.870065 19432 leader_election.cc:343] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:21.871379 19432 leader_election.cc:343] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:21.872570 19429 leader_election.cc:343] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a079720156944039b22ad6526547f3a3 (127.7.122.67:34141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.873745 19429 leader_election.cc:304] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:21.882797 19661 tablet_bootstrap.cc:654] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.889020 19614 raft_consensus.cc:2468] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:21.890508 19678 raft_consensus.cc:2749] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.890940 19659 tablet_bootstrap.cc:492] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.892354 19659 ts_tablet_manager.cc:1403] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.020s
I20260709 13:20:21.892531 19429 leader_election.cc:304] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:21.894673 19678 raft_consensus.cc:2804] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.896080 19678 raft_consensus.cc:697] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:21.896560 19658 tablet_bootstrap.cc:492] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.897192 19658 ts_tablet_manager.cc:1403] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.014s
I20260709 13:20:21.897938 19659 raft_consensus.cc:359] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.897156 19678 consensus_queue.cc:237] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.898731 19659 raft_consensus.cc:385] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.899313 19659 raft_consensus.cc:740] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.900699 19661 tablet_bootstrap.cc:492] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:21.900508 19659 consensus_queue.cc:260] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.901336 19661 ts_tablet_manager.cc:1403] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.006s
I20260709 13:20:21.904425 19659 ts_tablet_manager.cc:1434] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 13:20:21.905705 19659 tablet_bootstrap.cc:492] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:21.906412 19661 raft_consensus.cc:359] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.907829 19661 raft_consensus.cc:385] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.908155 19661 raft_consensus.cc:740] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.905393 19658 raft_consensus.cc:359] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.909447 19658 raft_consensus.cc:385] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.910198 19658 raft_consensus.cc:740] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.909031 19661 consensus_queue.cc:260] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.911511 19658 consensus_queue.cc:260] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.914084 19658 ts_tablet_manager.cc:1434] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:20:21.915984 19658 tablet_bootstrap.cc:492] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:21.918363 19661 ts_tablet_manager.cc:1434] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 13:20:21.920320 19661 tablet_bootstrap.cc:492] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:21.921886 19362 catalog_manager.cc:5697] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.925240 19667 raft_consensus.cc:493] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.925825 19667 raft_consensus.cc:515] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.928004 19661 tablet_bootstrap.cc:654] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.928105 19667 leader_election.cc:290] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.925211 19658 tablet_bootstrap.cc:654] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.929339 19665 raft_consensus.cc:493] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.942400 19665 raft_consensus.cc:515] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.929584 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:21.946091 19614 raft_consensus.cc:2468] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:21.930902 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:21.950598 19504 leader_election.cc:304] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:21.952795 19667 raft_consensus.cc:2804] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.953244 19667 raft_consensus.cc:493] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.953567 19667 raft_consensus.cc:3060] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.955546 19658 tablet_bootstrap.cc:492] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:21.956135 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:21.956714 19658 ts_tablet_manager.cc:1403] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.004s
W20260709 13:20:21.957356 19505 leader_election.cc:343] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:21.957985 19432 leader_election.cc:343] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.962535 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:21.960799 19658 raft_consensus.cc:359] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.965695 19614 raft_consensus.cc:2468] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:21.966248 19658 raft_consensus.cc:385] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.968039 19658 raft_consensus.cc:740] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.964162 19667 raft_consensus.cc:515] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.968508 19429 leader_election.cc:304] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:21.969260 19658 consensus_queue.cc:260] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.971760 19678 raft_consensus.cc:2804] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.962680 19665 leader_election.cc:290] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.972483 19678 raft_consensus.cc:493] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.973340 19678 raft_consensus.cc:3060] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.975023 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:21.975448 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:21.975845 19615 raft_consensus.cc:3060] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:21.977211 19505 leader_election.cc:343] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.984476 19667 leader_election.cc:290] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.971937 19658 ts_tablet_manager.cc:1434] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:20:21.986611 19659 tablet_bootstrap.cc:654] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.987362 19678 raft_consensus.cc:515] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:21.992374 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:21.994259 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
W20260709 13:20:21.994673 19432 leader_election.cc:343] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.995647 19659 tablet_bootstrap.cc:492] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:21.995292 19614 raft_consensus.cc:3060] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.992374 19615 raft_consensus.cc:2468] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:21.996165 19678 leader_election.cc:290] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:21.999419 19659 ts_tablet_manager.cc:1403] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.007s
I20260709 13:20:21.999214 19504 leader_election.cc:304] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.000669 19667 raft_consensus.cc:2804] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.003458 19659 raft_consensus.cc:359] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.004361 19659 raft_consensus.cc:385] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.005128 19659 raft_consensus.cc:740] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.006024 19667 raft_consensus.cc:697] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:22.006088 19661 tablet_bootstrap.cc:492] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:22.006309 19659 consensus_queue.cc:260] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.007340 19661 ts_tablet_manager.cc:1403] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.087s	user 0.038s	sys 0.031s
I20260709 13:20:22.007388 19667 consensus_queue.cc:237] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.009773 19659 ts_tablet_manager.cc:1434] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:20:22.011390 19659 tablet_bootstrap.cc:492] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:22.011516 19661 raft_consensus.cc:359] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.012351 19661 raft_consensus.cc:385] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.012665 19661 raft_consensus.cc:740] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.013533 19661 consensus_queue.cc:260] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.014605 19614 raft_consensus.cc:2468] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:22.016058 19429 leader_election.cc:304] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:22.016271 19661 ts_tablet_manager.cc:1434] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:22.017678 19661 tablet_bootstrap.cc:492] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:22.018152 19659 tablet_bootstrap.cc:654] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.017927 19678 raft_consensus.cc:2804] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.019507 19678 raft_consensus.cc:697] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:22.020731 19678 consensus_queue.cc:237] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.026240 19661 tablet_bootstrap.cc:654] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.027838 19707 raft_consensus.cc:493] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.028601 19707 raft_consensus.cc:515] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.032433 19707 leader_election.cc:290] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.032822 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:22.035287 19682 raft_consensus.cc:493] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.035720 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:22.035899 19682 raft_consensus.cc:515] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.036540 19614 raft_consensus.cc:2393] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13f3b9cb92d842adab53cfae0f465880 in current term 1: Already voted for candidate f0bf4771859f4045958021e7ea1be493 in this term.
I20260709 13:20:22.037901 19504 leader_election.cc:304] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880; no voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.038223 19682 leader_election.cc:290] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.041133 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:22.041867 19466 raft_consensus.cc:2468] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:22.040544 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:22.043347 19540 raft_consensus.cc:2468] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:22.044853 19581 leader_election.cc:304] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:22.044365 19362 catalog_manager.cc:5697] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.047055 19667 raft_consensus.cc:3060] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.047242 19659 tablet_bootstrap.cc:492] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:22.047935 19682 raft_consensus.cc:2804] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.048472 19682 raft_consensus.cc:493] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.049088 19682 raft_consensus.cc:3060] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.048295 19659 ts_tablet_manager.cc:1403] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.027s
I20260709 13:20:22.050383 19680 raft_consensus.cc:493] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.050927 19680 raft_consensus.cc:515] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.053453 19680 leader_election.cc:290] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.054396 19659 raft_consensus.cc:359] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.055570 19659 raft_consensus.cc:385] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.056028 19659 raft_consensus.cc:740] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.056376 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:22.057196 19540 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:22.057337 19659 consensus_queue.cc:260] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.058740 19581 leader_election.cc:304] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:22.060106 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:22.060906 19466 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:22.061640 19659 ts_tablet_manager.cc:1434] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:20:22.063045 19680 raft_consensus.cc:2804] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.063545 19680 raft_consensus.cc:493] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.063915 19680 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.068586 19682 raft_consensus.cc:515] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.071226 19682 leader_election.cc:290] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.074620 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:22.075970 19540 raft_consensus.cc:3060] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.079496 19661 tablet_bootstrap.cc:492] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:22.080344 19661 ts_tablet_manager.cc:1403] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.025s
I20260709 13:20:22.083252 19667 raft_consensus.cc:2749] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:22.083485 19661 raft_consensus.cc:359] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.082675 19362 catalog_manager.cc:5697] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.084304 19661 raft_consensus.cc:385] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.084681 19661 raft_consensus.cc:740] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.085606 19661 consensus_queue.cc:260] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.088335 19661 ts_tablet_manager.cc:1434] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:22.088061 19680 raft_consensus.cc:515] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.089437 19661 tablet_bootstrap.cc:492] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:22.089819 19540 raft_consensus.cc:2468] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:22.090710 19678 consensus_queue.cc:1048] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.090998 19680 leader_election.cc:290] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.093341 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:22.093675 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:22.077543 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:22.094148 19541 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.094271 19465 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.094403 19466 raft_consensus.cc:3060] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.097635 19581 leader_election.cc:304] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:22.104949 19661 tablet_bootstrap.cc:654] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:22.106518 19680 raft_consensus.cc:2804] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.112978 19680 raft_consensus.cc:697] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.114625 19680 consensus_queue.cc:237] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.108449 19466 raft_consensus.cc:2468] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:22.108575 19465 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:22.109349 19682 raft_consensus.cc:493] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.111147 19541 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:22.122220 19581 leader_election.cc:304] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:22.122869 19682 raft_consensus.cc:515] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.123504 19663 raft_consensus.cc:2804] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.125000 19663 raft_consensus.cc:697] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.127946 19682 leader_election.cc:290] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.129521 19661 tablet_bootstrap.cc:492] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:22.130102 19661 ts_tablet_manager.cc:1403] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.006s
I20260709 13:20:22.132112 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:22.133525 19464 raft_consensus.cc:2468] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:22.137732 19579 leader_election.cc:304] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.138468 19661 raft_consensus.cc:359] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.139071 19681 raft_consensus.cc:2804] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:22.139598 19661 raft_consensus.cc:385] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:22.140038 19661 raft_consensus.cc:740] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:22.141460 19661 consensus_queue.cc:260] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.140055 19681 raft_consensus.cc:493] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:22.143725 19681 raft_consensus.cc:3060] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.144438 19661 ts_tablet_manager.cc:1434] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:20:22.138530 19667 raft_consensus.cc:493] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.145628 19667 raft_consensus.cc:515] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.147643 19667 leader_election.cc:290] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.149341 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:22.150287 19540 raft_consensus.cc:2468] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:22.149348 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:22.152400 19679 consensus_queue.cc:1048] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.155754 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:22.156941 19464 raft_consensus.cc:2393] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 13f3b9cb92d842adab53cfae0f465880 in current term 1: Already voted for candidate a079720156944039b22ad6526547f3a3 in this term.
I20260709 13:20:22.159135 19505 leader_election.cc:304] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880; no voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.126734 19663 consensus_queue.cc:237] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.164794 19667 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.182718 19681 raft_consensus.cc:515] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.189688 19681 leader_election.cc:290] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.189785 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:22.190593 19540 raft_consensus.cc:3060] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.197506 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:22.198573 19466 raft_consensus.cc:3060] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.199492 19667 raft_consensus.cc:2749] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:22.204434 19364 catalog_manager.cc:5697] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.211726 19466 raft_consensus.cc:2468] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:22.204090 19680 consensus_queue.cc:1048] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:20:22.216984 19579 leader_election.cc:304] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.221048 19540 raft_consensus.cc:2468] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:22.221660 19681 raft_consensus.cc:2804] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:22.222486 19681 raft_consensus.cc:697] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.223680 19681 consensus_queue.cc:237] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.227501 19707 raft_consensus.cc:493] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.228570 19707 raft_consensus.cc:515] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:22.228998 19364 catalog_manager.cc:5697] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.237138 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:22.237432 19707 leader_election.cc:290] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.238549 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:22.240763 19505 leader_election.cc:304] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880; no voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.243199 19707 raft_consensus.cc:2749] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:22.244056 19540 raft_consensus.cc:3060] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.244999 19679 raft_consensus.cc:493] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.245551 19679 raft_consensus.cc:515] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.247725 19679 leader_election.cc:290] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.249842 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:22.249842 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:22.251863 19614 raft_consensus.cc:2393] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0bf4771859f4045958021e7ea1be493 in current term 1: Already voted for candidate 13f3b9cb92d842adab53cfae0f465880 in this term.
I20260709 13:20:22.252794 19429 leader_election.cc:304] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:22.253688 19679 raft_consensus.cc:3060] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.258605 19682 consensus_queue.cc:1048] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.260505 19682 consensus_queue.cc:1048] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.263123 19679 raft_consensus.cc:2749] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:22.274474 19362 catalog_manager.cc:5697] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:22.322326 19681 consensus_queue.cc:1048] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.420166 19679 consensus_queue.cc:1048] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.421479 19707 consensus_queue.cc:1048] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.437595 19678 consensus_queue.cc:1048] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.438645 19707 consensus_queue.cc:1048] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.464093 19540 raft_consensus.cc:3060] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.472412 19665 consensus_queue.cc:1048] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.487901 19665 consensus_queue.cc:1048] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.534912 19682 consensus_queue.cc:1048] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.550534 19615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8"
dest_uuid: "a079720156944039b22ad6526547f3a3"
mode: GRACEFUL
new_leader_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:20:22.551294 19615 raft_consensus.cc:606] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Received request to transfer leadership to TS f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.551811 19682 consensus_queue.cc:1048] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.561959 19615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f37f98f577248938245361e2def9199"
dest_uuid: "a079720156944039b22ad6526547f3a3"
mode: GRACEFUL
new_leader_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:20:22.562633 19615 raft_consensus.cc:606] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Received request to transfer leadership to TS f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.580924 19540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
mode: GRACEFUL
new_leader_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:20:22.581527 19540 raft_consensus.cc:606] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Received request to transfer leadership to TS f0bf4771859f4045958021e7ea1be493
I20260709 13:20:22.591398 19615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573"
dest_uuid: "a079720156944039b22ad6526547f3a3"
mode: GRACEFUL
new_leader_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:20:22.591995 19615 raft_consensus.cc:606] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Received request to transfer leadership to TS 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:22.607852 19466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
mode: GRACEFUL
new_leader_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:20:22.608428 19466 raft_consensus.cc:606] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Received request to transfer leadership to TS 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:22.614871 19615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba"
dest_uuid: "a079720156944039b22ad6526547f3a3"
mode: GRACEFUL
new_leader_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:20:22.615475 19615 raft_consensus.cc:606] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Received request to transfer leadership to TS 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:22.622076 19615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd"
dest_uuid: "a079720156944039b22ad6526547f3a3"
mode: GRACEFUL
new_leader_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:20:22.622671 19615 raft_consensus.cc:606] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Received request to transfer leadership to TS 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:22.630065 19466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
mode: GRACEFUL
new_leader_uuid: "a079720156944039b22ad6526547f3a3"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:20:22.630712 19466 raft_consensus.cc:606] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Received request to transfer leadership to TS a079720156944039b22ad6526547f3a3
I20260709 13:20:22.633555 19680 consensus_queue.cc:1048] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.642747 19682 raft_consensus.cc:993] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: : Instructing follower 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:22.643452 19681 raft_consensus.cc:1081] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Signalling peer 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:22.646494 19541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:51998
I20260709 13:20:22.647501 19541 raft_consensus.cc:493] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.648025 19541 raft_consensus.cc:3060] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.657593 19681 consensus_queue.cc:1048] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.658586 19541 raft_consensus.cc:515] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.660601 19540 raft_consensus.cc:1240] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Rejecting Update request from peer a079720156944039b22ad6526547f3a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:22.665063 19681 consensus_queue.cc:1059] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.665912 19663 raft_consensus.cc:3055] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.666493 19663 raft_consensus.cc:740] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.668031 19663 consensus_queue.cc:260] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.669320 19663 raft_consensus.cc:3060] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.669760 19541 leader_election.cc:290] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.669646 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:22.670655 19466 raft_consensus.cc:3060] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.671272 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1c455f49944115869891cf2ed24fbd" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:22.676738 19466 raft_consensus.cc:2468] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:22.678612 19505 leader_election.cc:304] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.679515 19667 raft_consensus.cc:2804] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.680011 19667 raft_consensus.cc:697] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:22.680920 19667 consensus_queue.cc:237] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.687894 19615 raft_consensus.cc:2468] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:22.689409 19364 catalog_manager.cc:5697] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 1 to 2, leader changed from a079720156944039b22ad6526547f3a3 (127.7.122.67) to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.721400 19681 raft_consensus.cc:993] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: : Instructing follower f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:22.721910 19681 raft_consensus.cc:1081] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Signalling peer f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:22.723827 19466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:20:22.724418 19466 raft_consensus.cc:493] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.724718 19466 raft_consensus.cc:3060] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.732383 19466 raft_consensus.cc:515] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:22.734910 19466 leader_election.cc:290] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Requested vote from peers a079720156944039b22ad6526547f3a3 (127.7.122.67:34141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:22.736155 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:22.736374 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94b9096dc5ca40daa09a2b7c363727b8" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:22.736999 19615 raft_consensus.cc:3055] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.737068 19541 raft_consensus.cc:3060] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.737404 19615 raft_consensus.cc:740] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.738349 19615 consensus_queue.cc:260] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:22.739467 19615 raft_consensus.cc:3060] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.741317 19681 consensus_queue.cc:1048] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.746536 19541 raft_consensus.cc:2468] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:22.747288 19663 consensus_queue.cc:1048] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.748116 19432 leader_election.cc:304] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.747329 19615 raft_consensus.cc:2468] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:22.749377 19728 raft_consensus.cc:2804] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.749912 19728 raft_consensus.cc:697] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:22.750754 19728 consensus_queue.cc:237] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } }
I20260709 13:20:22.763612 19682 raft_consensus.cc:993] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: : Instructing follower 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:22.763065 19363 catalog_manager.cc:5697] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 1 to 2, leader changed from a079720156944039b22ad6526547f3a3 (127.7.122.67) to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.764222 19681 raft_consensus.cc:1081] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Signalling peer 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:22.766533 19540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:51998
I20260709 13:20:22.767594 19540 raft_consensus.cc:493] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.768024 19540 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.781440 19540 raft_consensus.cc:515] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.783439 19540 leader_election.cc:290] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.784482 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:22.784649 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:22.785365 19466 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.785573 19615 raft_consensus.cc:3055] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.786139 19615 raft_consensus.cc:740] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.787091 19615 consensus_queue.cc:260] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.788583 19615 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.792568 19466 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:22.793993 19505 leader_election.cc:304] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.794941 19667 raft_consensus.cc:2804] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.795480 19667 raft_consensus.cc:697] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:22.795567 19615 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:22.796497 19667 consensus_queue.cc:237] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.803728 19362 catalog_manager.cc:5697] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 1 to 2, leader changed from a079720156944039b22ad6526547f3a3 (127.7.122.67) to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.810323 19663 raft_consensus.cc:993] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: : Instructing follower f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:22.811069 19681 raft_consensus.cc:1081] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Signalling peer f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:22.814430 19466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f37f98f577248938245361e2def9199"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:56374
I20260709 13:20:22.815037 19466 raft_consensus.cc:493] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.815321 19466 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.821148 19466 raft_consensus.cc:515] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.822948 19466 leader_election.cc:290] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.824105 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:22.824106 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:22.825187 19540 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.825371 19615 raft_consensus.cc:3055] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.825790 19615 raft_consensus.cc:740] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:22.826532 19615 consensus_queue.cc:260] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.827867 19615 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.832909 19707 raft_consensus.cc:993] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: : Instructing follower f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:22.832723 19540 raft_consensus.cc:2468] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:22.833587 19667 raft_consensus.cc:1081] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Signalling peer f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:22.834596 19432 leader_election.cc:304] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.835497 19665 raft_consensus.cc:2804] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.835649 19615 raft_consensus.cc:2468] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:22.836069 19665 raft_consensus.cc:697] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:22.836072 19466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:56386
I20260709 13:20:22.836854 19466 raft_consensus.cc:493] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.837543 19466 raft_consensus.cc:3060] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.837211 19665 consensus_queue.cc:237] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.844472 19466 raft_consensus.cc:515] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.845646 19362 catalog_manager.cc:5697] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 1 to 2, leader changed from a079720156944039b22ad6526547f3a3 (127.7.122.67) to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.847827 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:22.848029 19466 leader_election.cc:290] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:22.849257 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ae544f1a5a48daaf69cfa73c5cd0f0" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:22.848654 19540 raft_consensus.cc:3055] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:22.850003 19615 raft_consensus.cc:3060] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.850315 19540 raft_consensus.cc:740] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:22.852010 19540 consensus_queue.cc:260] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.853394 19540 raft_consensus.cc:3060] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.860327 19540 raft_consensus.cc:2468] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:22.860327 19615 raft_consensus.cc:2468] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:22.862231 19432 leader_election.cc:304] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:22.863144 19665 raft_consensus.cc:2804] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:22.863675 19665 raft_consensus.cc:697] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:22.864699 19665 consensus_queue.cc:237] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.873560 19362 catalog_manager.cc:5697] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 1 to 2, leader changed from 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66) to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:22.986423 19678 raft_consensus.cc:993] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: : Instructing follower 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:22.986929 19678 raft_consensus.cc:1081] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Signalling peer 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:22.989004 19540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:51986
I20260709 13:20:22.989528 19540 raft_consensus.cc:493] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:22.989851 19540 raft_consensus.cc:3060] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:22.997550 19540 raft_consensus.cc:515] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:22.999408 19540 leader_election.cc:290] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:23.000478 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:23.001206 19466 raft_consensus.cc:3055] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.001055 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c84d156f10b946a5a606abc4b01e0285" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:23.001600 19466 raft_consensus.cc:740] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:23.002496 19466 consensus_queue.cc:260] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.002449 19615 raft_consensus.cc:3060] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.003716 19466 raft_consensus.cc:3060] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.009624 19466 raft_consensus.cc:2468] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:23.009727 19615 raft_consensus.cc:2468] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:23.011224 19505 leader_election.cc:304] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:23.012267 19667 raft_consensus.cc:2804] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.012899 19667 raft_consensus.cc:697] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:23.013859 19667 consensus_queue.cc:237] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.021788 19362 catalog_manager.cc:5697] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 1 to 2, leader changed from f0bf4771859f4045958021e7ea1be493 (127.7.122.65) to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.083734 19615 raft_consensus.cc:1275] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.085517 19667 consensus_queue.cc:1048] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.094224 19665 raft_consensus.cc:993] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: : Instructing follower a079720156944039b22ad6526547f3a3 to start an election
I20260709 13:20:23.094789 19728 raft_consensus.cc:1081] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Signalling peer a079720156944039b22ad6526547f3a3 to start an election
I20260709 13:20:23.099048 19615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d"
dest_uuid: "a079720156944039b22ad6526547f3a3"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:20:23.100282 19615 raft_consensus.cc:493] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.100765 19615 raft_consensus.cc:3060] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.101028 19466 raft_consensus.cc:1275] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.103402 19743 consensus_queue.cc:1048] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.107440 19680 raft_consensus.cc:993] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: : Instructing follower 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:23.111131 19663 raft_consensus.cc:1081] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Signalling peer 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:23.113306 19540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:51998
I20260709 13:20:23.114101 19540 raft_consensus.cc:493] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:23.114588 19540 raft_consensus.cc:3060] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.117708 19615 raft_consensus.cc:515] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.120110 19615 leader_election.cc:290] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:23.120832 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:23.121398 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a73a0103c74ee1960ca0d4e885676d" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:23.121585 19464 raft_consensus.cc:3055] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.122037 19541 raft_consensus.cc:3060] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.122383 19464 raft_consensus.cc:740] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:23.123462 19464 consensus_queue.cc:260] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.125020 19464 raft_consensus.cc:3060] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.136601 19464 raft_consensus.cc:2468] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 2.
I20260709 13:20:23.138610 19540 raft_consensus.cc:515] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.139856 19579 leader_election.cc:304] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:23.141237 19663 raft_consensus.cc:2804] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.141800 19663 raft_consensus.cc:697] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 2 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:23.141889 19540 leader_election.cc:290] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:23.143014 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:23.143132 19541 raft_consensus.cc:2468] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 2.
I20260709 13:20:23.143813 19464 raft_consensus.cc:3060] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.142702 19663 consensus_queue.cc:237] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.145377 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bd5407becc24ba795d7005349f58dba" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:23.146258 19615 raft_consensus.cc:3055] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:23.146579 19615 raft_consensus.cc:740] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:23.147442 19615 consensus_queue.cc:260] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.148983 19615 raft_consensus.cc:3060] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.151857 19541 raft_consensus.cc:1275] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.152416 19364 catalog_manager.cc:5697] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 1 to 2, leader changed from f0bf4771859f4045958021e7ea1be493 (127.7.122.65) to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 2 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.153496 19464 raft_consensus.cc:2468] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:23.153756 19665 consensus_queue.cc:1048] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.155678 19505 leader_election.cc:304] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:23.156618 19743 raft_consensus.cc:2804] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.156746 19615 raft_consensus.cc:2468] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:23.157189 19743 raft_consensus.cc:697] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:23.160594 19743 consensus_queue.cc:237] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:23.164736 19615 raft_consensus.cc:1275] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.166782 19665 consensus_queue.cc:1048] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.171087 19364 catalog_manager.cc:5697] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 1 to 2, leader changed from a079720156944039b22ad6526547f3a3 (127.7.122.67) to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.250679 19615 raft_consensus.cc:1275] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.252450 19665 consensus_queue.cc:1048] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.264209 19540 raft_consensus.cc:1275] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.266238 19744 consensus_queue.cc:1048] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.285081 19464 raft_consensus.cc:1275] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.286463 19743 consensus_queue.cc:1048] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.295791 19615 raft_consensus.cc:1275] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.298149 19743 consensus_queue.cc:1048] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.305351 19540 raft_consensus.cc:1275] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.307858 19744 consensus_queue.cc:1048] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:23.312788 19615 raft_consensus.cc:1275] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.314400 19665 consensus_queue.cc:1048] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.458473 19615 raft_consensus.cc:1275] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.460107 19743 consensus_queue.cc:1048] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.470963 19464 raft_consensus.cc:1275] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.473287 19743 consensus_queue.cc:1048] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.584239 19615 raft_consensus.cc:1275] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.585898 19743 consensus_queue.cc:1048] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.596377 19464 raft_consensus.cc:1275] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.598148 19707 consensus_queue.cc:1048] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:23.710325 19464 raft_consensus.cc:1275] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer a079720156944039b22ad6526547f3a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.711921 19663 consensus_queue.cc:1048] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:23.723762 19540 raft_consensus.cc:1275] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer a079720156944039b22ad6526547f3a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.725530 19752 consensus_queue.cc:1048] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:25.671823 19363 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33894:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:25.675128 19363 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:25.736152 19454 tablet_service.cc:1511] Processing CreateTablet for tablet 269069e75b534e84b2c449e2f154d93b (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:25.739399 19523 tablet_service.cc:1511] Processing CreateTablet for tablet 269069e75b534e84b2c449e2f154d93b (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:25.739496 19598 tablet_service.cc:1511] Processing CreateTablet for tablet 269069e75b534e84b2c449e2f154d93b (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:25.741609 19523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269069e75b534e84b2c449e2f154d93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.742722 19452 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2c8966757c476f86676de504686b00 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:25.741665 19598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269069e75b534e84b2c449e2f154d93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.745713 19526 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2c8966757c476f86676de504686b00 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:25.746737 19603 tablet_service.cc:1511] Processing CreateTablet for tablet 9e2c8966757c476f86676de504686b00 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:25.747365 19526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2c8966757c476f86676de504686b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.748314 19603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2c8966757c476f86676de504686b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.749980 19528 tablet_service.cc:1511] Processing CreateTablet for tablet df90d31873d24c379fed6cc1eb04c9d6 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:25.751565 19528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df90d31873d24c379fed6cc1eb04c9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.751272 19450 tablet_service.cc:1511] Processing CreateTablet for tablet df90d31873d24c379fed6cc1eb04c9d6 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:25.755882 19451 tablet_service.cc:1511] Processing CreateTablet for tablet 8e101a3cc4114f9b9ec4cfe36896dcbb (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:25.757055 19599 tablet_service.cc:1511] Processing CreateTablet for tablet df90d31873d24c379fed6cc1eb04c9d6 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:25.758865 19524 tablet_service.cc:1511] Processing CreateTablet for tablet 8e101a3cc4114f9b9ec4cfe36896dcbb (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:25.758870 19599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df90d31873d24c379fed6cc1eb04c9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.763712 19530 tablet_service.cc:1511] Processing CreateTablet for tablet b5644a024901490d8272f00555d6fa44 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:25.762195 19448 tablet_service.cc:1511] Processing CreateTablet for tablet b5644a024901490d8272f00555d6fa44 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:25.767877 19530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5644a024901490d8272f00555d6fa44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.769706 19524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e101a3cc4114f9b9ec4cfe36896dcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.769001 19597 tablet_service.cc:1511] Processing CreateTablet for tablet 8e101a3cc4114f9b9ec4cfe36896dcbb (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:25.771296 19597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e101a3cc4114f9b9ec4cfe36896dcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.769065 19527 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0cea8225664bc59149e6249ee9d8bb (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:25.773043 19453 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0cea8225664bc59149e6249ee9d8bb (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:25.774749 19527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0cea8225664bc59149e6249ee9d8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.775903 19531 tablet_service.cc:1511] Processing CreateTablet for tablet 34abc271aa494ce29403c97d385b4e71 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:25.778484 19531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34abc271aa494ce29403c97d385b4e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.780176 19605 tablet_service.cc:1511] Processing CreateTablet for tablet b5644a024901490d8272f00555d6fa44 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:25.786036 19529 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe7397269e242c18c94e42bfe40d0a8 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:25.786795 19605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5644a024901490d8272f00555d6fa44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.787985 19529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe7397269e242c18c94e42bfe40d0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.790338 19455 tablet_service.cc:1511] Processing CreateTablet for tablet 34abc271aa494ce29403c97d385b4e71 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:25.791836 19601 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0cea8225664bc59149e6249ee9d8bb (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:25.793570 19600 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe7397269e242c18c94e42bfe40d0a8 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:25.794413 19604 tablet_service.cc:1511] Processing CreateTablet for tablet b9adf359a7ac43e498e3a8173b502589 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:25.795553 19600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe7397269e242c18c94e42bfe40d0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.799494 19449 tablet_service.cc:1511] Processing CreateTablet for tablet 7fe7397269e242c18c94e42bfe40d0a8 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:25.792037 19602 tablet_service.cc:1511] Processing CreateTablet for tablet 34abc271aa494ce29403c97d385b4e71 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:25.739406 19454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269069e75b534e84b2c449e2f154d93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.806116 19604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9adf359a7ac43e498e3a8173b502589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.805663 19456 tablet_service.cc:1511] Processing CreateTablet for tablet b9adf359a7ac43e498e3a8173b502589 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:25.807586 19456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9adf359a7ac43e498e3a8173b502589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.811271 19525 tablet_service.cc:1511] Processing CreateTablet for tablet b9adf359a7ac43e498e3a8173b502589 (DEFAULT_TABLE table=soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:25.817376 19525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9adf359a7ac43e498e3a8173b502589. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.823990 19451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e101a3cc4114f9b9ec4cfe36896dcbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.823990 19601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0cea8225664bc59149e6249ee9d8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.827220 19602 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34abc271aa494ce29403c97d385b4e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.832422 19455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34abc271aa494ce29403c97d385b4e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.835335 19449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fe7397269e242c18c94e42bfe40d0a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.836316 19453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0cea8225664bc59149e6249ee9d8bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.840548 19448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5644a024901490d8272f00555d6fa44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.844126 19450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df90d31873d24c379fed6cc1eb04c9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:25.847647 19452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e2c8966757c476f86676de504686b00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:26.029284 19769 tablet_bootstrap.cc:492] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.100507 19768 tablet_bootstrap.cc:492] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.103926 19772 tablet_bootstrap.cc:492] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.125710 19768 tablet_bootstrap.cc:654] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.128175 19769 tablet_bootstrap.cc:654] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:26.130753 19432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:33053, user_credentials={real_user=slave}} blocked reactor thread for 97710.9us
I20260709 13:20:26.167100 19772 tablet_bootstrap.cc:654] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.177304 19768 tablet_bootstrap.cc:492] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.178262 19768 ts_tablet_manager.cc:1403] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.013s
I20260709 13:20:26.183861 19768 raft_consensus.cc:359] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.185199 19768 raft_consensus.cc:385] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.185634 19768 raft_consensus.cc:740] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.186776 19768 consensus_queue.cc:260] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.190958 19768 ts_tablet_manager.cc:1434] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.003s
I20260709 13:20:26.192849 19768 tablet_bootstrap.cc:492] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.196115 19772 tablet_bootstrap.cc:492] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.196467 19769 tablet_bootstrap.cc:492] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.196960 19772 ts_tablet_manager.cc:1403] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.094s	user 0.022s	sys 0.018s
I20260709 13:20:26.197072 19769 ts_tablet_manager.cc:1403] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.169s	user 0.021s	sys 0.008s
I20260709 13:20:26.200623 19772 raft_consensus.cc:359] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.201540 19772 raft_consensus.cc:385] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.201937 19768 tablet_bootstrap.cc:654] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.201939 19772 raft_consensus.cc:740] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.202360 19769 raft_consensus.cc:359] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.203227 19769 raft_consensus.cc:385] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.203433 19772 consensus_queue.cc:260] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.203583 19769 raft_consensus.cc:740] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.207544 19772 ts_tablet_manager.cc:1434] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:26.209384 19772 tablet_bootstrap.cc:492] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.206004 19769 consensus_queue.cc:260] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.212654 19769 ts_tablet_manager.cc:1434] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:20:26.214612 19769 tablet_bootstrap.cc:492] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.216713 19768 tablet_bootstrap.cc:492] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.217358 19768 ts_tablet_manager.cc:1403] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.008s
I20260709 13:20:26.217533 19772 tablet_bootstrap.cc:654] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.220841 19768 raft_consensus.cc:359] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.221961 19768 raft_consensus.cc:385] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.222118 19769 tablet_bootstrap.cc:654] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.222425 19768 raft_consensus.cc:740] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.227541 19768 consensus_queue.cc:260] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.232743 19768 ts_tablet_manager.cc:1434] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:20:26.234912 19768 tablet_bootstrap.cc:492] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.239485 19772 tablet_bootstrap.cc:492] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.240275 19772 ts_tablet_manager.cc:1403] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 13:20:26.240882 19769 tablet_bootstrap.cc:492] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.241602 19769 ts_tablet_manager.cc:1403] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.004s
I20260709 13:20:26.243889 19768 tablet_bootstrap.cc:654] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.244343 19772 raft_consensus.cc:359] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.245249 19772 raft_consensus.cc:385] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.244788 19769 raft_consensus.cc:359] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.245608 19772 raft_consensus.cc:740] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.246978 19772 consensus_queue.cc:260] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.250012 19772 ts_tablet_manager.cc:1434] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:20:26.251102 19772 tablet_bootstrap.cc:492] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.245875 19769 raft_consensus.cc:385] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.252489 19769 raft_consensus.cc:740] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.245661 19748 raft_consensus.cc:493] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.253118 19748 raft_consensus.cc:515] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.253691 19768 tablet_bootstrap.cc:492] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.253410 19769 consensus_queue.cc:260] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.254354 19768 ts_tablet_manager.cc:1403] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:20:26.255743 19748 leader_election.cc:290] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.255987 19769 ts_tablet_manager.cc:1434] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:20:26.258920 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.259927 19614 raft_consensus.cc:2468] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.261528 19772 tablet_bootstrap.cc:654] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.263427 19769 tablet_bootstrap.cc:492] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.263509 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
W20260709 13:20:26.265632 19505 leader_election.cc:343] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.266628 19768 raft_consensus.cc:359] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.267738 19768 raft_consensus.cc:385] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.268061 19768 raft_consensus.cc:740] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.269764 19768 consensus_queue.cc:260] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.273340 19769 tablet_bootstrap.cc:654] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.273955 19768 ts_tablet_manager.cc:1434] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:20:26.274750 19504 leader_election.cc:304] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.276196 19775 raft_consensus.cc:2804] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.276767 19775 raft_consensus.cc:493] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.277294 19775 raft_consensus.cc:3060] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.284406 19768 tablet_bootstrap.cc:492] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.288697 19774 raft_consensus.cc:493] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.289733 19774 raft_consensus.cc:515] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.294342 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
W20260709 13:20:26.297147 19432 leader_election.cc:343] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.294150 19775 raft_consensus.cc:515] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.300143 19774 leader_election.cc:290] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.300585 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
W20260709 13:20:26.302639 19429 leader_election.cc:343] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a079720156944039b22ad6526547f3a3 (127.7.122.67:34141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.303102 19429 leader_election.cc:304] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:26.304570 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.304620 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.305760 19614 raft_consensus.cc:3060] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:26.307055 19505 leader_election.cc:343] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.308056 19769 tablet_bootstrap.cc:492] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.304795 19774 raft_consensus.cc:2749] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.303119 19775 leader_election.cc:290] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.308691 19769 ts_tablet_manager.cc:1403] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.007s
I20260709 13:20:26.311632 19772 tablet_bootstrap.cc:492] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.312168 19772 ts_tablet_manager.cc:1403] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.061s	user 0.022s	sys 0.031s
I20260709 13:20:26.314396 19769 raft_consensus.cc:359] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.315255 19769 raft_consensus.cc:385] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.315129 19772 raft_consensus.cc:359] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.315351 19614 raft_consensus.cc:2468] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.315788 19769 raft_consensus.cc:740] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.315959 19772 raft_consensus.cc:385] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.316375 19772 raft_consensus.cc:740] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.316670 19769 consensus_queue.cc:260] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.317169 19504 leader_election.cc:304] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.317206 19772 consensus_queue.cc:260] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.319587 19772 ts_tablet_manager.cc:1434] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:20:26.320762 19772 tablet_bootstrap.cc:492] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.322800 19768 tablet_bootstrap.cc:654] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.326211 19769 ts_tablet_manager.cc:1434] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:20:26.331032 19772 tablet_bootstrap.cc:654] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.333564 19769 tablet_bootstrap.cc:492] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.339751 19775 raft_consensus.cc:2804] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.344686 19775 raft_consensus.cc:697] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:26.346355 19775 consensus_queue.cc:237] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.350299 19772 tablet_bootstrap.cc:492] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.350908 19772 ts_tablet_manager.cc:1403] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.001s
I20260709 13:20:26.354341 19772 raft_consensus.cc:359] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.355537 19772 raft_consensus.cc:385] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.355911 19772 raft_consensus.cc:740] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.358289 19772 consensus_queue.cc:260] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.359901 19768 tablet_bootstrap.cc:492] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.360496 19768 ts_tablet_manager.cc:1403] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.076s	user 0.033s	sys 0.009s
I20260709 13:20:26.361191 19772 ts_tablet_manager.cc:1434] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:20:26.362844 19769 tablet_bootstrap.cc:654] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.363605 19768 raft_consensus.cc:359] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.364280 19768 raft_consensus.cc:385] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.364557 19768 raft_consensus.cc:740] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.366093 19768 consensus_queue.cc:260] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.368103 19772 tablet_bootstrap.cc:492] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.369861 19768 ts_tablet_manager.cc:1434] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.001s
I20260709 13:20:26.371233 19768 tablet_bootstrap.cc:492] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.380570 19768 tablet_bootstrap.cc:654] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.386361 19772 tablet_bootstrap.cc:654] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.386613 19769 tablet_bootstrap.cc:492] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.387742 19769 ts_tablet_manager.cc:1403] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.001s
I20260709 13:20:26.391067 19769 raft_consensus.cc:359] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.392114 19769 raft_consensus.cc:385] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.392567 19769 raft_consensus.cc:740] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.394004 19769 consensus_queue.cc:260] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.396636 19769 ts_tablet_manager.cc:1434] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:20:26.397737 19361 catalog_manager.cc:5697] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.401728 19769 tablet_bootstrap.cc:492] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.408143 19768 tablet_bootstrap.cc:492] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.410455 19768 ts_tablet_manager.cc:1403] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.001s
I20260709 13:20:26.415138 19768 raft_consensus.cc:359] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.416399 19768 raft_consensus.cc:385] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.416738 19768 raft_consensus.cc:740] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.426692 19768 consensus_queue.cc:260] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.433113 19768 ts_tablet_manager.cc:1434] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 13:20:26.436106 19768 tablet_bootstrap.cc:492] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.436491 19769 tablet_bootstrap.cc:654] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.442842 19772 tablet_bootstrap.cc:492] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.443113 19768 tablet_bootstrap.cc:654] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.443881 19772 ts_tablet_manager.cc:1403] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.076s	user 0.029s	sys 0.033s
I20260709 13:20:26.448037 19772 raft_consensus.cc:359] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.449493 19772 raft_consensus.cc:385] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.450155 19772 raft_consensus.cc:740] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.451113 19772 consensus_queue.cc:260] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.456933 19772 ts_tablet_manager.cc:1434] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:20:26.458082 19772 tablet_bootstrap.cc:492] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.458806 19768 tablet_bootstrap.cc:492] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.459947 19768 ts_tablet_manager.cc:1403] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.004s
I20260709 13:20:26.463433 19768 raft_consensus.cc:359] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.464215 19768 raft_consensus.cc:385] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.464507 19768 raft_consensus.cc:740] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.465255 19768 consensus_queue.cc:260] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.465878 19772 tablet_bootstrap.cc:654] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.467876 19768 ts_tablet_manager.cc:1434] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:26.469020 19768 tablet_bootstrap.cc:492] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.471958 19772 tablet_bootstrap.cc:492] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.472579 19772 ts_tablet_manager.cc:1403] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 13:20:26.474818 19769 tablet_bootstrap.cc:492] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.475409 19769 ts_tablet_manager.cc:1403] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.008s
I20260709 13:20:26.475816 19772 raft_consensus.cc:359] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.476706 19772 raft_consensus.cc:385] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.477051 19772 raft_consensus.cc:740] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.476349 19768 tablet_bootstrap.cc:654] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.477934 19772 consensus_queue.cc:260] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.479511 19769 raft_consensus.cc:359] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.480388 19769 raft_consensus.cc:385] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.480733 19772 ts_tablet_manager.cc:1434] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.004s
I20260709 13:20:26.480747 19769 raft_consensus.cc:740] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.481969 19772 tablet_bootstrap.cc:492] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.482177 19775 raft_consensus.cc:493] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.482714 19775 raft_consensus.cc:515] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.485082 19775 leader_election.cc:290] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.481997 19769 consensus_queue.cc:260] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.486709 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.487865 19769 ts_tablet_manager.cc:1434] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:20:26.489003 19769 tablet_bootstrap.cc:492] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
W20260709 13:20:26.488834 19504 leader_election.cc:343] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a079720156944039b22ad6526547f3a3 (127.7.122.67:34141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.490411 19775 raft_consensus.cc:493] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.490789 19768 tablet_bootstrap.cc:492] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.491436 19768 ts_tablet_manager.cc:1403] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260709 13:20:26.486771 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.492467 19466 raft_consensus.cc:2468] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.494491 19505 leader_election.cc:304] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: a079720156944039b22ad6526547f3a3
I20260709 13:20:26.496031 19748 raft_consensus.cc:2804] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.491024 19775 raft_consensus.cc:515] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.497162 19768 raft_consensus.cc:359] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.498063 19768 raft_consensus.cc:385] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.498710 19775 leader_election.cc:290] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.496624 19748 raft_consensus.cc:493] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.499389 19748 raft_consensus.cc:3060] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.501760 19772 tablet_bootstrap.cc:654] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.503558 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe7397269e242c18c94e42bfe40d0a8" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.498735 19768 raft_consensus.cc:740] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.501760 19769 tablet_bootstrap.cc:654] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.505811 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe7397269e242c18c94e42bfe40d0a8" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.505635 19768 consensus_queue.cc:260] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.506460 19614 raft_consensus.cc:2468] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
W20260709 13:20:26.505111 19505 leader_election.cc:343] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.508375 19768 ts_tablet_manager.cc:1434] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:20:26.513846 19768 tablet_bootstrap.cc:492] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.513664 19504 leader_election.cc:304] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.514827 19775 raft_consensus.cc:2804] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.515300 19775 raft_consensus.cc:493] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.515643 19775 raft_consensus.cc:3060] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:26.516573 19412 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:26.520563 19748 raft_consensus.cc:515] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.523787 19748 leader_election.cc:290] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.523452 19775 raft_consensus.cc:515] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.524538 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.525203 19466 raft_consensus.cc:3060] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.525843 19772 tablet_bootstrap.cc:492] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.526072 19768 tablet_bootstrap.cc:654] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.515571 19769 tablet_bootstrap.cc:492] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.526955 19769 ts_tablet_manager.cc:1403] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.005s
I20260709 13:20:26.526213 19775 leader_election.cc:290] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.530154 19769 raft_consensus.cc:359] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.530930 19769 raft_consensus.cc:385] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.531224 19769 raft_consensus.cc:740] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.531400 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe7397269e242c18c94e42bfe40d0a8" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.531994 19768 tablet_bootstrap.cc:492] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.532238 19772 ts_tablet_manager.cc:1403] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.051s	user 0.013s	sys 0.004s
I20260709 13:20:26.532517 19768 ts_tablet_manager.cc:1403] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:20:26.532027 19769 consensus_queue.cc:260] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
W20260709 13:20:26.534603 19505 leader_election.cc:343] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.535737 19768 raft_consensus.cc:359] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.536306 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe7397269e242c18c94e42bfe40d0a8" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.536448 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.536458 19768 raft_consensus.cc:385] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.537114 19768 raft_consensus.cc:740] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.536479 19772 raft_consensus.cc:359] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.537752 19772 raft_consensus.cc:385] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.538120 19772 raft_consensus.cc:740] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.537963 19768 consensus_queue.cc:260] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.538874 19772 consensus_queue.cc:260] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.536978 19615 raft_consensus.cc:3060] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.539892 19614 raft_consensus.cc:3060] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.540561 19768 ts_tablet_manager.cc:1434] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:26.542081 19768 tablet_bootstrap.cc:492] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: Bootstrap starting.
I20260709 13:20:26.543104 19769 ts_tablet_manager.cc:1434] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:20:26.544255 19769 tablet_bootstrap.cc:492] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.547396 19615 raft_consensus.cc:2468] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.548439 19768 tablet_bootstrap.cc:654] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.551378 19769 tablet_bootstrap.cc:654] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.548548 19466 raft_consensus.cc:2468] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.552707 19775 raft_consensus.cc:493] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.553036 19772 ts_tablet_manager.cc:1434] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.007s
I20260709 13:20:26.553309 19775 raft_consensus.cc:515] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.553912 19504 leader_election.cc:304] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.554554 19772 tablet_bootstrap.cc:492] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.555656 19748 raft_consensus.cc:2804] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.557276 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cea8225664bc59149e6249ee9d8bb" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.558132 19615 raft_consensus.cc:2468] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.560807 19504 leader_election.cc:304] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:26.555624 19775 leader_election.cc:290] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.563127 19767 raft_consensus.cc:493] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.563889 19767 raft_consensus.cc:515] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.558962 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cea8225664bc59149e6249ee9d8bb" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.565649 19466 raft_consensus.cc:2468] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.566723 19775 raft_consensus.cc:2804] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.567149 19775 raft_consensus.cc:493] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.567566 19775 raft_consensus.cc:3060] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.569288 19767 leader_election.cc:290] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:26.574712 19614 raft_consensus.cc:2468] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.579214 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e101a3cc4114f9b9ec4cfe36896dcbb" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.580441 19775 raft_consensus.cc:515] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.583997 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cea8225664bc59149e6249ee9d8bb" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.575794 19505 leader_election.cc:304] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.584595 19615 raft_consensus.cc:3060] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.586613 19772 tablet_bootstrap.cc:654] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:26.585423 19579 leader_election.cc:343] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.586113 19803 raft_consensus.cc:2804] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.591719 19803 raft_consensus.cc:697] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:26.593245 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0cea8225664bc59149e6249ee9d8bb" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.593966 19465 raft_consensus.cc:3060] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.592685 19803 consensus_queue.cc:237] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.603192 19465 raft_consensus.cc:2468] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.603260 19615 raft_consensus.cc:2468] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.612705 19775 leader_election.cc:290] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.608494 19772 tablet_bootstrap.cc:492] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.620229 19772 ts_tablet_manager.cc:1403] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.004s
I20260709 13:20:26.623675 19504 leader_election.cc:304] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:26.625099 19807 raft_consensus.cc:2804] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.622973 19748 raft_consensus.cc:697] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:26.633882 19808 raft_consensus.cc:493] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.634500 19808 raft_consensus.cc:515] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.636458 19808 leader_election.cc:290] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:26.637256 19774 raft_consensus.cc:493] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.637436 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.638936 19772 raft_consensus.cc:359] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.639639 19772 raft_consensus.cc:385] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.639906 19772 raft_consensus.cc:740] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.640512 19808 raft_consensus.cc:493] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.627707 19807 raft_consensus.cc:697] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:26.641069 19808 raft_consensus.cc:515] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.641959 19807 consensus_queue.cc:237] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.643263 19802 raft_consensus.cc:493] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.646699 19748 consensus_queue.cc:237] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.637883 19774 raft_consensus.cc:515] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
W20260709 13:20:26.649104 19581 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.66:33053, user_credentials={real_user=slave}} blocked reactor thread for 67922.5us
I20260709 13:20:26.649868 19466 raft_consensus.cc:2468] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:26.651948 19678 raft_consensus.cc:493] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.652132 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.652412 19539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.652618 19678 raft_consensus.cc:515] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.652838 19541 raft_consensus.cc:2468] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:26.652326 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e101a3cc4114f9b9ec4cfe36896dcbb" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.654402 19432 leader_election.cc:304] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.654553 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.643808 19802 raft_consensus.cc:515] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.661509 19808 leader_election.cc:290] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:26.657543 19772 consensus_queue.cc:260] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.655218 19615 raft_consensus.cc:2468] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:26.667250 19774 leader_election.cc:290] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.655390 19773 raft_consensus.cc:2804] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.669317 19773 raft_consensus.cc:493] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.658972 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.669806 19773 raft_consensus.cc:3060] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.670284 19540 raft_consensus.cc:2468] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:26.671938 19432 leader_election.cc:304] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.655432 19579 leader_election.cc:304] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.654954 19678 leader_election.cc:290] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.675690 19678 raft_consensus.cc:493] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.676298 19678 raft_consensus.cc:515] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.678169 19768 tablet_bootstrap.cc:492] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: No bootstrap required, opened a new log
I20260709 13:20:26.679286 19678 leader_election.cc:290] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.679446 19768 ts_tablet_manager.cc:1403] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: Time spent bootstrapping tablet: real 0.138s	user 0.032s	sys 0.067s
W20260709 13:20:26.682070 19581 leader_election.cc:343] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.682615 19581 leader_election.cc:304] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a079720156944039b22ad6526547f3a3; no voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.669392 19772 ts_tablet_manager.cc:1434] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.008s
I20260709 13:20:26.684533 19772 tablet_bootstrap.cc:492] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: Bootstrap starting.
I20260709 13:20:26.687559 19767 raft_consensus.cc:2804] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.688166 19767 raft_consensus.cc:493] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.688611 19767 raft_consensus.cc:3060] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.694765 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.695731 19540 raft_consensus.cc:2468] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:26.687592 19768 raft_consensus.cc:359] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.698124 19768 raft_consensus.cc:385] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.699126 19768 raft_consensus.cc:740] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.700273 19808 raft_consensus.cc:2749] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.700651 19768 consensus_queue.cc:260] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.670292 19769 tablet_bootstrap.cc:492] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.703609 19802 leader_election.cc:290] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.704917 19769 ts_tablet_manager.cc:1403] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.161s	user 0.014s	sys 0.019s
I20260709 13:20:26.704792 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.705713 19615 raft_consensus.cc:2468] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.706992 19504 leader_election.cc:304] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:26.707835 19802 raft_consensus.cc:2804] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.708315 19802 raft_consensus.cc:493] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.708834 19802 raft_consensus.cc:3060] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.710022 19769 raft_consensus.cc:359] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.710834 19581 leader_election.cc:304] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:26.711167 19769 raft_consensus.cc:385] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.711961 19769 raft_consensus.cc:740] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.712075 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.712478 19768 ts_tablet_manager.cc:1434] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:20:26.713181 19808 raft_consensus.cc:2804] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.713805 19808 raft_consensus.cc:493] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.714246 19808 raft_consensus.cc:3060] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.714372 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.715685 19772 tablet_bootstrap.cc:654] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.680030 19678 raft_consensus.cc:2804] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.720824 19678 raft_consensus.cc:493] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.721360 19678 raft_consensus.cc:3060] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.724478 19769 consensus_queue.cc:260] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.727392 19466 raft_consensus.cc:2468] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 0.
I20260709 13:20:26.700651 19767 raft_consensus.cc:515] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.730908 19769 ts_tablet_manager.cc:1434] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:20:26.730738 19773 raft_consensus.cc:515] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.723661 19808 raft_consensus.cc:515] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.732333 19769 tablet_bootstrap.cc:492] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.743482 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.747709 19466 raft_consensus.cc:2393] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a079720156944039b22ad6526547f3a3 in current term 1: Already voted for candidate f0bf4771859f4045958021e7ea1be493 in this term.
I20260709 13:20:26.745849 19363 catalog_manager.cc:5697] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.751901 19808 leader_election.cc:290] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:26.760912 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:26.761974 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.762863 19466 raft_consensus.cc:3060] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.762562 19773 leader_election.cc:290] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.770519 19767 leader_election.cc:290] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:26.771919 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:26.771119 19802 raft_consensus.cc:515] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.772543 19541 raft_consensus.cc:3060] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.775002 19802 leader_election.cc:290] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
W20260709 13:20:26.776484 19429 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.122.67:34141, user_credentials={real_user=slave}} blocked reactor thread for 117736us
I20260709 13:20:26.773188 19540 raft_consensus.cc:2393] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a079720156944039b22ad6526547f3a3 in current term 1: Already voted for candidate 13f3b9cb92d842adab53cfae0f465880 in this term.
I20260709 13:20:26.778419 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.779440 19615 raft_consensus.cc:2393] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0bf4771859f4045958021e7ea1be493 in current term 1: Already voted for candidate 13f3b9cb92d842adab53cfae0f465880 in this term.
I20260709 13:20:26.781747 19772 tablet_bootstrap.cc:492] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: No bootstrap required, opened a new log
I20260709 13:20:26.782322 19772 ts_tablet_manager.cc:1403] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.014s
W20260709 13:20:26.758388 19432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.122.66:33053, user_credentials={real_user=slave}} blocked reactor thread for 86547.2us
I20260709 13:20:26.785614 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.786171 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.786448 19615 raft_consensus.cc:2393] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f3b9cb92d842adab53cfae0f465880 in current term 1: Already voted for candidate a079720156944039b22ad6526547f3a3 in this term.
I20260709 13:20:26.786949 19539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:26.785485 19541 raft_consensus.cc:2468] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:26.789300 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.790016 19464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.786415 19361 catalog_manager.cc:5697] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.793478 19678 raft_consensus.cc:515] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.794498 19581 leader_election.cc:304] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.794291 19361 catalog_manager.cc:5697] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.795535 19767 raft_consensus.cc:2804] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.796203 19678 leader_election.cc:290] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.796367 19767 raft_consensus.cc:697] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:26.775681 19769 tablet_bootstrap.cc:654] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.797350 19767 consensus_queue.cc:237] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
W20260709 13:20:26.800309 19429 leader_election.cc:343] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a079720156944039b22ad6526547f3a3 (127.7.122.67:34141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:26.800428 19772 raft_consensus.cc:359] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.801697 19772 raft_consensus.cc:385] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.802012 19772 raft_consensus.cc:740] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.802228 19429 leader_election.cc:304] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:26.802798 19772 consensus_queue.cc:260] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.804600 19774 raft_consensus.cc:3060] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.805498 19505 leader_election.cc:304] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880; no voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493
I20260709 13:20:26.807659 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.808365 19614 raft_consensus.cc:3060] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.809926 19772 ts_tablet_manager.cc:1434] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:20:26.812362 19748 raft_consensus.cc:2749] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.813360 19774 raft_consensus.cc:2749] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.814914 19466 raft_consensus.cc:2468] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 1.
I20260709 13:20:26.803457 19615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9adf359a7ac43e498e3a8173b502589" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.818007 19769 tablet_bootstrap.cc:492] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.818641 19769 ts_tablet_manager.cc:1403] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.087s	user 0.006s	sys 0.006s
I20260709 13:20:26.818672 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:26.819511 19541 raft_consensus.cc:3060] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.821857 19769 raft_consensus.cc:359] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.822650 19769 raft_consensus.cc:385] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.822962 19769 raft_consensus.cc:740] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.823648 19429 leader_election.cc:304] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:26.823652 19769 consensus_queue.cc:260] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.824904 19678 raft_consensus.cc:2749] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.828120 19769 ts_tablet_manager.cc:1434] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:26.829398 19769 tablet_bootstrap.cc:492] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: Bootstrap starting.
I20260709 13:20:26.829196 19579 leader_election.cc:304] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:26.830585 19614 raft_consensus.cc:2468] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:26.836182 19429 leader_election.cc:304] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.837195 19769 tablet_bootstrap.cc:654] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:26.837548 19774 raft_consensus.cc:2804] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.837114 19361 catalog_manager.cc:5697] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.838526 19774 raft_consensus.cc:697] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:26.838788 19767 raft_consensus.cc:2804] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.839444 19767 raft_consensus.cc:697] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:26.839634 19774 consensus_queue.cc:237] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.840392 19767 consensus_queue.cc:237] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.850085 19748 raft_consensus.cc:493] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.850812 19748 raft_consensus.cc:515] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.851729 19769 tablet_bootstrap.cc:492] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: No bootstrap required, opened a new log
I20260709 13:20:26.852321 19769 ts_tablet_manager.cc:1403] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.007s
I20260709 13:20:26.854707 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493" is_pre_election: true
I20260709 13:20:26.855458 19466 raft_consensus.cc:2468] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.855937 19748 leader_election.cc:290] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.855814 19769 raft_consensus.cc:359] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.856303 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.857121 19612 raft_consensus.cc:2468] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 0.
I20260709 13:20:26.834707 19541 raft_consensus.cc:2468] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:26.859474 19504 leader_election.cc:304] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:26.856765 19769 raft_consensus.cc:385] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:26.860486 19769 raft_consensus.cc:740] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Initialized, Role: FOLLOWER
I20260709 13:20:26.861338 19769 consensus_queue.cc:260] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.863790 19769 ts_tablet_manager.cc:1434] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:20:26.865099 19748 raft_consensus.cc:2804] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.865577 19748 raft_consensus.cc:493] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.865921 19748 raft_consensus.cc:3060] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.867671 19363 catalog_manager.cc:5697] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 1 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:26.872295 19748 raft_consensus.cc:515] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.874488 19748 leader_election.cc:290] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.876459 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.876574 19466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:26.877257 19612 raft_consensus.cc:3060] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.877431 19466 raft_consensus.cc:3060] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.879194 19361 catalog_manager.cc:5697] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.884200 19466 raft_consensus.cc:2468] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.884714 19774 raft_consensus.cc:493] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.885262 19612 raft_consensus.cc:2468] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 1.
I20260709 13:20:26.885519 19505 leader_election.cc:304] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.885353 19774 raft_consensus.cc:515] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.886543 19807 raft_consensus.cc:2804] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.887082 19807 raft_consensus.cc:697] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:26.888002 19774 leader_election.cc:290] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.887959 19807 consensus_queue.cc:237] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.889899 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e101a3cc4114f9b9ec4cfe36896dcbb" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.890650 19541 raft_consensus.cc:2468] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:26.889922 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e101a3cc4114f9b9ec4cfe36896dcbb" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.892194 19612 raft_consensus.cc:2468] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 0.
I20260709 13:20:26.893241 19432 leader_election.cc:304] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.894681 19811 raft_consensus.cc:2804] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:26.895100 19811 raft_consensus.cc:493] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:26.895423 19811 raft_consensus.cc:3060] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.901589 19363 catalog_manager.cc:5697] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 1 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.902912 19811 raft_consensus.cc:515] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.904884 19811 leader_election.cc:290] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.905527 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e101a3cc4114f9b9ec4cfe36896dcbb" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:26.905943 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e101a3cc4114f9b9ec4cfe36896dcbb" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:26.906133 19540 raft_consensus.cc:3060] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.906546 19612 raft_consensus.cc:3060] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.913872 19540 raft_consensus.cc:2468] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:26.915151 19612 raft_consensus.cc:2468] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 1.
I20260709 13:20:26.915174 19432 leader_election.cc:304] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:26.915457 19811 raft_consensus.cc:493] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:26.916913 19774 raft_consensus.cc:2804] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:26.916663 19811 raft_consensus.cc:515] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.918421 19774 raft_consensus.cc:697] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:26.919080 19811 leader_election.cc:290] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:26.919364 19774 consensus_queue.cc:237] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:26.919808 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe7397269e242c18c94e42bfe40d0a8" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13f3b9cb92d842adab53cfae0f465880" is_pre_election: true
I20260709 13:20:26.920768 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7fe7397269e242c18c94e42bfe40d0a8" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a079720156944039b22ad6526547f3a3" is_pre_election: true
I20260709 13:20:26.921640 19612 raft_consensus.cc:2393] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0bf4771859f4045958021e7ea1be493 in current term 1: Already voted for candidate 13f3b9cb92d842adab53cfae0f465880 in this term.
I20260709 13:20:26.922856 19429 leader_election.cc:304] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0bf4771859f4045958021e7ea1be493; no voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3
I20260709 13:20:26.923731 19811 raft_consensus.cc:3060] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:26.929416 19363 catalog_manager.cc:5697] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 1 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:26.930975 19811 raft_consensus.cc:2749] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:26.947850 19807 consensus_queue.cc:1048] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:26.966192 19748 consensus_queue.cc:1048] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.003331 19540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
mode: GRACEFUL
new_leader_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:20:27.003880 19540 raft_consensus.cc:606] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Received request to transfer leadership to TS f0bf4771859f4045958021e7ea1be493
I20260709 13:20:27.010500 19540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e2c8966757c476f86676de504686b00"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
mode: GRACEFUL
new_leader_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:20:27.011121 19540 raft_consensus.cc:606] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Received request to transfer leadership to TS f0bf4771859f4045958021e7ea1be493
I20260709 13:20:27.016829 19540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
mode: GRACEFUL
new_leader_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:52014
I20260709 13:20:27.017470 19540 raft_consensus.cc:606] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Received request to transfer leadership to TS f0bf4771859f4045958021e7ea1be493
I20260709 13:20:27.026953 19612 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5644a024901490d8272f00555d6fa44"
dest_uuid: "a079720156944039b22ad6526547f3a3"
mode: GRACEFUL
new_leader_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:49790
I20260709 13:20:27.027642 19612 raft_consensus.cc:606] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Received request to transfer leadership to TS 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:27.038627 19466 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
mode: GRACEFUL
new_leader_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:56396
I20260709 13:20:27.039242 19466 raft_consensus.cc:606] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Received request to transfer leadership to TS 13f3b9cb92d842adab53cfae0f465880
I20260709 13:20:27.066737 19802 consensus_queue.cc:1048] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.078269 19807 consensus_queue.cc:1048] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.086305 19748 raft_consensus.cc:993] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: : Instructing follower f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:27.086871 19807 raft_consensus.cc:1081] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Signalling peer f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:27.088685 19466 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:56386
I20260709 13:20:27.089320 19466 raft_consensus.cc:493] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.089622 19466 raft_consensus.cc:3060] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.094678 19466 raft_consensus.cc:515] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.095634 19807 consensus_queue.cc:1048] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:27.097419 19540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:27.097663 19612 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df90d31873d24c379fed6cc1eb04c9d6" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:27.098080 19540 raft_consensus.cc:3055] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.098467 19540 raft_consensus.cc:740] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:27.099252 19540 consensus_queue.cc:260] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.100088 19540 raft_consensus.cc:3060] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.101002 19466 leader_election.cc:290] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:27.106971 19612 raft_consensus.cc:3060] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.107429 19540 raft_consensus.cc:2468] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:27.108809 19432 leader_election.cc:304] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:27.109874 19811 raft_consensus.cc:2804] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.110337 19811 raft_consensus.cc:697] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:27.111191 19811 consensus_queue.cc:237] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.118671 19775 consensus_queue.cc:1048] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.122491 19612 raft_consensus.cc:2468] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:27.125536 19361 catalog_manager.cc:5697] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 1 to 2, leader changed from 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66) to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.189797 19775 consensus_queue.cc:1048] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.201069 19748 consensus_queue.cc:1048] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.283488 19808 consensus_queue.cc:1048] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.295456 19808 consensus_queue.cc:1048] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:27.315357 19811 consensus_queue.cc:1048] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.321321 19811 consensus_queue.cc:1048] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.326459 19811 consensus_queue.cc:1048] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:20:27.343791 19774 consensus_queue.cc:1048] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.352690 19678 raft_consensus.cc:993] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: : Instructing follower 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:27.353193 19678 raft_consensus.cc:1081] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Signalling peer 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:27.355077 19541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:51986
I20260709 13:20:27.355592 19541 raft_consensus.cc:493] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.355935 19541 raft_consensus.cc:3060] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.361938 19541 raft_consensus.cc:515] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.363682 19541 leader_election.cc:290] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:27.364768 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:27.365532 19614 raft_consensus.cc:3060] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.364769 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34abc271aa494ce29403c97d385b4e71" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:27.366875 19465 raft_consensus.cc:3055] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.367199 19465 raft_consensus.cc:740] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:27.367995 19465 consensus_queue.cc:260] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.369290 19465 raft_consensus.cc:3060] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.371712 19808 consensus_queue.cc:1048] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.373070 19614 raft_consensus.cc:2468] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:27.374377 19504 leader_election.cc:304] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:27.375226 19775 raft_consensus.cc:2804] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.375686 19775 raft_consensus.cc:697] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:27.376508 19775 consensus_queue.cc:237] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.378156 19465 raft_consensus.cc:2468] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:27.387306 19808 consensus_queue.cc:1048] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.389194 19361 catalog_manager.cc:5697] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 1 to 2, leader changed from f0bf4771859f4045958021e7ea1be493 (127.7.122.65) to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.396240 19835 raft_consensus.cc:993] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: : Instructing follower 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:27.396803 19835 raft_consensus.cc:1081] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Signalling peer 13f3b9cb92d842adab53cfae0f465880 to start an election
I20260709 13:20:27.399068 19541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5644a024901490d8272f00555d6fa44"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
 from {username='slave'} at 127.0.0.1:51998
I20260709 13:20:27.399639 19541 raft_consensus.cc:493] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.399989 19541 raft_consensus.cc:3060] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.400920 19748 consensus_queue.cc:1048] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:27.406488 19541 raft_consensus.cc:515] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.410559 19465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:27.411180 19465 raft_consensus.cc:3060] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.418921 19803 consensus_queue.cc:1048] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:27.419657 19541 leader_election.cc:290] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:27.421656 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5644a024901490d8272f00555d6fa44" candidate_uuid: "13f3b9cb92d842adab53cfae0f465880" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:27.422322 19614 raft_consensus.cc:3055] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.422658 19614 raft_consensus.cc:740] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:27.423471 19614 consensus_queue.cc:260] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.418907 19465 raft_consensus.cc:2468] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:27.428663 19505 leader_election.cc:304] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:27.429520 19775 raft_consensus.cc:2804] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.429672 19614 raft_consensus.cc:3060] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.430261 19802 raft_consensus.cc:993] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: : Instructing follower f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:27.430699 19802 raft_consensus.cc:1081] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Signalling peer f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:27.431579 19775 raft_consensus.cc:697] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Leader. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:27.432580 19775 consensus_queue.cc:237] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.438247 19614 raft_consensus.cc:2468] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f3b9cb92d842adab53cfae0f465880 in term 2.
I20260709 13:20:27.438117 19465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:56386
I20260709 13:20:27.439040 19465 raft_consensus.cc:493] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.439440 19465 raft_consensus.cc:3060] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.444593 19363 catalog_manager.cc:5697] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 reported cstate change: term changed from 1 to 2, leader changed from a079720156944039b22ad6526547f3a3 (127.7.122.67) to 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66). New cstate: current_term: 2 leader_uuid: "13f3b9cb92d842adab53cfae0f465880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.447258 19465 raft_consensus.cc:515] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.450635 19465 leader_election.cc:290] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:27.450912 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:27.451617 19541 raft_consensus.cc:3055] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.452107 19541 raft_consensus.cc:740] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:27.452217 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269069e75b534e84b2c449e2f154d93b" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:27.452852 19614 raft_consensus.cc:3060] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.453138 19541 consensus_queue.cc:260] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.454720 19541 raft_consensus.cc:3060] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.459061 19614 raft_consensus.cc:2468] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:27.460525 19541 raft_consensus.cc:2468] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:27.460583 19429 leader_election.cc:304] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:27.461695 19774 raft_consensus.cc:2804] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.462333 19774 raft_consensus.cc:697] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:27.463009 19774 consensus_queue.cc:237] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.470357 19363 catalog_manager.cc:5697] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 1 to 2, leader changed from 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66) to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.491243 19775 raft_consensus.cc:993] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: : Instructing follower f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:27.491775 19748 raft_consensus.cc:1081] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Signalling peer f0bf4771859f4045958021e7ea1be493 to start an election
I20260709 13:20:27.493489 19465 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e2c8966757c476f86676de504686b00"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
 from {username='slave'} at 127.0.0.1:56386
I20260709 13:20:27.494027 19465 raft_consensus.cc:493] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:27.494333 19465 raft_consensus.cc:3060] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.499722 19465 raft_consensus.cc:515] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.501446 19465 leader_election.cc:290] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Requested vote from peers 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053), a079720156944039b22ad6526547f3a3 (127.7.122.67:34141)
I20260709 13:20:27.502555 19541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:27.502619 19614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e2c8966757c476f86676de504686b00" candidate_uuid: "f0bf4771859f4045958021e7ea1be493" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a079720156944039b22ad6526547f3a3"
I20260709 13:20:27.503222 19541 raft_consensus.cc:3055] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:27.503350 19614 raft_consensus.cc:3060] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.503528 19541 raft_consensus.cc:740] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:27.504434 19541 consensus_queue.cc:260] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.505471 19541 raft_consensus.cc:3060] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.508312 19614 raft_consensus.cc:2468] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:27.509516 19429 leader_election.cc:304] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:27.510239 19774 raft_consensus.cc:2804] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:27.510663 19774 raft_consensus.cc:697] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Leader. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:27.511010 19541 raft_consensus.cc:2468] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0bf4771859f4045958021e7ea1be493 in term 2.
I20260709 13:20:27.511396 19774 consensus_queue.cc:237] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:27.519110 19363 catalog_manager.cc:5697] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 reported cstate change: term changed from 1 to 2, leader changed from 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66) to f0bf4771859f4045958021e7ea1be493 (127.7.122.65). New cstate: current_term: 2 leader_uuid: "f0bf4771859f4045958021e7ea1be493" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:27.532505 19614 raft_consensus.cc:1275] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.533798 19774 consensus_queue.cc:1048] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.545897 19541 raft_consensus.cc:1275] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.547703 19845 consensus_queue.cc:1048] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.834836 19466 raft_consensus.cc:1275] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.836263 19748 consensus_queue.cc:1048] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.845257 19614 raft_consensus.cc:1275] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.847079 19802 consensus_queue.cc:1048] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.871801 19614 raft_consensus.cc:1275] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.873306 19774 consensus_queue.cc:1048] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:27.881760 19541 raft_consensus.cc:1275] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.883460 19774 consensus_queue.cc:1048] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.888036 19614 raft_consensus.cc:1275] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.889994 19748 consensus_queue.cc:1048] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.898926 19466 raft_consensus.cc:1275] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Refusing update from remote peer 13f3b9cb92d842adab53cfae0f465880: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.900848 19775 consensus_queue.cc:1048] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.978252 19614 raft_consensus.cc:1275] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.979794 19811 consensus_queue.cc:1048] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:27.989666 19541 raft_consensus.cc:1275] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Refusing update from remote peer f0bf4771859f4045958021e7ea1be493: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:27.991546 19774 consensus_queue.cc:1048] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.049737 19363 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33894:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:30.076391 19363 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33894:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:30.171365  7657 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.230867 19885 tablet.cc:1724] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.267302 19875 log.cc:927] Time spent T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:20:30.377622 19908 tablet.cc:1724] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.336601 19893 tablet.cc:1724] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.371311 19901 tablet.cc:1724] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:30.437162 19881 log.cc:927] Time spent T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: Append to log took a long time: real 0.132s	user 0.004s	sys 0.001s
W20260709 13:20:30.439532 19900 log.cc:927] Time spent T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 13:20:30.426565 19899 tablet.cc:1724] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.461949 19885 tablet.cc:1724] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.428344 19898 tablet.cc:1724] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.482385 19908 tablet.cc:1724] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.504086 19920 tablet.cc:1724] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.504374 19911 tablet.cc:1724] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.521713 19917 tablet.cc:1724] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.525444 19893 tablet.cc:1724] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.540838 19898 tablet.cc:1724] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.548888 19899 tablet.cc:1724] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.553622 19917 tablet.cc:1724] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.558130 19901 tablet.cc:1724] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.582083 19921 tablet.cc:1724] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.589645 19916 tablet.cc:1724] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.582172 19919 tablet.cc:1724] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.633087 19538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573"
dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
mode: GRACEFUL
new_leader_uuid: "a079720156944039b22ad6526547f3a3"
 from {username='slave'} at 127.0.0.1:56538
I20260709 13:20:30.633792 19538 raft_consensus.cc:606] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Received request to transfer leadership to TS a079720156944039b22ad6526547f3a3
I20260709 13:20:30.632972 19899 tablet.cc:1724] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.641805 19921 tablet.cc:1724] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.657094 19917 tablet.cc:1724] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.660426 19919 tablet.cc:1724] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.644495 19898 tablet.cc:1724] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.652192 19920 tablet.cc:1724] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.672384 19916 tablet.cc:1724] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.686204 19919 tablet.cc:1724] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:30.708582 19463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f37f98f577248938245361e2def9199"
dest_uuid: "f0bf4771859f4045958021e7ea1be493"
mode: GRACEFUL
new_leader_uuid: "a079720156944039b22ad6526547f3a3"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:20:30.709408 19463 raft_consensus.cc:606] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Received request to transfer leadership to TS a079720156944039b22ad6526547f3a3
I20260709 13:20:30.710880  7657 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:30.711565  7657 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:30.714952 19363 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f: soft_deleted_table [id=21336ebeb4c14286811fdf562fd697d4] alter complete (version 1)
I20260709 13:20:30.777462 19862 raft_consensus.cc:993] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: : Instructing follower a079720156944039b22ad6526547f3a3 to start an election
I20260709 13:20:30.777961 19862 raft_consensus.cc:1081] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Signalling peer a079720156944039b22ad6526547f3a3 to start an election
I20260709 13:20:30.779458 19614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573"
dest_uuid: "a079720156944039b22ad6526547f3a3"
 from {username='slave'} at 127.0.0.1:49784
I20260709 13:20:30.779935 19614 raft_consensus.cc:493] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.780176 19614 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.785511 19614 raft_consensus.cc:515] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:30.787263 19614 leader_election.cc:290] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 3 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:30.788175 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:30.788681 19538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d038c6c55134b638eaef82cd6b71573" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:30.788930 19463 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.789290 19538 raft_consensus.cc:3055] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:30.789623 19538 raft_consensus.cc:740] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13f3b9cb92d842adab53cfae0f465880, State: Running, Role: LEADER
I20260709 13:20:30.790426 19538 consensus_queue.cc:260] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:30.791428 19538 raft_consensus.cc:3060] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.795253 19463 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 3.
I20260709 13:20:30.796628 19579 leader_election.cc:304] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a079720156944039b22ad6526547f3a3, f0bf4771859f4045958021e7ea1be493; no voters: 
I20260709 13:20:30.797520 19808 raft_consensus.cc:2804] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:30.797991 19808 raft_consensus.cc:697] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 3 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:30.798118 19538 raft_consensus.cc:2468] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 3.
I20260709 13:20:30.798846 19808 consensus_queue.cc:237] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:30.807548 19363 catalog_manager.cc:5697] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 2 to 3, leader changed from 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66) to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 3 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.843739 19896 raft_consensus.cc:993] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: : Instructing follower a079720156944039b22ad6526547f3a3 to start an election
I20260709 13:20:30.844467 19915 raft_consensus.cc:1081] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Signalling peer a079720156944039b22ad6526547f3a3 to start an election
I20260709 13:20:30.846127 19614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f37f98f577248938245361e2def9199"
dest_uuid: "a079720156944039b22ad6526547f3a3"
 from {username='slave'} at 127.0.0.1:49780
I20260709 13:20:30.846637 19614 raft_consensus.cc:493] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.846930 19614 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.851732 19614 raft_consensus.cc:515] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:30.853511 19614 leader_election.cc:290] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 3 election: Requested vote from peers f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141), 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053)
I20260709 13:20:30.854561 19538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13f3b9cb92d842adab53cfae0f465880"
I20260709 13:20:30.854561 19463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f37f98f577248938245361e2def9199" candidate_uuid: "a079720156944039b22ad6526547f3a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0bf4771859f4045958021e7ea1be493"
I20260709 13:20:30.855520 19538 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.855553 19463 raft_consensus.cc:3055] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:30.856181 19463 raft_consensus.cc:740] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0bf4771859f4045958021e7ea1be493, State: Running, Role: LEADER
I20260709 13:20:30.857048 19463 consensus_queue.cc:260] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:30.858171 19463 raft_consensus.cc:3060] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.861552 19538 raft_consensus.cc:2468] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 3.
I20260709 13:20:30.862861 19581 leader_election.cc:304] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f3b9cb92d842adab53cfae0f465880, a079720156944039b22ad6526547f3a3; no voters: 
I20260709 13:20:30.863651 19808 raft_consensus.cc:2804] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:30.864065 19808 raft_consensus.cc:697] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 3 LEADER]: Becoming Leader. State: Replica: a079720156944039b22ad6526547f3a3, State: Running, Role: LEADER
I20260709 13:20:30.864176 19463 raft_consensus.cc:2468] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a079720156944039b22ad6526547f3a3 in term 3.
I20260709 13:20:30.865077 19808 consensus_queue.cc:237] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } }
I20260709 13:20:30.873448 19363 catalog_manager.cc:5697] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 reported cstate change: term changed from 2 to 3, leader changed from f0bf4771859f4045958021e7ea1be493 (127.7.122.65) to a079720156944039b22ad6526547f3a3 (127.7.122.67). New cstate: current_term: 3 leader_uuid: "a079720156944039b22ad6526547f3a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a079720156944039b22ad6526547f3a3" member_type: VOTER last_known_addr { host: "127.7.122.67" port: 34141 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.234993 19541 raft_consensus.cc:1275] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Refusing update from remote peer a079720156944039b22ad6526547f3a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.236546 19808 consensus_queue.cc:1048] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:31.248131 19463 raft_consensus.cc:1275] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Refusing update from remote peer a079720156944039b22ad6526547f3a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.254776 19808 consensus_queue.cc:1048] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.319911 19463 raft_consensus.cc:1275] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Refusing update from remote peer a079720156944039b22ad6526547f3a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.321424 19930 consensus_queue.cc:1048] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0bf4771859f4045958021e7ea1be493" member_type: VOTER last_known_addr { host: "127.7.122.65" port: 41141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.332919 19541 raft_consensus.cc:1275] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Refusing update from remote peer a079720156944039b22ad6526547f3a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.334877 19808 consensus_queue.cc:1048] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f3b9cb92d842adab53cfae0f465880" member_type: VOTER last_known_addr { host: "127.7.122.66" port: 33053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:31.783924  7657 tablet_server.cc:179] TabletServer@127.7.122.65:0 shutting down...
W20260709 13:20:31.788568 19579 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
W20260709 13:20:31.792600 19505 consensus_peers.cc:597] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 -> Peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Couldn't send request to peer f0bf4771859f4045958021e7ea1be493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:31.792922 19579 consensus_peers.cc:597] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 -> Peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Couldn't send request to peer f0bf4771859f4045958021e7ea1be493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:31.809514 19505 consensus_peers.cc:597] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 -> Peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Couldn't send request to peer f0bf4771859f4045958021e7ea1be493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:31.817099 19505 consensus_peers.cc:597] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 -> Peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Couldn't send request to peer f0bf4771859f4045958021e7ea1be493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:31.821419 19579 consensus_peers.cc:597] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 -> Peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Couldn't send request to peer f0bf4771859f4045958021e7ea1be493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:31.829321  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:31.831278  7657 tablet_replica.cc:333] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.832048  7657 raft_consensus.cc:2243] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.833063  7657 raft_consensus.cc:2272] T 8e101a3cc4114f9b9ec4cfe36896dcbb P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.835644  7657 tablet_replica.cc:333] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.836350  7657 raft_consensus.cc:2243] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.836823  7657 raft_consensus.cc:2272] T b5644a024901490d8272f00555d6fa44 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.838820  7657 tablet_replica.cc:333] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.839432  7657 raft_consensus.cc:2243] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.839887  7657 raft_consensus.cc:2272] T 3d0cea8225664bc59149e6249ee9d8bb P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.841869  7657 tablet_replica.cc:333] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.842500  7657 raft_consensus.cc:2243] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.843000  7657 raft_consensus.cc:2272] T 34abc271aa494ce29403c97d385b4e71 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.844836  7657 tablet_replica.cc:333] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.845460  7657 raft_consensus.cc:2243] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.846367  7657 raft_consensus.cc:2272] T 9e2c8966757c476f86676de504686b00 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.848315  7657 tablet_replica.cc:333] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.848984  7657 raft_consensus.cc:2243] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.849444  7657 raft_consensus.cc:2272] T b9adf359a7ac43e498e3a8173b502589 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.851476  7657 tablet_replica.cc:333] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.852074  7657 raft_consensus.cc:2243] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.853016  7657 raft_consensus.cc:2272] T 69848ac78e1148979677509a52df8579 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.855882  7657 tablet_replica.cc:333] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.856736  7657 raft_consensus.cc:2243] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.857337  7657 raft_consensus.cc:2272] T 1f37f98f577248938245361e2def9199 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.860213  7657 tablet_replica.cc:333] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.860843  7657 raft_consensus.cc:2243] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.861726  7657 raft_consensus.cc:2272] T 269069e75b534e84b2c449e2f154d93b P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.863934  7657 tablet_replica.cc:333] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.864711  7657 raft_consensus.cc:2243] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.865633  7657 raft_consensus.cc:2272] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.868160  7657 tablet_replica.cc:333] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.868849  7657 raft_consensus.cc:2243] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.869401  7657 raft_consensus.cc:2272] T 1d038c6c55134b638eaef82cd6b71573 P f0bf4771859f4045958021e7ea1be493 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.873514  7657 tablet_replica.cc:333] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.874393  7657 raft_consensus.cc:2243] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.875159  7657 raft_consensus.cc:2272] T 54a73a0103c74ee1960ca0d4e885676d P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.877651  7657 tablet_replica.cc:333] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.878307  7657 raft_consensus.cc:2243] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.879060  7657 raft_consensus.cc:2272] T 4bd5407becc24ba795d7005349f58dba P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.882378  7657 tablet_replica.cc:333] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.883109  7657 raft_consensus.cc:2243] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.883733  7657 raft_consensus.cc:2272] T c84d156f10b946a5a606abc4b01e0285 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.886420  7657 tablet_replica.cc:333] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.887198  7657 raft_consensus.cc:2243] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.888067  7657 raft_consensus.cc:2272] T 94b9096dc5ca40daa09a2b7c363727b8 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.890738  7657 tablet_replica.cc:333] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.891436  7657 raft_consensus.cc:2243] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.892187  7657 raft_consensus.cc:2272] T 7fe7397269e242c18c94e42bfe40d0a8 P f0bf4771859f4045958021e7ea1be493 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.895149  7657 tablet_replica.cc:333] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.895860  7657 raft_consensus.cc:2243] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:31.897032  7657 raft_consensus.cc:2272] T df90d31873d24c379fed6cc1eb04c9d6 P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:31.900074  7657 tablet_replica.cc:333] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493: stopping tablet replica
I20260709 13:20:31.900624  7657 raft_consensus.cc:2243] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:31.901139  7657 raft_consensus.cc:2272] T ee1c455f49944115869891cf2ed24fbd P f0bf4771859f4045958021e7ea1be493 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:31.913504 19579 consensus_peers.cc:597] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 -> Peer f0bf4771859f4045958021e7ea1be493 (127.7.122.65:41141): Couldn't send request to peer f0bf4771859f4045958021e7ea1be493. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:31.940301  7657 tablet_server.cc:196] TabletServer@127.7.122.65:0 shutdown complete.
I20260709 13:20:31.977953  7657 tablet_server.cc:179] TabletServer@127.7.122.66:0 shutting down...
I20260709 13:20:32.010550  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:32.011559  7657 tablet_replica.cc:333] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.012368  7657 raft_consensus.cc:2243] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.012997  7657 raft_consensus.cc:2272] T 8e101a3cc4114f9b9ec4cfe36896dcbb P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.015098  7657 tablet_replica.cc:333] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.015736  7657 raft_consensus.cc:2243] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.016238  7657 raft_consensus.cc:2272] T b9adf359a7ac43e498e3a8173b502589 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.018249  7657 tablet_replica.cc:333] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.018860  7657 raft_consensus.cc:2243] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.019681  7657 raft_consensus.cc:2272] T 34abc271aa494ce29403c97d385b4e71 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.021890  7657 tablet_replica.cc:333] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.022552  7657 raft_consensus.cc:2243] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.023386  7657 raft_consensus.cc:2272] T 3d0cea8225664bc59149e6249ee9d8bb P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.025419  7657 tablet_replica.cc:333] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.026014  7657 raft_consensus.cc:2243] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.026818  7657 raft_consensus.cc:2272] T b5644a024901490d8272f00555d6fa44 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.028820  7657 tablet_replica.cc:333] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.029551  7657 raft_consensus.cc:2243] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.030011  7657 raft_consensus.cc:2272] T 54a73a0103c74ee1960ca0d4e885676d P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.032749  7657 tablet_replica.cc:333] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.033442  7657 raft_consensus.cc:2243] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.034209  7657 raft_consensus.cc:2272] T df90d31873d24c379fed6cc1eb04c9d6 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.036289  7657 tablet_replica.cc:333] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.037002  7657 raft_consensus.cc:2243] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.038251  7657 raft_consensus.cc:2272] T 7fe7397269e242c18c94e42bfe40d0a8 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.040975  7657 tablet_replica.cc:333] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.041644  7657 raft_consensus.cc:2243] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.042914  7657 raft_consensus.cc:2272] T ee1c455f49944115869891cf2ed24fbd P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.045923  7657 tablet_replica.cc:333] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.046651  7657 raft_consensus.cc:2243] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.047410  7657 raft_consensus.cc:2272] T 94b9096dc5ca40daa09a2b7c363727b8 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.049878  7657 tablet_replica.cc:333] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.050575  7657 raft_consensus.cc:2243] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.051471  7657 raft_consensus.cc:2272] T c84d156f10b946a5a606abc4b01e0285 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.054083  7657 tablet_replica.cc:333] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.054738  7657 raft_consensus.cc:2243] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.055296  7657 raft_consensus.cc:2272] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.057823  7657 tablet_replica.cc:333] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.058483  7657 raft_consensus.cc:2243] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.058962  7657 raft_consensus.cc:2272] T 1d038c6c55134b638eaef82cd6b71573 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.062578  7657 tablet_replica.cc:333] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.063233  7657 raft_consensus.cc:2243] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.063740  7657 raft_consensus.cc:2272] T 269069e75b534e84b2c449e2f154d93b P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.065722  7657 tablet_replica.cc:333] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.066313  7657 raft_consensus.cc:2243] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.066762  7657 raft_consensus.cc:2272] T 69848ac78e1148979677509a52df8579 P 13f3b9cb92d842adab53cfae0f465880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.068753  7657 tablet_replica.cc:333] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.069301  7657 raft_consensus.cc:2243] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.069770  7657 raft_consensus.cc:2272] T 1f37f98f577248938245361e2def9199 P 13f3b9cb92d842adab53cfae0f465880 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.072376  7657 tablet_replica.cc:333] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.073072  7657 raft_consensus.cc:2243] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.073940  7657 raft_consensus.cc:2272] T 4bd5407becc24ba795d7005349f58dba P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.075925  7657 tablet_replica.cc:333] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880: stopping tablet replica
I20260709 13:20:32.076442  7657 raft_consensus.cc:2243] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.076932  7657 raft_consensus.cc:2272] T 9e2c8966757c476f86676de504686b00 P 13f3b9cb92d842adab53cfae0f465880 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.117630  7657 tablet_server.cc:196] TabletServer@127.7.122.66:0 shutdown complete.
W20260709 13:20:32.130275 19581 consensus_peers.cc:597] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 -> Peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Couldn't send request to peer 13f3b9cb92d842adab53cfae0f465880. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:33053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:32.155319  7657 tablet_server.cc:179] TabletServer@127.7.122.67:0 shutting down...
W20260709 13:20:32.185621 19581 consensus_peers.cc:597] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 -> Peer 13f3b9cb92d842adab53cfae0f465880 (127.7.122.66:33053): Couldn't send request to peer 13f3b9cb92d842adab53cfae0f465880. Status: Network error: Client connection negotiation failed: client connection to 127.7.122.66:33053: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:32.190615  7657 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:32.191699  7657 tablet_replica.cc:333] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.192541  7657 raft_consensus.cc:2243] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.193101  7657 raft_consensus.cc:2272] T 34abc271aa494ce29403c97d385b4e71 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.195032  7657 tablet_replica.cc:333] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.195641  7657 raft_consensus.cc:2243] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.196489  7657 raft_consensus.cc:2272] T b9adf359a7ac43e498e3a8173b502589 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.198617  7657 tablet_replica.cc:333] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.199259  7657 raft_consensus.cc:2243] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.199730  7657 raft_consensus.cc:2272] T 3d0cea8225664bc59149e6249ee9d8bb P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.201647  7657 tablet_replica.cc:333] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.202234  7657 raft_consensus.cc:2243] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.202687  7657 raft_consensus.cc:2272] T b5644a024901490d8272f00555d6fa44 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.204557  7657 tablet_replica.cc:333] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.205222  7657 raft_consensus.cc:2243] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.205677  7657 raft_consensus.cc:2272] T df90d31873d24c379fed6cc1eb04c9d6 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.207477  7657 tablet_replica.cc:333] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.208057  7657 raft_consensus.cc:2243] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.208509  7657 raft_consensus.cc:2272] T 7fe7397269e242c18c94e42bfe40d0a8 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.210713  7657 tablet_replica.cc:333] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.211333  7657 raft_consensus.cc:2243] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.211791  7657 raft_consensus.cc:2272] T ee1c455f49944115869891cf2ed24fbd P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.213914  7657 tablet_replica.cc:333] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.214509  7657 raft_consensus.cc:2243] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.214951  7657 raft_consensus.cc:2272] T 8e101a3cc4114f9b9ec4cfe36896dcbb P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.216766  7657 tablet_replica.cc:333] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.217435  7657 raft_consensus.cc:2243] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.218238  7657 raft_consensus.cc:2272] T 54a73a0103c74ee1960ca0d4e885676d P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.220602  7657 tablet_replica.cc:333] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.221210  7657 raft_consensus.cc:2243] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.221685  7657 raft_consensus.cc:2272] T 9e2c8966757c476f86676de504686b00 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.223464  7657 tablet_replica.cc:333] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.223984  7657 raft_consensus.cc:2243] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.224421  7657 raft_consensus.cc:2272] T 269069e75b534e84b2c449e2f154d93b P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.226212  7657 tablet_replica.cc:333] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.226759  7657 raft_consensus.cc:2243] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.227556  7657 raft_consensus.cc:2272] T 1f37f98f577248938245361e2def9199 P a079720156944039b22ad6526547f3a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.230595  7657 tablet_replica.cc:333] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.231199  7657 raft_consensus.cc:2243] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.231774  7657 raft_consensus.cc:2272] T 69848ac78e1148979677509a52df8579 P a079720156944039b22ad6526547f3a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.233801  7657 tablet_replica.cc:333] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.234359  7657 raft_consensus.cc:2243] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.234813  7657 raft_consensus.cc:2272] T 4bd5407becc24ba795d7005349f58dba P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.236680  7657 tablet_replica.cc:333] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.237309  7657 raft_consensus.cc:2243] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.238191  7657 raft_consensus.cc:2272] T c84d156f10b946a5a606abc4b01e0285 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.240494  7657 tablet_replica.cc:333] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.241101  7657 raft_consensus.cc:2243] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.241545  7657 raft_consensus.cc:2272] T 94b9096dc5ca40daa09a2b7c363727b8 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.243609  7657 tablet_replica.cc:333] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.244109  7657 raft_consensus.cc:2243] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.244623  7657 raft_consensus.cc:2272] T d5ae544f1a5a48daaf69cfa73c5cd0f0 P a079720156944039b22ad6526547f3a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.246654  7657 tablet_replica.cc:333] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3: stopping tablet replica
I20260709 13:20:32.247184  7657 raft_consensus.cc:2243] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.248042  7657 raft_consensus.cc:2272] T 1d038c6c55134b638eaef82cd6b71573 P a079720156944039b22ad6526547f3a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.290412  7657 tablet_server.cc:196] TabletServer@127.7.122.67:0 shutdown complete.
I20260709 13:20:32.320779  7657 master.cc:562] Master@127.7.122.126:36875 shutting down...
I20260709 13:20:32.346905  7657 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:32.347681  7657 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.348054  7657 tablet_replica.cc:333] T 00000000000000000000000000000000 P ff4108ea6bfb412db127791e4182653f: stopping tablet replica
I20260709 13:20:32.371532  7657 master.cc:584] Master@127.7.122.126:36875 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12153 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25677 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (348697 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:20:32.434963  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 425 messages since previous log ~15 seconds ago
I20260709 13:20:32.435236  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 425 messages since previous log ~15 seconds ago
I20260709 13:20:32.435456  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 416 messages since previous log ~15 seconds ago
I20260709 13:20:32.435720  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:20:32.435911  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:20:32.436177  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 10 messages since previous log ~206 seconds ago
I20260709 13:20:32.437000  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:20:32.437376  7657 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
